[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:13:24.058185 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:42337
I20260709 13:13:24.059659 29718 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:13:24.060743 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.077935 29725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.077927 29724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:24.079093 29727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.080294 29718 server_base.cc:1061] running on GCE node
I20260709 13:13:25.277835 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.278126 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.278379 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602805278344 us; error 0 us; skew 500 ppm
I20260709 13:13:25.279244 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.286154 29718 webserver.cc:533] Webserver started at http://127.29.5.190:36411/ using document root <none> and password file <none>
I20260709 13:13:25.287096 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.287351 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.287871 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.293881 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "9258af6ecc2f4342b33bc294675798af"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-kgkf"
I20260709 13:13:25.301717 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:13:25.306864 29733 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.308069 29718 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:25.308436 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "9258af6ecc2f4342b33bc294675798af"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-kgkf"
I20260709 13:13:25.308795 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.366367 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.368026 29718 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:13:25.368538 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.441697 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:42337
I20260709 13:13:25.441777 29784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:42337 every 8 connection(s)
I20260709 13:13:25.449782 29785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:25.471410 29785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af: Bootstrap starting.
I20260709 13:13:25.477861 29785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.479641 29785 log.cc:826] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af: Log is configured to *not* fsync() on all Append() calls
I20260709 13:13:25.484269 29785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af: No bootstrap required, opened a new log
I20260709 13:13:25.504804 29785 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9258af6ecc2f4342b33bc294675798af" member_type: VOTER }
I20260709 13:13:25.505394 29785 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.505594 29785 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9258af6ecc2f4342b33bc294675798af, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.506577 29785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9258af6ecc2f4342b33bc294675798af" member_type: VOTER }
I20260709 13:13:25.507054 29785 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:25.507301 29785 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:25.507589 29785 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.511689 29785 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9258af6ecc2f4342b33bc294675798af" member_type: VOTER }
I20260709 13:13:25.512378 29785 leader_election.cc:304] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9258af6ecc2f4342b33bc294675798af; no voters: 
I20260709 13:13:25.514065 29785 leader_election.cc:290] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:25.514415 29788 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.516817 29788 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 1 LEADER]: Becoming Leader. State: Replica: 9258af6ecc2f4342b33bc294675798af, State: Running, Role: LEADER
I20260709 13:13:25.517771 29788 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9258af6ecc2f4342b33bc294675798af" member_type: VOTER }
I20260709 13:13:25.518838 29785 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:25.529390 29790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9258af6ecc2f4342b33bc294675798af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9258af6ecc2f4342b33bc294675798af" member_type: VOTER } }
I20260709 13:13:25.530330 29790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:25.533910 29789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9258af6ecc2f4342b33bc294675798af. Latest consensus state: current_term: 1 leader_uuid: "9258af6ecc2f4342b33bc294675798af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9258af6ecc2f4342b33bc294675798af" member_type: VOTER } }
I20260709 13:13:25.534636 29789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:25.535377 29798 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:25.548447 29798 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:25.550870 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:25.565932 29798 catalog_manager.cc:1383] Generated new cluster ID: 57bd3639d73d461c9850215dca0b74de
I20260709 13:13:25.566283 29798 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:25.594864 29798 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:25.597069 29798 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:25.615178 29798 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af: Generated new TSK 0
I20260709 13:13:25.616158 29798 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:25.682318 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.692251 29807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.694109 29808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.696139 29718 server_base.cc:1061] running on GCE node
W20260709 13:13:25.696626 29810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.697628 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.697899 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.698118 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602805698095 us; error 0 us; skew 500 ppm
I20260709 13:13:25.698900 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.702986 29718 webserver.cc:533] Webserver started at http://127.29.5.129:34409/ using document root <none> and password file <none>
I20260709 13:13:25.703688 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.703966 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.704310 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.705837 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "d0f2aa36fdcc45c484ab32dad5174593"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-kgkf"
I20260709 13:13:25.712846 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:25.718139 29815 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.718986 29718 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:25.719337 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "d0f2aa36fdcc45c484ab32dad5174593"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-kgkf"
I20260709 13:13:25.719714 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.742662 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.744482 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.747268 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:25.752789 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:25.753098 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.753398 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:25.753624 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.843845 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:43583
I20260709 13:13:25.843938 29877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:43583 every 8 connection(s)
I20260709 13:13:25.851585 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:25.860621 29882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:25.863332 29883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.872045 29718 server_base.cc:1061] running on GCE node
W20260709 13:13:25.871727 29885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:25.873485 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:25.873783 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:25.873997 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602805873977 us; error 0 us; skew 500 ppm
I20260709 13:13:25.874743 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:25.879130 29878 heartbeater.cc:344] Connected to a master server at 127.29.5.190:42337
I20260709 13:13:25.879601 29878 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:25.880795 29878 heartbeater.cc:507] Master 127.29.5.190:42337 requested a full tablet report, sending...
I20260709 13:13:25.884487 29750 ts_manager.cc:194] Registered new tserver with Master: d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583)
I20260709 13:13:25.887277 29718 webserver.cc:533] Webserver started at http://127.29.5.130:43511/ using document root <none> and password file <none>
I20260709 13:13:25.887468 29750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53298
I20260709 13:13:25.887902 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:25.888160 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:25.888461 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:25.889752 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "89daee0e84be4ae0be4cad52aa8039b9"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-kgkf"
I20260709 13:13:25.895135 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:13:25.899315 29890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.900172 29718 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:25.900473 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "89daee0e84be4ae0be4cad52aa8039b9"
format_stamp: "Formatted at 2026-07-09 13:13:25 on dist-test-slave-kgkf"
I20260709 13:13:25.900770 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:25.936048 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:25.937347 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:25.939987 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:25.942894 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:25.943066 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:25.943375 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:25.943514 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.036041 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:36513
I20260709 13:13:26.036118 29952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:36513 every 8 connection(s)
I20260709 13:13:26.043279 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.054356 29957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.053131 29956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.063557 29718 server_base.cc:1061] running on GCE node
W20260709 13:13:26.064558 29959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.065084 29953 heartbeater.cc:344] Connected to a master server at 127.29.5.190:42337
I20260709 13:13:26.065465 29953 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.065618 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.065904 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.066104 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602806066084 us; error 0 us; skew 500 ppm
I20260709 13:13:26.066331 29953 heartbeater.cc:507] Master 127.29.5.190:42337 requested a full tablet report, sending...
I20260709 13:13:26.066776 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.068796 29750 ts_manager.cc:194] Registered new tserver with Master: 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:26.069758 29718 webserver.cc:533] Webserver started at http://127.29.5.131:40983/ using document root <none> and password file <none>
I20260709 13:13:26.070370 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.070591 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:26.070614 29750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53312
I20260709 13:13:26.070981 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:26.072431 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "7e0734fa1b8e46bd869e346ae79a4675"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-kgkf"
I20260709 13:13:26.077265 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:26.081127 29964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.081954 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:26.082264 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "7e0734fa1b8e46bd869e346ae79a4675"
format_stamp: "Formatted at 2026-07-09 13:13:26 on dist-test-slave-kgkf"
I20260709 13:13:26.082574 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:26.112668 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.114084 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.115585 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.117882 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:26.118058 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.118335 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:26.118494 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.210542 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:33603
I20260709 13:13:26.210691 30026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:33603 every 8 connection(s)
I20260709 13:13:26.226323 30027 heartbeater.cc:344] Connected to a master server at 127.29.5.190:42337
I20260709 13:13:26.226696 30027 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.227523 30027 heartbeater.cc:507] Master 127.29.5.190:42337 requested a full tablet report, sending...
I20260709 13:13:26.229456 29750 ts_manager.cc:194] Registered new tserver with Master: 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:26.229758 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014556722s
I20260709 13:13:26.231132 29750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53322
I20260709 13:13:26.282557 29750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53338:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:26.286403 29750 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:26.414631 29843 tablet_service.cc:1511] Processing CreateTablet for tablet 28dc0277e12643bf89a534f800f8106a (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:26.417093 29842 tablet_service.cc:1511] Processing CreateTablet for tablet 5c80447cf71f46d2a02edee2f2a82d74 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:26.423425 29843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dc0277e12643bf89a534f800f8106a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.427199 29842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c80447cf71f46d2a02edee2f2a82d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.428778 29838 tablet_service.cc:1511] Processing CreateTablet for tablet fbde894b43d549839a0a80b522e323ca (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:26.430583 29840 tablet_service.cc:1511] Processing CreateTablet for tablet e8ddcd68825c432b915f6196dc532b5c (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:26.427985 29839 tablet_service.cc:1511] Processing CreateTablet for tablet 5687528a8fb44360bd95831f2b1d838d (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:26.428725 29841 tablet_service.cc:1511] Processing CreateTablet for tablet 18833fd9a1534e78a3b239a54a71ae47 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:26.425689 29837 tablet_service.cc:1511] Processing CreateTablet for tablet 73c8406ed82f41a39d22eedd2cfaa735 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:26.431958 29838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbde894b43d549839a0a80b522e323ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.435895 29839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5687528a8fb44360bd95831f2b1d838d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.437551 29841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18833fd9a1534e78a3b239a54a71ae47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.443360 29991 tablet_service.cc:1511] Processing CreateTablet for tablet 5c80447cf71f46d2a02edee2f2a82d74 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:26.446318 29836 tablet_service.cc:1511] Processing CreateTablet for tablet e27c11ad9b2c45bc9e8f774767c4e404 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:26.447614 29991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c80447cf71f46d2a02edee2f2a82d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.449261 29990 tablet_service.cc:1511] Processing CreateTablet for tablet 18833fd9a1534e78a3b239a54a71ae47 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:26.440793 29992 tablet_service.cc:1511] Processing CreateTablet for tablet 28dc0277e12643bf89a534f800f8106a (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:26.449626 29840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ddcd68825c432b915f6196dc532b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.454869 29990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18833fd9a1534e78a3b239a54a71ae47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.459064 29992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dc0277e12643bf89a534f800f8106a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.461388 29836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c11ad9b2c45bc9e8f774767c4e404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.464974 29989 tablet_service.cc:1511] Processing CreateTablet for tablet e8ddcd68825c432b915f6196dc532b5c (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:26.466694 29989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ddcd68825c432b915f6196dc532b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.469385 29987 tablet_service.cc:1511] Processing CreateTablet for tablet fbde894b43d549839a0a80b522e323ca (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:26.471086 29987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbde894b43d549839a0a80b522e323ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.473905 29988 tablet_service.cc:1511] Processing CreateTablet for tablet 5687528a8fb44360bd95831f2b1d838d (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:26.475592 29988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5687528a8fb44360bd95831f2b1d838d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.487659 29835 tablet_service.cc:1511] Processing CreateTablet for tablet 57e73dd62d4f4552822e5c2f12932637 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:26.489161 29835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e73dd62d4f4552822e5c2f12932637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.495738 29837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c8406ed82f41a39d22eedd2cfaa735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.500916 29986 tablet_service.cc:1511] Processing CreateTablet for tablet 73c8406ed82f41a39d22eedd2cfaa735 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:26.503288 29986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c8406ed82f41a39d22eedd2cfaa735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.516425 29985 tablet_service.cc:1511] Processing CreateTablet for tablet e27c11ad9b2c45bc9e8f774767c4e404 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:26.520098 29985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c11ad9b2c45bc9e8f774767c4e404. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:26.540625 29797 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:26.542323 29984 tablet_service.cc:1511] Processing CreateTablet for tablet 57e73dd62d4f4552822e5c2f12932637 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:26.552572 29984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e73dd62d4f4552822e5c2f12932637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.556134 29917 tablet_service.cc:1511] Processing CreateTablet for tablet 5c80447cf71f46d2a02edee2f2a82d74 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:26.559751 29918 tablet_service.cc:1511] Processing CreateTablet for tablet 28dc0277e12643bf89a534f800f8106a (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:26.595774 29913 tablet_service.cc:1511] Processing CreateTablet for tablet fbde894b43d549839a0a80b522e323ca (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:26.587009 29917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c80447cf71f46d2a02edee2f2a82d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.604651 29916 tablet_service.cc:1511] Processing CreateTablet for tablet 18833fd9a1534e78a3b239a54a71ae47 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:26.575884 29915 tablet_service.cc:1511] Processing CreateTablet for tablet e8ddcd68825c432b915f6196dc532b5c (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:26.602970 29914 tablet_service.cc:1511] Processing CreateTablet for tablet 5687528a8fb44360bd95831f2b1d838d (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:26.609393 29913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbde894b43d549839a0a80b522e323ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.628427 29915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ddcd68825c432b915f6196dc532b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.634620 29916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18833fd9a1534e78a3b239a54a71ae47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.638901 29918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dc0277e12643bf89a534f800f8106a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.641152 29914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5687528a8fb44360bd95831f2b1d838d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.679571 30045 tablet_bootstrap.cc:492] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:26.680768 29912 tablet_service.cc:1511] Processing CreateTablet for tablet 73c8406ed82f41a39d22eedd2cfaa735 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:26.701063 29910 tablet_service.cc:1511] Processing CreateTablet for tablet 57e73dd62d4f4552822e5c2f12932637 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:26.709882 30046 tablet_bootstrap.cc:492] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:26.712481 29910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e73dd62d4f4552822e5c2f12932637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.716308 29911 tablet_service.cc:1511] Processing CreateTablet for tablet e27c11ad9b2c45bc9e8f774767c4e404 (DEFAULT_TABLE table=test-workload [id=71788fc44dcd4284aa25c6d2ae7d294b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:26.722270 29912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c8406ed82f41a39d22eedd2cfaa735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.738722 29911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c11ad9b2c45bc9e8f774767c4e404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:26.764782 30047 tablet_bootstrap.cc:492] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:26.768656 30045 tablet_bootstrap.cc:654] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.794747 30046 tablet_bootstrap.cc:654] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.798336 30047 tablet_bootstrap.cc:654] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.820232 30045 tablet_bootstrap.cc:492] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:26.820426 30047 tablet_bootstrap.cc:492] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:26.821987 30047 ts_tablet_manager.cc:1403] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.011s
I20260709 13:13:26.821987 30045 ts_tablet_manager.cc:1403] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.017s
I20260709 13:13:26.822062 30046 tablet_bootstrap.cc:492] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:26.822795 30046 ts_tablet_manager.cc:1403] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.114s	user 0.005s	sys 0.018s
I20260709 13:13:26.825335 30045 raft_consensus.cc:359] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.825207 30047 raft_consensus.cc:359] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.825594 30046 raft_consensus.cc:359] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.826059 30045 raft_consensus.cc:385] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.826494 30046 raft_consensus.cc:385] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.826547 30045 raft_consensus.cc:740] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.826902 30046 raft_consensus.cc:740] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.826115 30047 raft_consensus.cc:385] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.827970 30047 raft_consensus.cc:740] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.827649 30046 consensus_queue.cc:260] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.827836 30045 consensus_queue.cc:260] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.828864 30047 consensus_queue.cc:260] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.842331 30047 ts_tablet_manager.cc:1434] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:26.843497 29953 heartbeater.cc:499] Master 127.29.5.190:42337 was elected leader, sending a full tablet report...
I20260709 13:13:26.846134 29878 heartbeater.cc:499] Master 127.29.5.190:42337 was elected leader, sending a full tablet report...
I20260709 13:13:26.846451 30027 heartbeater.cc:499] Master 127.29.5.190:42337 was elected leader, sending a full tablet report...
I20260709 13:13:26.845613 30046 ts_tablet_manager.cc:1434] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 13:13:26.849929 30046 tablet_bootstrap.cc:492] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:26.850813 30047 tablet_bootstrap.cc:492] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
W20260709 13:13:26.852548 29879 tablet.cc:2406] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:26.853462 30045 ts_tablet_manager.cc:1434] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.006s
I20260709 13:13:26.854243 30045 tablet_bootstrap.cc:492] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:26.862493 30045 tablet_bootstrap.cc:654] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.866484 30046 tablet_bootstrap.cc:654] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.869794 30047 tablet_bootstrap.cc:654] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.878741 30046 tablet_bootstrap.cc:492] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:26.879251 30046 ts_tablet_manager.cc:1403] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.003s
I20260709 13:13:26.882148 30046 raft_consensus.cc:359] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.882843 30046 raft_consensus.cc:385] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.883164 30046 raft_consensus.cc:740] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.884558 30046 consensus_queue.cc:260] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.886987 30047 tablet_bootstrap.cc:492] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:26.887477 30047 ts_tablet_manager.cc:1403] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:13:26.890445 30047 raft_consensus.cc:359] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.891175 30047 raft_consensus.cc:385] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.891481 30047 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.892758 30047 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.895298 30046 ts_tablet_manager.cc:1434] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.006s
I20260709 13:13:26.896322 30046 tablet_bootstrap.cc:492] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:26.902724 30046 tablet_bootstrap.cc:654] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.905316 30047 ts_tablet_manager.cc:1434] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:13:26.906348 30047 tablet_bootstrap.cc:492] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:26.912801 30047 tablet_bootstrap.cc:654] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.925233 30047 tablet_bootstrap.cc:492] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:26.925797 30047 ts_tablet_manager.cc:1403] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:13:26.928689 30047 raft_consensus.cc:359] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:26.929633 30047 raft_consensus.cc:385] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.929987 30047 raft_consensus.cc:740] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.930816 30047 consensus_queue.cc:260] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:26.932986 30047 ts_tablet_manager.cc:1434] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:13:26.931366 30045 tablet_bootstrap.cc:492] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:26.933609 30045 ts_tablet_manager.cc:1403] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.043s
I20260709 13:13:26.936383 30045 raft_consensus.cc:359] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.937072 30045 raft_consensus.cc:385] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.937353 30045 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.937992 30045 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.939863 30046 tablet_bootstrap.cc:492] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:26.939990 30045 ts_tablet_manager.cc:1434] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:26.940363 30046 ts_tablet_manager.cc:1403] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.007s
I20260709 13:13:26.940912 30045 tablet_bootstrap.cc:492] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:26.943073 30046 raft_consensus.cc:359] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:26.944595 30047 tablet_bootstrap.cc:492] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:26.947320 30045 tablet_bootstrap.cc:654] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.951400 30047 tablet_bootstrap.cc:654] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:26.943605 30046 raft_consensus.cc:385] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.961035 30046 raft_consensus.cc:740] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.962951 30045 tablet_bootstrap.cc:492] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:26.962654 30046 consensus_queue.cc:260] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:26.963419 30045 ts_tablet_manager.cc:1403] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:13:26.965476 30046 ts_tablet_manager.cc:1434] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:13:26.966820 30045 raft_consensus.cc:359] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.967552 30045 raft_consensus.cc:385] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.967887 30045 raft_consensus.cc:740] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.968709 30045 consensus_queue.cc:260] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.970404 30047 tablet_bootstrap.cc:492] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:26.970921 30047 ts_tablet_manager.cc:1403] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.004s
I20260709 13:13:26.973526 30045 ts_tablet_manager.cc:1434] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:26.974457 30045 tablet_bootstrap.cc:492] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:26.975469 30047 raft_consensus.cc:359] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.976263 30047 raft_consensus.cc:385] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:26.976603 30047 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.977660 30046 tablet_bootstrap.cc:492] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:26.977380 30047 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.979893 30047 ts_tablet_manager.cc:1434] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:26.980857 30047 tablet_bootstrap.cc:492] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:26.982049 30052 raft_consensus.cc:493] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.982527 30052 raft_consensus.cc:515] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:26.985497 30052 leader_election.cc:290] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:26.995370 30047 tablet_bootstrap.cc:654] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.006722 30045 tablet_bootstrap.cc:654] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.010516 30046 tablet_bootstrap.cc:654] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.018508 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
W20260709 13:13:27.021214 29965 leader_election.cc:343] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.024251 30047 tablet_bootstrap.cc:492] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:27.024636 30045 tablet_bootstrap.cc:492] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:27.024740 30047 ts_tablet_manager.cc:1403] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.001s
I20260709 13:13:27.025162 30045 ts_tablet_manager.cc:1403] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.003s
I20260709 13:13:27.028980 30047 raft_consensus.cc:359] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.029747 30047 raft_consensus.cc:385] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.029595 30045 raft_consensus.cc:359] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.029758 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.030123 30047 raft_consensus.cc:740] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.030404 30045 raft_consensus.cc:385] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.030704 29853 raft_consensus.cc:2468] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 0.
I20260709 13:13:27.031018 30047 consensus_queue.cc:260] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.030714 30045 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.032485 29966 leader_election.cc:304] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:27.033165 30045 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.034153 30052 raft_consensus.cc:2804] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.034711 30052 raft_consensus.cc:493] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.035224 30052 raft_consensus.cc:3060] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.036862 30047 ts_tablet_manager.cc:1434] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:13:27.037791 30047 tablet_bootstrap.cc:492] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:27.040346 30053 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.040804 30053 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.047109 30046 tablet_bootstrap.cc:492] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:27.051267 30052 raft_consensus.cc:515] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.055215 30053 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.048063 30046 ts_tablet_manager.cc:1403] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.000s
I20260709 13:13:27.059443 30052 leader_election.cc:290] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.060096 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:27.061220 29853 raft_consensus.cc:3060] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.066259 30047 tablet_bootstrap.cc:654] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.072970 30046 raft_consensus.cc:359] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.073697 30046 raft_consensus.cc:385] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.073982 30046 raft_consensus.cc:740] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.074647 30046 consensus_queue.cc:260] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.081988 29853 raft_consensus.cc:2468] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 1.
I20260709 13:13:27.083886 29966 leader_election.cc:304] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.084738 30046 ts_tablet_manager.cc:1434] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:13:27.085764 30046 tablet_bootstrap.cc:492] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:27.089727 30045 ts_tablet_manager.cc:1434] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 13:13:27.090674 30045 tablet_bootstrap.cc:492] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:27.094076 30053 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.094705 30053 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:27.097256 30053 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.098589 30067 raft_consensus.cc:2804] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.099515 30067 raft_consensus.cc:697] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:27.100692 30067 consensus_queue.cc:237] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.102063 30052 raft_consensus.cc:493] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.102653 30052 raft_consensus.cc:515] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.104974 30046 tablet_bootstrap.cc:654] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.105129 30052 leader_election.cc:290] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.106148 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.107110 30051 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.112324 29853 raft_consensus.cc:2468] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 0.
I20260709 13:13:27.112273 30051 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:27.114535 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.114939 29966 leader_election.cc:304] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.115722 30052 raft_consensus.cc:2804] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.116114 30052 raft_consensus.cc:493] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:27.116115 29965 leader_election.cc:343] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.116279 30051 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.109411 30045 tablet_bootstrap.cc:654] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.113227 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.116567 30052 raft_consensus.cc:3060] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.117287 29928 raft_consensus.cc:3060] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.123827 30052 raft_consensus.cc:515] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.126151 30052 leader_election.cc:290] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.127974 29928 raft_consensus.cc:2468] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 1.
I20260709 13:13:27.137236 30052 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.138648 30052 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.141178 30052 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.141748 30052 raft_consensus.cc:493] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.142462 30047 tablet_bootstrap.cc:492] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:27.142273 30052 raft_consensus.cc:515] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.142927 30047 ts_tablet_manager.cc:1403] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.009s
I20260709 13:13:27.144531 30052 leader_election.cc:290] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.148048 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.150684 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
W20260709 13:13:27.152426 29966 leader_election.cc:343] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.153705 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:27.154620 29853 raft_consensus.cc:3060] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.157186 30047 raft_consensus.cc:359] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.157877 30047 raft_consensus.cc:385] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.158156 30047 raft_consensus.cc:740] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
W20260709 13:13:27.158883 29966 leader_election.cc:343] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.158895 30047 consensus_queue.cc:260] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.154527 30046 tablet_bootstrap.cc:492] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:27.160851 30046 ts_tablet_manager.cc:1403] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.000s
I20260709 13:13:27.163131 30045 tablet_bootstrap.cc:492] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:27.163617 30045 ts_tablet_manager.cc:1403] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.001s
I20260709 13:13:27.163980 30046 raft_consensus.cc:359] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.164736 30046 raft_consensus.cc:385] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.164651 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.165189 30046 raft_consensus.cc:740] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.165688 29927 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 0.
I20260709 13:13:27.165995 30046 consensus_queue.cc:260] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.168308 30046 ts_tablet_manager.cc:1434] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:27.175887 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.176301 30046 tablet_bootstrap.cc:492] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:27.178730 29965 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.179242 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.179965 29928 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 0.
W20260709 13:13:27.180055 29965 leader_election.cc:343] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.180908 30067 raft_consensus.cc:2804] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.181304 30067 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.181622 30045 raft_consensus.cc:359] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.182076 29965 leader_election.cc:304] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.182416 30045 raft_consensus.cc:385] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.182729 30045 raft_consensus.cc:740] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.183435 30078 raft_consensus.cc:2804] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.184075 30046 tablet_bootstrap.cc:654] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.181643 30067 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.184325 30078 raft_consensus.cc:493] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.184813 30078 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.183511 30045 consensus_queue.cc:260] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.191962 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.197666 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.199882 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.201027 30047 ts_tablet_manager.cc:1434] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.003s
W20260709 13:13:27.201776 29891 leader_election.cc:343] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:27.205754 29816 leader_election.cc:343] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.207275 30047 tablet_bootstrap.cc:492] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:27.207196 29852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.209681 29853 raft_consensus.cc:2468] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 1.
I20260709 13:13:27.210212 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.210798 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.211879 30045 ts_tablet_manager.cc:1434] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:13:27.211736 29851 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 0.
I20260709 13:13:27.212288 29928 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
W20260709 13:13:27.213165 29892 leader_election.cc:343] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.213505 29966 leader_election.cc:304] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:27.213861 29892 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:27.213861 29816 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:27.216228 30053 raft_consensus.cc:2804] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.215090 30052 raft_consensus.cc:2804] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.216390 30051 raft_consensus.cc:2804] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.216743 30053 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.216993 30051 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.217581 30053 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.217989 30051 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.219539 30045 tablet_bootstrap.cc:492] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:27.220949 30078 raft_consensus.cc:515] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.254539 30078 leader_election.cc:290] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.255721 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:27.245945 30052 raft_consensus.cc:697] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:27.259193 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.264062 30053 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
W20260709 13:13:27.259233 29966 leader_election.cc:343] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.265026 30067 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.263036 29928 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.267239 30067 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.268348 30001 raft_consensus.cc:2393] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89daee0e84be4ae0be4cad52aa8039b9 in current term 1: Already voted for candidate 7e0734fa1b8e46bd869e346ae79a4675 in this term.
I20260709 13:13:27.267875 30052 consensus_queue.cc:237] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.270923 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:27.271543 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.272117 29927 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.272224 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
W20260709 13:13:27.276584 29966 leader_election.cc:343] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.281837 30053 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.283710 30053 raft_consensus.cc:493] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.284013 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:27.284279 30053 raft_consensus.cc:515] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
W20260709 13:13:27.285746 29891 leader_election.cc:343] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.286067 29928 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 1.
I20260709 13:13:27.281598 30051 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:27.288959 29851 raft_consensus.cc:2393] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89daee0e84be4ae0be4cad52aa8039b9 in current term 1: Already voted for candidate d0f2aa36fdcc45c484ab32dad5174593 in this term.
I20260709 13:13:27.288338 29965 leader_election.cc:304] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.289142 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.289628 30051 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
W20260709 13:13:27.291337 29892 leader_election.cc:343] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.291663 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:27.290154 30051 raft_consensus.cc:493] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.292878 30046 tablet_bootstrap.cc:492] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:27.292163 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.293450 30051 raft_consensus.cc:515] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
W20260709 13:13:27.295117 29816 leader_election.cc:343] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.295838 30046 ts_tablet_manager.cc:1403] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.014s
I20260709 13:13:27.296249 30080 raft_consensus.cc:2804] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.294610 30053 leader_election.cc:290] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.298415 30047 tablet_bootstrap.cc:654] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.299124 29928 raft_consensus.cc:2393] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d0f2aa36fdcc45c484ab32dad5174593 in current term 1: Already voted for candidate 89daee0e84be4ae0be4cad52aa8039b9 in this term.
I20260709 13:13:27.299860 30080 raft_consensus.cc:697] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:27.298914 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.301345 29816 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0f2aa36fdcc45c484ab32dad5174593; no voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9
W20260709 13:13:27.303788 29891 leader_election.cc:343] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.304947 30081 raft_consensus.cc:2749] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.306464 30051 leader_election.cc:290] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.301266 30080 consensus_queue.cc:237] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.306034 29891 leader_election.cc:304] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9; no voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.310544 30053 raft_consensus.cc:2749] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.311630 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.312011 29928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.312630 30002 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.313472 29928 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.314729 29927 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 1.
I20260709 13:13:27.314973 29816 leader_election.cc:304] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.316833 30081 raft_consensus.cc:2804] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.317785 30081 raft_consensus.cc:493] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.321398 30045 tablet_bootstrap.cc:654] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.317792 29965 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.318429 30081 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.324150 30052 raft_consensus.cc:2804] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.325428 30052 raft_consensus.cc:697] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:27.326334 30052 consensus_queue.cc:237] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.326630 29891 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9; no voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.327597 30053 raft_consensus.cc:2749] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.330709 29892 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9; no voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.332342 30053 raft_consensus.cc:2749] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.332744 30046 raft_consensus.cc:359] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.333546 30046 raft_consensus.cc:385] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.333846 30046 raft_consensus.cc:740] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.333268 30081 raft_consensus.cc:515] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.332839 29748 catalog_manager.cc:5697] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.338243 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.339947 30047 tablet_bootstrap.cc:492] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:27.340215 29927 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.340411 30047 ts_tablet_manager.cc:1403] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.006s
I20260709 13:13:27.343434 30047 raft_consensus.cc:359] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.344138 30047 raft_consensus.cc:385] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.344512 30047 raft_consensus.cc:740] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.345566 30047 consensus_queue.cc:260] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.347008 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:27.348114 30001 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.335822 30046 consensus_queue.cc:260] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.351574 30046 ts_tablet_manager.cc:1434] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.004s
I20260709 13:13:27.356668 30001 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.357901 29816 leader_election.cc:304] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.359727 30047 ts_tablet_manager.cc:1434] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:13:27.359941 30051 raft_consensus.cc:2804] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.349485 30081 leader_election.cc:290] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.365847 30047 tablet_bootstrap.cc:492] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:27.371122 30046 tablet_bootstrap.cc:492] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:27.375306 30045 tablet_bootstrap.cc:492] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:27.375818 30045 ts_tablet_manager.cc:1403] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.002s
I20260709 13:13:27.379967 30051 raft_consensus.cc:697] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:27.375403 29927 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.380888 30051 consensus_queue.cc:237] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.383621 30045 raft_consensus.cc:359] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.389307 30047 tablet_bootstrap.cc:654] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.394747 30046 tablet_bootstrap.cc:654] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.384469 30045 raft_consensus.cc:385] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.395519 30045 raft_consensus.cc:740] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.396596 30045 consensus_queue.cc:260] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.399119 30045 ts_tablet_manager.cc:1434] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 13:13:27.400431 30045 tablet_bootstrap.cc:492] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:27.406778 30047 tablet_bootstrap.cc:492] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:27.407339 30047 ts_tablet_manager.cc:1403] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.008s
I20260709 13:13:27.409988 30047 raft_consensus.cc:359] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.413331 30045 tablet_bootstrap.cc:654] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.414217 30047 raft_consensus.cc:385] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.414595 30047 raft_consensus.cc:740] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.415493 30047 consensus_queue.cc:260] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.418159 29749 catalog_manager.cc:5697] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.420948 30047 ts_tablet_manager.cc:1434] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:27.421363 30051 raft_consensus.cc:493] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.422166 30047 tablet_bootstrap.cc:492] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: Bootstrap starting.
I20260709 13:13:27.421988 30051 raft_consensus.cc:515] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.427062 30051 leader_election.cc:290] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.428880 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.429302 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.429514 29927 raft_consensus.cc:2468] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.429821 30046 tablet_bootstrap.cc:492] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:27.430274 30046 ts_tablet_manager.cc:1403] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.017s
W20260709 13:13:27.430836 29816 leader_election.cc:343] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.431569 29816 leader_election.cc:304] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:27.432768 30051 raft_consensus.cc:2804] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.433166 30051 raft_consensus.cc:493] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.433517 30051 raft_consensus.cc:3060] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.434468 30046 raft_consensus.cc:359] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.435173 30046 raft_consensus.cc:385] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.435472 30046 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.436239 30046 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.438757 30046 ts_tablet_manager.cc:1434] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:13:27.440387 30046 tablet_bootstrap.cc:492] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:27.440671 30051 raft_consensus.cc:515] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.440466 30047 tablet_bootstrap.cc:654] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.443444 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.444118 29927 raft_consensus.cc:3060] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.447240 30046 tablet_bootstrap.cc:654] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.451110 29927 raft_consensus.cc:2468] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.452723 29816 leader_election.cc:304] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.453842 30088 raft_consensus.cc:2804] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.454308 30088 raft_consensus.cc:697] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:27.455575 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:27.455155 30088 consensus_queue.cc:237] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
W20260709 13:13:27.456975 29816 leader_election.cc:343] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.459033 30045 tablet_bootstrap.cc:492] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:27.459553 30045 ts_tablet_manager.cc:1403] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.011s
I20260709 13:13:27.463110 30045 raft_consensus.cc:359] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:27.464044 30045 raft_consensus.cc:385] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.464414 30045 raft_consensus.cc:740] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.465279 30045 consensus_queue.cc:260] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:27.466560 30051 leader_election.cc:290] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.469328 30045 ts_tablet_manager.cc:1434] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:27.470328 30045 tablet_bootstrap.cc:492] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:27.473037 30046 tablet_bootstrap.cc:492] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:27.473536 30046 ts_tablet_manager.cc:1403] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.006s
I20260709 13:13:27.476212 30046 raft_consensus.cc:359] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.476854 30045 tablet_bootstrap.cc:654] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.476899 30046 raft_consensus.cc:385] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.479950 30046 raft_consensus.cc:740] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.480901 30046 consensus_queue.cc:260] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.484519 30046 ts_tablet_manager.cc:1434] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:27.485705 30046 tablet_bootstrap.cc:492] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593: Bootstrap starting.
I20260709 13:13:27.485432 29748 catalog_manager.cc:5697] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.487272 29748 catalog_manager.cc:5697] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.490447 30045 tablet_bootstrap.cc:492] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:27.490945 30045 ts_tablet_manager.cc:1403] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:13:27.490892 29748 catalog_manager.cc:5697] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.492416 30046 tablet_bootstrap.cc:654] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.493819 30045 raft_consensus.cc:359] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.494522 30045 raft_consensus.cc:385] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.494791 30045 raft_consensus.cc:740] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.496289 30045 consensus_queue.cc:260] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.501142 30045 ts_tablet_manager.cc:1434] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:13:27.502130 30045 tablet_bootstrap.cc:492] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675: Bootstrap starting.
I20260709 13:13:27.504179 30047 tablet_bootstrap.cc:492] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: No bootstrap required, opened a new log
I20260709 13:13:27.504698 30047 ts_tablet_manager.cc:1403] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.011s
I20260709 13:13:27.505524 29749 catalog_manager.cc:5697] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.507092 30046 tablet_bootstrap.cc:492] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593: No bootstrap required, opened a new log
I20260709 13:13:27.507519 30046 ts_tablet_manager.cc:1403] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:13:27.507673 30047 raft_consensus.cc:359] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.508455 30047 raft_consensus.cc:385] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.508885 30047 raft_consensus.cc:740] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.510180 30046 raft_consensus.cc:359] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.510895 30046 raft_consensus.cc:385] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.510205 30047 consensus_queue.cc:260] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.514788 30088 raft_consensus.cc:493] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.515256 30088 raft_consensus.cc:515] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.515848 30047 ts_tablet_manager.cc:1434] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:13:27.511184 30046 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.516777 30045 tablet_bootstrap.cc:654] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:27.517323 30046 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.519340 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.519683 30046 ts_tablet_manager.cc:1434] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 13:13:27.519961 29927 raft_consensus.cc:2468] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.520955 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.521575 30001 raft_consensus.cc:2468] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.523051 29816 leader_election.cc:304] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.524293 30051 raft_consensus.cc:2804] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.524752 30051 raft_consensus.cc:493] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.525190 30051 raft_consensus.cc:3060] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.532330 30051 raft_consensus.cc:515] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.517339 30088 leader_election.cc:290] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.536878 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.537510 29927 raft_consensus.cc:3060] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.537714 30051 leader_election.cc:290] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.538506 30045 tablet_bootstrap.cc:492] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675: No bootstrap required, opened a new log
I20260709 13:13:27.538947 30045 ts_tablet_manager.cc:1403] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.002s
I20260709 13:13:27.538801 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:27.539309 30001 raft_consensus.cc:3060] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.542099 30045 raft_consensus.cc:359] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.542819 30045 raft_consensus.cc:385] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:27.543095 30045 raft_consensus.cc:740] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.543515 29927 raft_consensus.cc:2468] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.543828 30045 consensus_queue.cc:260] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.544766 29816 leader_election.cc:304] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.545617 30051 raft_consensus.cc:2804] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.545819 30045 ts_tablet_manager.cc:1434] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:13:27.546066 29797 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:27.546278 30051 raft_consensus.cc:697] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:27.547111 30051 consensus_queue.cc:237] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.549376 30001 raft_consensus.cc:2468] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.558990 30052 raft_consensus.cc:493] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.559506 30052 raft_consensus.cc:515] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.561630 30052 leader_election.cc:290] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.562275 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.563279 29750 catalog_manager.cc:5697] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.565011 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.565678 29927 raft_consensus.cc:2393] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0734fa1b8e46bd869e346ae79a4675 in current term 1: Already voted for candidate d0f2aa36fdcc45c484ab32dad5174593 in this term.
I20260709 13:13:27.566604 29965 leader_election.cc:304] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675; no voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.567272 30052 raft_consensus.cc:3060] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.573355 30052 raft_consensus.cc:2749] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.574441 30051 raft_consensus.cc:493] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.574889 30051 raft_consensus.cc:515] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.576656 30051 leader_election.cc:290] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.577346 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.577917 29927 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.577811 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.578781 30001 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 0.
I20260709 13:13:27.579080 29816 leader_election.cc:304] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.579924 30051 raft_consensus.cc:2804] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:27.580243 30051 raft_consensus.cc:493] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:27.580518 30051 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.585011 30051 raft_consensus.cc:515] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.586565 30051 leader_election.cc:290] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.587455 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:27.587792 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:27.588066 29927 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.588304 30001 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.594465 29927 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.595563 29816 leader_election.cc:304] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:27.594465 30001 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:27.596372 30051 raft_consensus.cc:2804] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:27.596865 30051 raft_consensus.cc:697] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:27.597669 30051 consensus_queue.cc:237] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.598866 30052 consensus_queue.cc:1048] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.607446 29750 catalog_manager.cc:5697] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.622020 30067 consensus_queue.cc:1048] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.630685 30051 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.631196 30051 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:27.633456 30051 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:27.634537 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:27.634629 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.635597 29927 raft_consensus.cc:2393] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0f2aa36fdcc45c484ab32dad5174593 in current term 1: Already voted for candidate 7e0734fa1b8e46bd869e346ae79a4675 in this term.
I20260709 13:13:27.636587 29816 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0f2aa36fdcc45c484ab32dad5174593; no voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:27.637257 30051 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.643437 30051 raft_consensus.cc:2749] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.650234 30080 consensus_queue.cc:1048] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.661876 29927 raft_consensus.cc:3060] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.669845 30080 consensus_queue.cc:1048] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.788765 29851 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.796535 30080 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.796792 30067 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.813539 30080 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.821741 30051 consensus_queue.cc:1048] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:27.823588 30080 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.836899 30080 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.837493 30080 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:27.840670 30080 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:27.842520 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593" is_pre_election: true
I20260709 13:13:27.843309 29853 raft_consensus.cc:2393] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0734fa1b8e46bd869e346ae79a4675 in current term 1: Already voted for candidate d0f2aa36fdcc45c484ab32dad5174593 in this term.
I20260709 13:13:27.843971 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:27.846156 29927 raft_consensus.cc:2393] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0734fa1b8e46bd869e346ae79a4675 in current term 1: Already voted for candidate 89daee0e84be4ae0be4cad52aa8039b9 in this term.
I20260709 13:13:27.847668 29965 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675; no voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:27.848946 30080 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:27.855592 30080 raft_consensus.cc:2749] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:27.855448 30081 consensus_queue.cc:1048] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.912225 30081 consensus_queue.cc:1048] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.923245 30051 consensus_queue.cc:1048] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.956697 30051 consensus_queue.cc:1048] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.966972 30088 consensus_queue.cc:1048] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:27.997519 30088 consensus_queue.cc:1048] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:28.009400 30051 consensus_queue.cc:1048] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:28.547505 29797 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:28.886610 30081 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.887045 30081 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:28.888532 30081 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:28.889369 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675" is_pre_election: true
I20260709 13:13:28.889618 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9" is_pre_election: true
I20260709 13:13:28.889918 30002 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:28.890236 29926 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 1.
I20260709 13:13:28.890928 29816 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:28.891969 30081 raft_consensus.cc:2804] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:28.892467 30081 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.892980 30081 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.898029 30081 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:28.899559 30081 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 2 election: Requested vote from peers 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:28.900482 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:28.900681 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:28.901000 30002 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.901204 29926 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.906821 30002 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 2.
I20260709 13:13:28.907207 29926 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 2.
I20260709 13:13:28.908007 29816 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:28.908946 30081 raft_consensus.cc:2804] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.909423 30081 raft_consensus.cc:697] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:28.910079 30081 consensus_queue.cc:237] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:28.917379 29749 catalog_manager.cc:5697] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 0 to 2, leader changed from <none> to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.190600 30002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
mode: GRACEFUL
new_leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:33412
I20260709 13:13:29.191166 30002 raft_consensus.cc:606] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Received request to transfer leadership to TS d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:29.198827 30002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:33412
I20260709 13:13:29.199299 30002 raft_consensus.cc:606] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:29.203941 30002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:33412
I20260709 13:13:29.204376 30002 raft_consensus.cc:606] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:29.216635 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:13:29.217191 29851 raft_consensus.cc:606] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:29.221966 30002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:33412
I20260709 13:13:29.222506 30002 raft_consensus.cc:606] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:29.227358 29853 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
mode: GRACEFUL
new_leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:13:29.227963 29853 raft_consensus.cc:606] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Received request to transfer leadership to TS 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:29.262768 30052 raft_consensus.cc:993] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.263196 30052 raft_consensus.cc:1081] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.264678 29926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59052
I20260709 13:13:29.265177 29926 raft_consensus.cc:493] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.265509 29926 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.270009 29926 raft_consensus.cc:515] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.271746 29926 leader_election.cc:290] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:29.272557 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:29.272784 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:29.273087 29853 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.273348 30002 raft_consensus.cc:3055] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.273679 30002 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:29.274438 30002 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.275457 30002 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.277782 29853 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.278923 29892 leader_election.cc:304] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:29.280594 30136 raft_consensus.cc:2804] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.280663 30002 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.281826 30136 raft_consensus.cc:697] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:29.282585 30136 consensus_queue.cc:237] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.289474 29749 catalog_manager.cc:5697] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 1 to 2, leader changed from 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.305584 30002 raft_consensus.cc:1275] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:29.307642 30125 consensus_queue.cc:1048] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.311201 30135 raft_consensus.cc:993] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.311758 30139 raft_consensus.cc:1081] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.313504 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59052
I20260709 13:13:29.314123 29927 raft_consensus.cc:493] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.314495 29927 raft_consensus.cc:3060] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.321837 29926 raft_consensus.cc:1275] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:29.322191 29927 raft_consensus.cc:515] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.323204 30081 consensus_queue.cc:1048] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:29.325889 29927 leader_election.cc:290] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:29.326339 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:29.326900 29853 raft_consensus.cc:3060] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.328840 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbde894b43d549839a0a80b522e323ca" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:29.329247 30002 raft_consensus.cc:3055] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.329473 30002 raft_consensus.cc:740] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:29.330173 30002 consensus_queue.cc:260] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.331977 30002 raft_consensus.cc:3060] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.332288 30135 raft_consensus.cc:993] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: : Instructing follower d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:29.332711 30139 raft_consensus.cc:1081] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Signalling peer d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:29.334372 29851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:39082
I20260709 13:13:29.334910 29851 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.335263 29851 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.335286 29853 raft_consensus.cc:2468] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.337095 29892 leader_election.cc:304] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:29.338229 30136 raft_consensus.cc:2804] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.338826 30136 raft_consensus.cc:697] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:29.339306 30002 raft_consensus.cc:2468] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.339959 30136 consensus_queue.cc:237] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.342456 29851 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.344640 29851 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 2 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:29.345822 29926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:29.346616 29926 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.353796 29926 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 2.
I20260709 13:13:29.354144 30139 raft_consensus.cc:993] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.354713 30139 raft_consensus.cc:1081] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.356617 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59052
I20260709 13:13:29.357216 29927 raft_consensus.cc:493] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.357657 29927 raft_consensus.cc:3060] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.357481 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:29.358108 29816 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:29.358306 30002 raft_consensus.cc:3055] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.358771 30002 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:29.359725 30125 raft_consensus.cc:2804] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.360275 30125 raft_consensus.cc:697] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:29.359819 30002 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.361069 30125 consensus_queue.cc:237] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.361523 30002 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.364480 29927 raft_consensus.cc:515] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.368139 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:29.368680 30001 raft_consensus.cc:3055] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.368999 30001 raft_consensus.cc:740] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:29.369727 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27c11ad9b2c45bc9e8f774767c4e404" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:29.370277 29851 raft_consensus.cc:3060] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.369750 30001 consensus_queue.cc:260] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.371073 30001 raft_consensus.cc:3060] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.372226 30002 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 2.
I20260709 13:13:29.377386 29851 raft_consensus.cc:2468] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.377946 29927 leader_election.cc:290] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:29.378575 29892 leader_election.cc:304] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:29.379544 30001 raft_consensus.cc:2468] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.381764 30145 raft_consensus.cc:2804] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.382458 30145 raft_consensus.cc:697] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:29.383466 30145 consensus_queue.cc:237] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.388378 29750 catalog_manager.cc:5697] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 1 to 2, leader changed from 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131) to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.388950 29749 catalog_manager.cc:5697] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 1 to 2, leader changed from 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.401748 29749 catalog_manager.cc:5697] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 1 to 2, leader changed from 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.461278 30081 raft_consensus.cc:993] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: : Instructing follower 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:29.461700 30125 raft_consensus.cc:1081] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Signalling peer 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:29.463032 30001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:59544
I20260709 13:13:29.463541 30001 raft_consensus.cc:493] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.463887 30001 raft_consensus.cc:3060] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.468287 30001 raft_consensus.cc:515] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.470028 30001 leader_election.cc:290] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:29.470721 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:29.470997 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e73dd62d4f4552822e5c2f12932637" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:29.471283 29851 raft_consensus.cc:3055] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.471572 29927 raft_consensus.cc:3060] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.471630 29851 raft_consensus.cc:740] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:29.472558 29851 consensus_queue.cc:260] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.473446 29851 raft_consensus.cc:3060] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.476670 29927 raft_consensus.cc:2468] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 2.
I20260709 13:13:29.477607 29965 leader_election.cc:304] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: 
I20260709 13:13:29.478123 29851 raft_consensus.cc:2468] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 2.
I20260709 13:13:29.478273 30052 raft_consensus.cc:2804] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.478765 30052 raft_consensus.cc:697] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:29.479596 30052 consensus_queue.cc:237] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.485958 29749 catalog_manager.cc:5697] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 1 to 2, leader changed from d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129) to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.691151 29851 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.692658 30145 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.700685 30001 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.702432 30145 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.744678 30081 raft_consensus.cc:993] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.745143 30125 raft_consensus.cc:1081] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:29.746624 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59062
I20260709 13:13:29.747097 29927 raft_consensus.cc:493] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:29.747368 29927 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.752794 29927 raft_consensus.cc:515] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.754709 29927 leader_election.cc:290] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:29.755689 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:29.755620 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:29.756347 30001 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.756462 29851 raft_consensus.cc:3055] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:29.756803 29851 raft_consensus.cc:740] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:29.757578 29851 consensus_queue.cc:260] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.758749 29851 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.763142 30001 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.764259 29891 leader_election.cc:304] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: 
I20260709 13:13:29.764930 30145 raft_consensus.cc:2804] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:29.764957 29851 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:29.765460 30145 raft_consensus.cc:697] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:29.766240 30145 consensus_queue.cc:237] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:29.772596 29750 catalog_manager.cc:5697] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 1 to 2, leader changed from d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.784152 29851 raft_consensus.cc:1275] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.785344 30145 consensus_queue.cc:1048] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.793424 30001 raft_consensus.cc:1275] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.795038 30145 consensus_queue.cc:1048] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.843624 29851 raft_consensus.cc:1275] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.845265 30145 consensus_queue.cc:1048] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.853713 30001 raft_consensus.cc:1275] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.855244 30137 consensus_queue.cc:1048] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.875476 29927 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.876956 30125 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.887362 30001 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.888980 30159 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.978039 29851 raft_consensus.cc:1275] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.979403 30052 consensus_queue.cc:1048] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:29.988796 29927 raft_consensus.cc:1275] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.990514 30162 consensus_queue.cc:1048] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.328909 30001 raft_consensus.cc:1275] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.330060 30145 consensus_queue.cc:1048] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.339035 29851 raft_consensus.cc:1275] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.341213 30145 consensus_queue.cc:1048] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:32.257303 29718 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:13:32.258131 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.272886 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
mode: GRACEFUL
new_leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:55820
I20260709 13:13:32.273420 29851 raft_consensus.cc:606] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Received request to transfer leadership to TS 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:32.284997 29927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
mode: GRACEFUL
new_leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:57694
I20260709 13:13:32.285488 29927 raft_consensus.cc:606] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Received request to transfer leadership to TS 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:32.286501 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:32.286955 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:32.292768 30167 raft_consensus.cc:993] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: : Instructing follower 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:32.293222 30136 raft_consensus.cc:1081] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Signalling peer 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:32.294579 30002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:59538
I20260709 13:13:32.295106 30002 raft_consensus.cc:493] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.295410 30002 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.299866 30002 raft_consensus.cc:515] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:32.301373 30002 leader_election.cc:290] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:32.302237 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:32.302443 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:32.302906 29851 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.302948 29927 raft_consensus.cc:3055] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.303428 29927 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:32.304105 29927 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:32.304899 29927 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.308131 29851 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:32.309369 29966 leader_election.cc:304] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:32.310246 30166 raft_consensus.cc:2804] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:32.310557 29927 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:32.311631 30166 raft_consensus.cc:697] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:32.312430 30166 consensus_queue.cc:237] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:32.319089 29749 catalog_manager.cc:5697] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 2 to 3, leader changed from 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130) to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.677865 30159 raft_consensus.cc:993] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: : Instructing follower 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:32.678308 30159 raft_consensus.cc:1081] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Signalling peer 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:32.679796 30002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:59544
I20260709 13:13:32.680271 30002 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.680579 30002 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.685470 30002 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:32.687225 30002 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:32.688007 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:32.688527 29851 raft_consensus.cc:3055] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:32.688820 29851 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:32.688966 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:32.689519 29927 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.689605 29851 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:32.690819 29851 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:32.695652 29927 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:32.696713 29965 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: 
I20260709 13:13:32.696892 29851 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:32.697403 30166 raft_consensus.cc:2804] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:32.697827 30166 raft_consensus.cc:697] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:32.698537 30166 consensus_queue.cc:237] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:32.703467 29927 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.704607 30166 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:32.705274 29749 catalog_manager.cc:5697] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 2 to 3, leader changed from d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129) to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.718221 29851 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.719836 30166 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.274179 29851 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.275362 30186 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.284300 29927 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:33.285677 30172 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:33.287716 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.301981 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:13:33.302548 29851 raft_consensus.cc:606] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:33.307440 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:13:33.307977 29851 raft_consensus.cc:606] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:33.312824 30002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:33412
I20260709 13:13:33.313330 30002 raft_consensus.cc:606] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:33.317842 29851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:13:33.318313 29851 raft_consensus.cc:606] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:33.322832 30002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
mode: GRACEFUL
new_leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:33412
I20260709 13:13:33.323366 30002 raft_consensus.cc:606] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Received request to transfer leadership to TS 89daee0e84be4ae0be4cad52aa8039b9
I20260709 13:13:33.440623 30159 raft_consensus.cc:993] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.441063 30190 raft_consensus.cc:1081] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.442448 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59062
I20260709 13:13:33.442885 29927 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.443141 29927 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.447160 29927 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:33.448485 29927 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 3 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:33.449138 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:33.449493 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:33.449705 29851 raft_consensus.cc:3055] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:33.450002 29851 raft_consensus.cc:740] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:33.450052 30002 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.450783 29851 consensus_queue.cc:260] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:33.451880 29851 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:33.456295 30002 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 3.
I20260709 13:13:33.457405 29891 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: 
I20260709 13:13:33.457791 29851 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 3.
I20260709 13:13:33.458127 30167 raft_consensus.cc:2804] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:33.459260 30167 raft_consensus.cc:697] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:33.460022 30167 consensus_queue.cc:237] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:33.466055 29749 catalog_manager.cc:5697] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 2 to 3, leader changed from d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.472371 30159 raft_consensus.cc:993] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.472770 30190 raft_consensus.cc:1081] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.474300 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59062
I20260709 13:13:33.474699 29927 raft_consensus.cc:493] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.474972 29927 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.479210 29927 raft_consensus.cc:515] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.480546 29927 leader_election.cc:290] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:33.481298 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:33.481587 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:33.481806 29851 raft_consensus.cc:3055] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.482105 30002 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.482122 29851 raft_consensus.cc:740] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:33.482926 29851 consensus_queue.cc:260] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.483809 29851 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.487030 30002 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:33.487967 29851 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:33.488127 29891 leader_election.cc:304] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: 
I20260709 13:13:33.488915 30193 raft_consensus.cc:2804] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.489324 30193 raft_consensus.cc:697] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:33.490118 30193 consensus_queue.cc:237] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.496958 29749 catalog_manager.cc:5697] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 1 to 2, leader changed from d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.597849 30159 raft_consensus.cc:993] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.598345 30159 raft_consensus.cc:1081] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.600095 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59062
I20260709 13:13:33.600684 29927 raft_consensus.cc:493] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.601060 29927 raft_consensus.cc:3060] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.607995 29927 raft_consensus.cc:515] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.609876 29927 leader_election.cc:290] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:33.610668 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:33.610895 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ddcd68825c432b915f6196dc532b5c" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:33.611239 29851 raft_consensus.cc:3055] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.611443 30002 raft_consensus.cc:3060] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.611588 29851 raft_consensus.cc:740] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:33.612272 29851 consensus_queue.cc:260] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.613068 29851 raft_consensus.cc:3060] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.616070 30002 raft_consensus.cc:2468] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:33.616999 29891 leader_election.cc:304] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, 89daee0e84be4ae0be4cad52aa8039b9; no voters: 
I20260709 13:13:33.617668 30193 raft_consensus.cc:2804] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.618057 30193 raft_consensus.cc:697] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:33.618181 29851 raft_consensus.cc:2468] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 2.
I20260709 13:13:33.618808 30193 consensus_queue.cc:237] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.625097 29749 catalog_manager.cc:5697] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 1 to 2, leader changed from d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.727980 30172 raft_consensus.cc:993] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.728451 30182 raft_consensus.cc:1081] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.729856 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59052
I20260709 13:13:33.730379 29927 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.730729 29927 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.735733 29927 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.737242 29927 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 4 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:33.738031 29851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:33.738164 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:33.738601 29851 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.738679 30002 raft_consensus.cc:3055] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:33.739041 30002 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:33.739705 30002 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.740795 30002 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.744657 29851 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 4.
I20260709 13:13:33.745738 29892 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:33.746490 30193 raft_consensus.cc:2804] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:33.746698 30002 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 4.
I20260709 13:13:33.746958 30193 raft_consensus.cc:697] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:33.747838 30193 consensus_queue.cc:237] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.753737 29749 catalog_manager.cc:5697] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 3 to 4, leader changed from 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.880705 30002 raft_consensus.cc:1275] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:33.882025 30193 consensus_queue.cc:1048] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.887986 30182 raft_consensus.cc:993] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: : Instructing follower 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.888459 30182 raft_consensus.cc:1081] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Signalling peer 89daee0e84be4ae0be4cad52aa8039b9 to start an election
I20260709 13:13:33.890460 29927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
 from {username='slave'} at 127.0.0.1:59052
I20260709 13:13:33.891013 29927 raft_consensus.cc:493] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.891379 29927 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.891583 29851 raft_consensus.cc:1275] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:33.892885 30193 consensus_queue.cc:1048] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.898941 29927 raft_consensus.cc:515] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.902803 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:33.903036 29927 leader_election.cc:290] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 4 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:33.903384 29853 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.905112 30002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "89daee0e84be4ae0be4cad52aa8039b9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:33.907684 30002 raft_consensus.cc:3055] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:33.908006 30002 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:33.908830 30002 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.909986 30002 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:33.910342 29853 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 4.
I20260709 13:13:33.911317 29892 leader_election.cc:304] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:33.912125 30193 raft_consensus.cc:2804] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:33.912618 30193 raft_consensus.cc:697] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Becoming Leader. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:33.913383 30193 consensus_queue.cc:237] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:33.915980 30002 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89daee0e84be4ae0be4cad52aa8039b9 in term 4.
I20260709 13:13:33.920269 29750 catalog_manager.cc:5697] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 reported cstate change: term changed from 3 to 4, leader changed from 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131) to 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "89daee0e84be4ae0be4cad52aa8039b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.025568 29853 raft_consensus.cc:1275] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.026755 30193 consensus_queue.cc:1048] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.035001 30002 raft_consensus.cc:1275] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.036392 30202 consensus_queue.cc:1048] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.067305 30002 raft_consensus.cc:1275] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.068668 30202 consensus_queue.cc:1048] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.116235 29853 raft_consensus.cc:1275] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.118498 30193 consensus_queue.cc:1048] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:34.226295 30002 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:34.227509 30202 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:34.238193 29853 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:34.240027 30202 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:34.488718 30002 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:34.489931 30202 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:34.497010 29853 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Refusing update from remote peer 89daee0e84be4ae0be4cad52aa8039b9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:34.499066 30167 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:36.335597 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:36.343050 29927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
mode: GRACEFUL
new_leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:57694
I20260709 13:13:36.343657 29927 raft_consensus.cc:606] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Received request to transfer leadership to TS d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:36.346127 29927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
mode: GRACEFUL
new_leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:57694
I20260709 13:13:36.346560 29927 raft_consensus.cc:606] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 LEADER]: Received request to transfer leadership to TS d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:36.348734 29927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
mode: GRACEFUL
new_leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:57694
I20260709 13:13:36.349370 29927 raft_consensus.cc:606] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Received request to transfer leadership to TS d0f2aa36fdcc45c484ab32dad5174593
I20260709 13:13:36.351478 29927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
mode: GRACEFUL
new_leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:57694
I20260709 13:13:36.351905 29927 raft_consensus.cc:606] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Received request to transfer leadership to TS 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:36.353770 29927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735"
dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
mode: GRACEFUL
new_leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:57694
I20260709 13:13:36.354121 29927 raft_consensus.cc:606] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Received request to transfer leadership to TS 7e0734fa1b8e46bd869e346ae79a4675
I20260709 13:13:36.354959 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:36.355434 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:36.429931 30214 raft_consensus.cc:993] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: : Instructing follower d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:36.430449 30167 raft_consensus.cc:1081] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Signalling peer d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:36.431910 29853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:39092
I20260709 13:13:36.432456 29853 raft_consensus.cc:493] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.432785 29853 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.438284 29853 raft_consensus.cc:515] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.440049 29853 leader_election.cc:290] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 5 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:36.440949 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:36.441226 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5687528a8fb44360bd95831f2b1d838d" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:36.441512 29927 raft_consensus.cc:3055] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:36.441820 30001 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.441857 29927 raft_consensus.cc:740] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:36.442749 29927 consensus_queue.cc:260] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.443625 29927 raft_consensus.cc:3060] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.448179 29927 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 5.
I20260709 13:13:36.448046 30001 raft_consensus.cc:2468] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 5.
I20260709 13:13:36.449479 29816 leader_election.cc:304] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89daee0e84be4ae0be4cad52aa8039b9, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:36.450721 30215 raft_consensus.cc:2804] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:36.451611 30215 raft_consensus.cc:697] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 5 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:36.452445 30215 consensus_queue.cc:237] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.462836 29749 catalog_manager.cc:5697] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 4 to 5, leader changed from 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130) to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 5 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.513784 30214 raft_consensus.cc:993] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: : Instructing follower 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:36.514218 30167 raft_consensus.cc:1081] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Signalling peer 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:36.515708 30001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:59538
I20260709 13:13:36.516217 30001 raft_consensus.cc:493] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.516526 30001 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.521535 30001 raft_consensus.cc:515] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.523461 30001 leader_election.cc:290] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:36.524145 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:36.524672 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c8406ed82f41a39d22eedd2cfaa735" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:36.524786 29853 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.525135 29927 raft_consensus.cc:3055] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.525374 29927 raft_consensus.cc:740] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:36.526036 29927 consensus_queue.cc:260] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.526840 29927 raft_consensus.cc:3060] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.529546 29853 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:36.530715 29966 leader_election.cc:304] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:36.531016 29927 raft_consensus.cc:2468] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:36.531569 30172 raft_consensus.cc:2804] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.532739 30172 raft_consensus.cc:697] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:36.533587 30172 consensus_queue.cc:237] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.540228 29749 catalog_manager.cc:5697] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 2 to 3, leader changed from 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130) to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.627370 30214 raft_consensus.cc:993] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: : Instructing follower 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:36.627825 30167 raft_consensus.cc:1081] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Signalling peer 7e0734fa1b8e46bd869e346ae79a4675 to start an election
I20260709 13:13:36.629112 30001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74"
dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
 from {username='slave'} at 127.0.0.1:59538
I20260709 13:13:36.629491 30001 raft_consensus.cc:493] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.629707 30001 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.633690 30001 raft_consensus.cc:515] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.635332 30001 leader_election.cc:290] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Requested vote from peers d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:36.636291 29853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
I20260709 13:13:36.636292 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c80447cf71f46d2a02edee2f2a82d74" candidate_uuid: "7e0734fa1b8e46bd869e346ae79a4675" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:36.637006 29853 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.637037 29927 raft_consensus.cc:3055] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:36.637447 29927 raft_consensus.cc:740] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:36.638162 29927 consensus_queue.cc:260] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.639346 29927 raft_consensus.cc:3060] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:36.641923 29853 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:36.642910 29966 leader_election.cc:304] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:36.643656 30172 raft_consensus.cc:2804] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:36.644081 30172 raft_consensus.cc:697] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Becoming Leader. State: Replica: 7e0734fa1b8e46bd869e346ae79a4675, State: Running, Role: LEADER
I20260709 13:13:36.644258 29927 raft_consensus.cc:2468] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0734fa1b8e46bd869e346ae79a4675 in term 3.
I20260709 13:13:36.644917 30172 consensus_queue.cc:237] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.652045 29749 catalog_manager.cc:5697] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 reported cstate change: term changed from 2 to 3, leader changed from 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130) to 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "7e0734fa1b8e46bd869e346ae79a4675" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.734292 30214 raft_consensus.cc:993] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: : Instructing follower d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:36.734721 30167 raft_consensus.cc:1081] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 LEADER]: Signalling peer d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:36.736353 29853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:39092
I20260709 13:13:36.736902 29853 raft_consensus.cc:493] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.737226 29853 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.742302 29853 raft_consensus.cc:515] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:36.744065 29853 leader_election.cc:290] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 4 election: Requested vote from peers 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603), 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513)
I20260709 13:13:36.745033 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:36.745159 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dc0277e12643bf89a534f800f8106a" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:36.745566 30001 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.745745 29927 raft_consensus.cc:3055] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:36.746150 29927 raft_consensus.cc:740] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:36.746933 29927 consensus_queue.cc:260] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:36.748142 29927 raft_consensus.cc:3060] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:36.751480 30001 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 4.
I20260709 13:13:36.752637 29816 leader_election.cc:304] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:36.753419 30215 raft_consensus.cc:2804] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:36.753826 29927 raft_consensus.cc:2468] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 4.
I20260709 13:13:36.753911 30215 raft_consensus.cc:697] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 4 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:36.755072 30215 consensus_queue.cc:237] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } }
I20260709 13:13:36.762480 29749 catalog_manager.cc:5697] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 3 to 4, leader changed from 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130) to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 4 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.784246 30167 raft_consensus.cc:993] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: : Instructing follower d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:36.784710 30214 raft_consensus.cc:1081] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Signalling peer d0f2aa36fdcc45c484ab32dad5174593 to start an election
I20260709 13:13:36.786088 29853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47"
dest_uuid: "d0f2aa36fdcc45c484ab32dad5174593"
 from {username='slave'} at 127.0.0.1:39092
I20260709 13:13:36.786595 29853 raft_consensus.cc:493] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:36.786922 29853 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.791137 29853 raft_consensus.cc:515] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.792459 29853 leader_election.cc:290] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 5 election: Requested vote from peers 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513), 7e0734fa1b8e46bd869e346ae79a4675 (127.29.5.131:33603)
I20260709 13:13:36.793210 29927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "89daee0e84be4ae0be4cad52aa8039b9"
I20260709 13:13:36.793499 30001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18833fd9a1534e78a3b239a54a71ae47" candidate_uuid: "d0f2aa36fdcc45c484ab32dad5174593" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7e0734fa1b8e46bd869e346ae79a4675"
I20260709 13:13:36.793779 29927 raft_consensus.cc:3055] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:36.793978 30001 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.794085 29927 raft_consensus.cc:740] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89daee0e84be4ae0be4cad52aa8039b9, State: Running, Role: LEADER
I20260709 13:13:36.794860 29927 consensus_queue.cc:260] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.795995 29927 raft_consensus.cc:3060] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:36.800077 30001 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 5.
I20260709 13:13:36.801151 29816 leader_election.cc:304] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0734fa1b8e46bd869e346ae79a4675, d0f2aa36fdcc45c484ab32dad5174593; no voters: 
I20260709 13:13:36.801826 30215 raft_consensus.cc:2804] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:36.801954 29927 raft_consensus.cc:2468] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0f2aa36fdcc45c484ab32dad5174593 in term 5.
I20260709 13:13:36.802264 30215 raft_consensus.cc:697] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 5 LEADER]: Becoming Leader. State: Replica: d0f2aa36fdcc45c484ab32dad5174593, State: Running, Role: LEADER
I20260709 13:13:36.803141 30215 consensus_queue.cc:237] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } }
I20260709 13:13:36.809252 29749 catalog_manager.cc:5697] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 reported cstate change: term changed from 4 to 5, leader changed from 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130) to d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129). New cstate: current_term: 5 leader_uuid: "d0f2aa36fdcc45c484ab32dad5174593" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.891510 30001 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:36.892616 30215 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:36.902375 29927 raft_consensus.cc:1275] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:36.904520 30216 consensus_queue.cc:1048] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:36.974509 29926 raft_consensus.cc:1275] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.975683 30172 consensus_queue.cc:1048] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:36.984624 29853 raft_consensus.cc:1275] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:36.986644 30222 consensus_queue.cc:1048] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.040076 29926 raft_consensus.cc:1275] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.041302 30222 consensus_queue.cc:1048] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.049624 29853 raft_consensus.cc:1275] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Refusing update from remote peer 7e0734fa1b8e46bd869e346ae79a4675: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.051146 30234 consensus_queue.cc:1048] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2aa36fdcc45c484ab32dad5174593" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:37.196797 29926 raft_consensus.cc:1275] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:37.197901 30215 consensus_queue.cc:1048] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.205654 30001 raft_consensus.cc:1275] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:37.207738 30216 consensus_queue.cc:1048] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.310658 30001 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:37.311848 30216 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0734fa1b8e46bd869e346ae79a4675" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:37.320545 29926 raft_consensus.cc:1275] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Refusing update from remote peer d0f2aa36fdcc45c484ab32dad5174593: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:37.322140 30216 consensus_queue.cc:1048] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89daee0e84be4ae0be4cad52aa8039b9" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:37.356397 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:37.362128 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
I20260709 13:13:37.386179 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.386888 29718 tablet_replica.cc:333] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.387667 29718 raft_consensus.cc:2243] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.388582 29718 raft_consensus.cc:2272] T 5687528a8fb44360bd95831f2b1d838d P d0f2aa36fdcc45c484ab32dad5174593 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.391079 29718 tablet_replica.cc:333] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.391642 29718 raft_consensus.cc:2243] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.392442 29718 raft_consensus.cc:2272] T 18833fd9a1534e78a3b239a54a71ae47 P d0f2aa36fdcc45c484ab32dad5174593 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.394567 29718 tablet_replica.cc:333] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.395219 29718 raft_consensus.cc:2243] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.395637 29718 raft_consensus.cc:2272] T e8ddcd68825c432b915f6196dc532b5c P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.397297 29718 tablet_replica.cc:333] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.397778 29718 raft_consensus.cc:2243] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.398195 29718 raft_consensus.cc:2272] T 57e73dd62d4f4552822e5c2f12932637 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.399911 29718 tablet_replica.cc:333] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.400401 29718 raft_consensus.cc:2243] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.400856 29718 raft_consensus.cc:2272] T 73c8406ed82f41a39d22eedd2cfaa735 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.402889 29718 tablet_replica.cc:333] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.403373 29718 raft_consensus.cc:2243] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.403860 29718 raft_consensus.cc:2272] T e27c11ad9b2c45bc9e8f774767c4e404 P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.405453 29718 tablet_replica.cc:333] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.405923 29718 raft_consensus.cc:2243] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.406741 29718 raft_consensus.cc:2272] T 28dc0277e12643bf89a534f800f8106a P d0f2aa36fdcc45c484ab32dad5174593 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.409230 29718 tablet_replica.cc:333] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.409861 29718 raft_consensus.cc:2243] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.410223 29718 raft_consensus.cc:2272] T fbde894b43d549839a0a80b522e323ca P d0f2aa36fdcc45c484ab32dad5174593 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.411841 29718 tablet_replica.cc:333] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593: stopping tablet replica
I20260709 13:13:37.412243 29718 raft_consensus.cc:2243] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.412580 29718 raft_consensus.cc:2272] T 5c80447cf71f46d2a02edee2f2a82d74 P d0f2aa36fdcc45c484ab32dad5174593 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:37.507500 29966 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:43583: connect: Connection refused (error 111)
I20260709 13:13:37.512140 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
W20260709 13:13:37.512660 29966 consensus_peers.cc:597] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 -> Peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Couldn't send request to peer d0f2aa36fdcc45c484ab32dad5174593. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:43583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:37.514147 29892 consensus_peers.cc:597] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 -> Peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Couldn't send request to peer d0f2aa36fdcc45c484ab32dad5174593. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:43583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.530721 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
W20260709 13:13:37.543553 29966 consensus_peers.cc:597] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 -> Peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Couldn't send request to peer d0f2aa36fdcc45c484ab32dad5174593. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:43583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.565833 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.566537 29718 tablet_replica.cc:333] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.567214 29718 raft_consensus.cc:2243] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.567828 29718 raft_consensus.cc:2272] T 57e73dd62d4f4552822e5c2f12932637 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.570079 29718 tablet_replica.cc:333] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.570693 29718 raft_consensus.cc:2243] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:37.570904 29965 consensus_peers.cc:597] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 -> Peer 89daee0e84be4ae0be4cad52aa8039b9 (127.29.5.130:36513): Couldn't send request to peer 89daee0e84be4ae0be4cad52aa8039b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.571204 29718 raft_consensus.cc:2272] T 5c80447cf71f46d2a02edee2f2a82d74 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.573172 29718 tablet_replica.cc:333] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.573618 29718 raft_consensus.cc:2243] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.573944 29718 raft_consensus.cc:2272] T 18833fd9a1534e78a3b239a54a71ae47 P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.575662 29718 tablet_replica.cc:333] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.576135 29718 raft_consensus.cc:2243] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.576472 29718 raft_consensus.cc:2272] T 5687528a8fb44360bd95831f2b1d838d P 89daee0e84be4ae0be4cad52aa8039b9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.578538 29718 tablet_replica.cc:333] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.579180 29718 raft_consensus.cc:2243] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.580163 29718 raft_consensus.cc:2272] T fbde894b43d549839a0a80b522e323ca P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.582414 29718 tablet_replica.cc:333] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
W20260709 13:13:37.582994 29966 consensus_peers.cc:597] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 -> Peer d0f2aa36fdcc45c484ab32dad5174593 (127.29.5.129:43583): Couldn't send request to peer d0f2aa36fdcc45c484ab32dad5174593. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:43583: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:37.583050 29718 raft_consensus.cc:2243] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.583630 29718 raft_consensus.cc:2272] T 73c8406ed82f41a39d22eedd2cfaa735 P 89daee0e84be4ae0be4cad52aa8039b9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.585778 29718 tablet_replica.cc:333] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.586269 29718 raft_consensus.cc:2243] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.586928 29718 raft_consensus.cc:2272] T e27c11ad9b2c45bc9e8f774767c4e404 P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.588447 29718 tablet_replica.cc:333] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.588881 29718 raft_consensus.cc:2243] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.589244 29718 raft_consensus.cc:2272] T 28dc0277e12643bf89a534f800f8106a P 89daee0e84be4ae0be4cad52aa8039b9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.591198 29718 tablet_replica.cc:333] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9: stopping tablet replica
I20260709 13:13:37.591632 29718 raft_consensus.cc:2243] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.592334 29718 raft_consensus.cc:2272] T e8ddcd68825c432b915f6196dc532b5c P 89daee0e84be4ae0be4cad52aa8039b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.618681 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
I20260709 13:13:37.636463 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
I20260709 13:13:37.668057 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:37.668687 29718 tablet_replica.cc:333] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.669207 29718 raft_consensus.cc:2243] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.669943 29718 raft_consensus.cc:2272] T 57e73dd62d4f4552822e5c2f12932637 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.671656 29718 tablet_replica.cc:333] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.672220 29718 raft_consensus.cc:2243] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.672580 29718 raft_consensus.cc:2272] T e8ddcd68825c432b915f6196dc532b5c P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.674059 29718 tablet_replica.cc:333] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.674499 29718 raft_consensus.cc:2243] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.675170 29718 raft_consensus.cc:2272] T 5c80447cf71f46d2a02edee2f2a82d74 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.677019 29718 tablet_replica.cc:333] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.677461 29718 raft_consensus.cc:2243] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.677825 29718 raft_consensus.cc:2272] T fbde894b43d549839a0a80b522e323ca P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.679352 29718 tablet_replica.cc:333] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.679884 29718 raft_consensus.cc:2243] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.680255 29718 raft_consensus.cc:2272] T 5687528a8fb44360bd95831f2b1d838d P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.682070 29718 tablet_replica.cc:333] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.682528 29718 raft_consensus.cc:2243] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.682910 29718 raft_consensus.cc:2272] T 18833fd9a1534e78a3b239a54a71ae47 P 7e0734fa1b8e46bd869e346ae79a4675 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.685164 29718 tablet_replica.cc:333] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.685609 29718 raft_consensus.cc:2243] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.686306 29718 raft_consensus.cc:2272] T 73c8406ed82f41a39d22eedd2cfaa735 P 7e0734fa1b8e46bd869e346ae79a4675 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.688169 29718 tablet_replica.cc:333] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.688597 29718 raft_consensus.cc:2243] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.688948 29718 raft_consensus.cc:2272] T 28dc0277e12643bf89a534f800f8106a P 7e0734fa1b8e46bd869e346ae79a4675 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.690668 29718 tablet_replica.cc:333] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675: stopping tablet replica
I20260709 13:13:37.691092 29718 raft_consensus.cc:2243] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:37.691448 29718 raft_consensus.cc:2272] T e27c11ad9b2c45bc9e8f774767c4e404 P 7e0734fa1b8e46bd869e346ae79a4675 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.717639 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
I20260709 13:13:37.733484 29718 master.cc:562] Master@127.29.5.190:42337 shutting down...
I20260709 13:13:37.928159 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:37.928763 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:37.929109 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9258af6ecc2f4342b33bc294675798af: stopping tablet replica
I20260709 13:13:37.948215 29718 master.cc:584] Master@127.29.5.190:42337 shutdown complete.
7e0734fa1b8e46bd869e346ae79a4675  1
89daee0e84be4ae0be4cad52aa8039b9  4
d0f2aa36fdcc45c484ab32dad5174593  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13932 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:13:37.986595 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:46811
I20260709 13:13:37.987739 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.993346 30247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.993362 30246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.993949 30249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.995301 29718 server_base.cc:1061] running on GCE node
I20260709 13:13:37.996286 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.996515 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.996671 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602817996656 us; error 0 us; skew 500 ppm
I20260709 13:13:37.997174 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.999552 29718 webserver.cc:533] Webserver started at http://127.29.5.190:35759/ using document root <none> and password file <none>
I20260709 13:13:38.000110 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:38.000310 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:38.000589 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:38.001698 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "dc32bb966c8745c3b97949ab8e0d7a2f"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-kgkf"
I20260709 13:13:38.006222 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:13:38.009451 30254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.010339 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 13:13:38.010578 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "dc32bb966c8745c3b97949ab8e0d7a2f"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-kgkf"
I20260709 13:13:38.010819 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.032169 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.033370 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.070817 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:46811
I20260709 13:13:38.070906 30305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:46811 every 8 connection(s)
I20260709 13:13:38.074927 30306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.083899 30306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f: Bootstrap starting.
I20260709 13:13:38.088402 30306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.092478 30306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f: No bootstrap required, opened a new log
I20260709 13:13:38.094517 30306 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" member_type: VOTER }
I20260709 13:13:38.094877 30306 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.095160 30306 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc32bb966c8745c3b97949ab8e0d7a2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.095816 30306 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" member_type: VOTER }
I20260709 13:13:38.096271 30306 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:38.096472 30306 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:38.096791 30306 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.100704 30306 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" member_type: VOTER }
I20260709 13:13:38.101254 30306 leader_election.cc:304] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc32bb966c8745c3b97949ab8e0d7a2f; no voters: 
I20260709 13:13:38.102355 30306 leader_election.cc:290] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:38.102762 30309 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.104384 30309 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 1 LEADER]: Becoming Leader. State: Replica: dc32bb966c8745c3b97949ab8e0d7a2f, State: Running, Role: LEADER
I20260709 13:13:38.105155 30309 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" member_type: VOTER }
I20260709 13:13:38.105697 30306 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:38.110684 30310 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" member_type: VOTER } }
I20260709 13:13:38.110914 30311 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc32bb966c8745c3b97949ab8e0d7a2f. Latest consensus state: current_term: 1 leader_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc32bb966c8745c3b97949ab8e0d7a2f" member_type: VOTER } }
I20260709 13:13:38.111490 30310 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:38.111958 30311 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:38.127161 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260709 13:13:38.130033 30325 catalog_manager.cc:1594] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260709 13:13:38.130270 30325 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260709 13:13:38.130510 30316 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:38.134694 30316 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:38.142441 30316 catalog_manager.cc:1383] Generated new cluster ID: 65d96c95ff05494a9c2ee27e4d73d7cc
I20260709 13:13:38.142694 30316 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:38.165014 30316 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:38.166261 30316 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:38.182726 30316 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f: Generated new TSK 0
I20260709 13:13:38.183319 30316 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:38.193384 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:38.199361 30327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.201028 30328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.201793 30330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.202558 29718 server_base.cc:1061] running on GCE node
I20260709 13:13:38.203289 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:38.203457 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:38.203572 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602818203562 us; error 0 us; skew 500 ppm
I20260709 13:13:38.204082 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:38.206288 29718 webserver.cc:533] Webserver started at http://127.29.5.129:45845/ using document root <none> and password file <none>
I20260709 13:13:38.206710 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:38.206943 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:38.207238 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:38.208381 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "f587223defdc4836bbe8ba58a69cd40e"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-kgkf"
I20260709 13:13:38.212714 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:13:38.215731 30335 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.216639 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:38.216866 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "f587223defdc4836bbe8ba58a69cd40e"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-kgkf"
I20260709 13:13:38.217094 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.238904 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.240154 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.241568 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:38.243754 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:38.243997 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.244279 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:38.244454 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.284116 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:35433
I20260709 13:13:38.284195 30397 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:35433 every 8 connection(s)
I20260709 13:13:38.288965 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:38.297571 30403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.299149 30402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.299190 29718 server_base.cc:1061] running on GCE node
W20260709 13:13:38.299158 30405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.300824 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:38.301026 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:38.301218 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602818301182 us; error 0 us; skew 500 ppm
I20260709 13:13:38.301748 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:38.305210 29718 webserver.cc:533] Webserver started at http://127.29.5.130:34471/ using document root <none> and password file <none>
I20260709 13:13:38.305778 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:38.305989 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:38.306314 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:38.306339 30398 heartbeater.cc:344] Connected to a master server at 127.29.5.190:46811
I20260709 13:13:38.306739 30398 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:38.307432 30398 heartbeater.cc:507] Master 127.29.5.190:46811 requested a full tablet report, sending...
I20260709 13:13:38.307722 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-kgkf"
I20260709 13:13:38.309508 30271 ts_manager.cc:194] Registered new tserver with Master: f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433)
I20260709 13:13:38.311172 30271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37960
I20260709 13:13:38.312691 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:38.316192 30410 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.316890 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:38.317162 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-kgkf"
I20260709 13:13:38.317428 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.333207 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.334398 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.335887 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:38.338091 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:38.338330 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.338572 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:38.338742 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.378026 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:44627
I20260709 13:13:38.378129 30472 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:44627 every 8 connection(s)
I20260709 13:13:38.382730 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:38.391120 30477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:38.391166 30476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.394289 29718 server_base.cc:1061] running on GCE node
W20260709 13:13:38.394373 30479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:38.395606 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:38.395884 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:38.396080 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602818396063 us; error 0 us; skew 500 ppm
I20260709 13:13:38.396658 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:38.396773 30473 heartbeater.cc:344] Connected to a master server at 127.29.5.190:46811
I20260709 13:13:38.397169 30473 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:38.398105 30473 heartbeater.cc:507] Master 127.29.5.190:46811 requested a full tablet report, sending...
I20260709 13:13:38.399443 29718 webserver.cc:533] Webserver started at http://127.29.5.131:37277/ using document root <none> and password file <none>
I20260709 13:13:38.400116 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:38.400353 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:38.400415 30271 ts_manager.cc:194] Registered new tserver with Master: ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:38.400743 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:38.402237 30271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37964
I20260709 13:13:38.402251 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-kgkf"
I20260709 13:13:38.407449 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:38.410538 30484 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.411298 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:38.411597 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
format_stamp: "Formatted at 2026-07-09 13:13:38 on dist-test-slave-kgkf"
I20260709 13:13:38.411942 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:38.437193 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:38.438403 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:38.439862 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:38.441983 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:38.442214 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.442456 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:38.442627 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:38.496711 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:42419
I20260709 13:13:38.496884 30546 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:42419 every 8 connection(s)
I20260709 13:13:38.512193 30547 heartbeater.cc:344] Connected to a master server at 127.29.5.190:46811
I20260709 13:13:38.512590 30547 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:38.513403 30547 heartbeater.cc:507] Master 127.29.5.190:46811 requested a full tablet report, sending...
I20260709 13:13:38.515267 30271 ts_manager.cc:194] Registered new tserver with Master: e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:38.515679 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01558678s
I20260709 13:13:38.516656 30271 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37970
I20260709 13:13:38.539511 30271 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37972:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:38.542364 30271 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:38.611415 30363 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbf052624f0413c941b658b4cc4ebfa (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:38.613265 30363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbf052624f0413c941b658b4cc4ebfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.617321 30362 tablet_service.cc:1511] Processing CreateTablet for tablet 89590aa8fa0b4270ba6f2a1ffad3467d (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:38.619359 30362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89590aa8fa0b4270ba6f2a1ffad3467d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.630035 30512 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbf052624f0413c941b658b4cc4ebfa (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:38.630754 30511 tablet_service.cc:1511] Processing CreateTablet for tablet 89590aa8fa0b4270ba6f2a1ffad3467d (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:38.631464 30512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbf052624f0413c941b658b4cc4ebfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.633450 30361 tablet_service.cc:1511] Processing CreateTablet for tablet 763109a82c1545ccaba37ccbe1da2ae0 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:38.634733 30361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763109a82c1545ccaba37ccbe1da2ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.639184 30511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89590aa8fa0b4270ba6f2a1ffad3467d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.639086 30510 tablet_service.cc:1511] Processing CreateTablet for tablet 763109a82c1545ccaba37ccbe1da2ae0 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:38.640429 30510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763109a82c1545ccaba37ccbe1da2ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.642892 30436 tablet_service.cc:1511] Processing CreateTablet for tablet 763109a82c1545ccaba37ccbe1da2ae0 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:38.644918 30437 tablet_service.cc:1511] Processing CreateTablet for tablet 89590aa8fa0b4270ba6f2a1ffad3467d (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:38.646361 30437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89590aa8fa0b4270ba6f2a1ffad3467d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.648990 30509 tablet_service.cc:1511] Processing CreateTablet for tablet e4a76741587a4b67b1f5cf5a1ae981f7 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:38.650377 30509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a76741587a4b67b1f5cf5a1ae981f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.652997 30435 tablet_service.cc:1511] Processing CreateTablet for tablet e4a76741587a4b67b1f5cf5a1ae981f7 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:38.655822 30438 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbf052624f0413c941b658b4cc4ebfa (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:38.656029 30434 tablet_service.cc:1511] Processing CreateTablet for tablet 609f8541ef3449e69b8f03a565857aa1 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:38.655826 30508 tablet_service.cc:1511] Processing CreateTablet for tablet 609f8541ef3449e69b8f03a565857aa1 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:38.658098 30508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609f8541ef3449e69b8f03a565857aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.665326 30359 tablet_service.cc:1511] Processing CreateTablet for tablet 609f8541ef3449e69b8f03a565857aa1 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:38.667284 30359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609f8541ef3449e69b8f03a565857aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.668192 30360 tablet_service.cc:1511] Processing CreateTablet for tablet e4a76741587a4b67b1f5cf5a1ae981f7 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:38.670089 30360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a76741587a4b67b1f5cf5a1ae981f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.672690 30435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a76741587a4b67b1f5cf5a1ae981f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.673609 30438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbf052624f0413c941b658b4cc4ebfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.680289 30436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763109a82c1545ccaba37ccbe1da2ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.683513 30434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 609f8541ef3449e69b8f03a565857aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.720654 30562 tablet_bootstrap.cc:492] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:38.721807 30358 tablet_service.cc:1511] Processing CreateTablet for tablet 4cacab1c1d894d24b8256ce1f349dadd (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:38.723146 30358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cacab1c1d894d24b8256ce1f349dadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.724402 30563 tablet_bootstrap.cc:492] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:38.725203 30507 tablet_service.cc:1511] Processing CreateTablet for tablet 4cacab1c1d894d24b8256ce1f349dadd (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:38.726662 30507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cacab1c1d894d24b8256ce1f349dadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.727458 30357 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe4f9f19008456a9ec987928c45e766 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:38.728785 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe4f9f19008456a9ec987928c45e766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.733414 30433 tablet_service.cc:1511] Processing CreateTablet for tablet 4cacab1c1d894d24b8256ce1f349dadd (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:38.734849 30433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cacab1c1d894d24b8256ce1f349dadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.742043 30432 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe4f9f19008456a9ec987928c45e766 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:38.743468 30432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe4f9f19008456a9ec987928c45e766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.746835 30562 tablet_bootstrap.cc:654] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.750475 30506 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe4f9f19008456a9ec987928c45e766 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:38.752030 30563 tablet_bootstrap.cc:654] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.752179 30506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe4f9f19008456a9ec987928c45e766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.752986 30431 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0e95e1f0994e8e99ebaac95422ea2d (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:38.754310 30431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0e95e1f0994e8e99ebaac95422ea2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.768862 30361 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0e95e1f0994e8e99ebaac95422ea2d (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:38.779024 30563 tablet_bootstrap.cc:492] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:38.779525 30563 ts_tablet_manager.cc:1403] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.055s	user 0.002s	sys 0.009s
I20260709 13:13:38.782285 30563 raft_consensus.cc:359] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.782981 30563 raft_consensus.cc:385] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.783277 30563 raft_consensus.cc:740] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.783948 30512 tablet_service.cc:1511] Processing CreateTablet for tablet 3b0e95e1f0994e8e99ebaac95422ea2d (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:38.784471 30563 consensus_queue.cc:260] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.785272 30512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0e95e1f0994e8e99ebaac95422ea2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.786737 30363 tablet_service.cc:1511] Processing CreateTablet for tablet 447c665260ea458c85f12d3578996f8f (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:38.797979 30547 heartbeater.cc:499] Master 127.29.5.190:46811 was elected leader, sending a full tablet report...
I20260709 13:13:38.801730 30565 tablet_bootstrap.cc:492] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:38.805673 30361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b0e95e1f0994e8e99ebaac95422ea2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.814142 30434 tablet_service.cc:1511] Processing CreateTablet for tablet 447c665260ea458c85f12d3578996f8f (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:38.819386 30506 tablet_service.cc:1511] Processing CreateTablet for tablet 447c665260ea458c85f12d3578996f8f (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:38.821137 30506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447c665260ea458c85f12d3578996f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.821673 30362 tablet_service.cc:1511] Processing CreateTablet for tablet 3876fed8bcb440a89ae446a6be340322 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:38.822891 30362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3876fed8bcb440a89ae446a6be340322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.831175 30435 tablet_service.cc:1511] Processing CreateTablet for tablet 3876fed8bcb440a89ae446a6be340322 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:38.832901 30435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3876fed8bcb440a89ae446a6be340322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.836120 30363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447c665260ea458c85f12d3578996f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.840416 30434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447c665260ea458c85f12d3578996f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.845206 30509 tablet_service.cc:1511] Processing CreateTablet for tablet 3876fed8bcb440a89ae446a6be340322 (DEFAULT_TABLE table=test-workload [id=c98152e9c10c4babaff4a6483296150e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:38.856249 30509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3876fed8bcb440a89ae446a6be340322. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.863034 30563 ts_tablet_manager.cc:1434] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.083s	user 0.000s	sys 0.014s
I20260709 13:13:38.867614 30563 tablet_bootstrap.cc:492] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:38.898433 30565 tablet_bootstrap.cc:654] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.907655 30563 tablet_bootstrap.cc:654] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.913359 30562 tablet_bootstrap.cc:492] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:38.913821 30562 ts_tablet_manager.cc:1403] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.193s	user 0.034s	sys 0.061s
I20260709 13:13:38.916680 30562 raft_consensus.cc:359] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:38.917387 30562 raft_consensus.cc:385] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.917675 30562 raft_consensus.cc:740] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.918536 30562 consensus_queue.cc:260] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:38.922853 30563 tablet_bootstrap.cc:492] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:38.923338 30565 tablet_bootstrap.cc:492] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:38.923334 30563 ts_tablet_manager.cc:1403] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.008s
I20260709 13:13:38.924106 30565 ts_tablet_manager.cc:1403] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.026s
I20260709 13:13:38.926923 30398 heartbeater.cc:499] Master 127.29.5.190:46811 was elected leader, sending a full tablet report...
I20260709 13:13:38.926731 30563 raft_consensus.cc:359] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.927039 30565 raft_consensus.cc:359] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:38.927565 30563 raft_consensus.cc:385] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.927938 30565 raft_consensus.cc:385] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.927992 30563 raft_consensus.cc:740] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.928398 30565 raft_consensus.cc:740] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.929204 30565 consensus_queue.cc:260] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:38.929244 30563 consensus_queue.cc:260] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.931542 30563 ts_tablet_manager.cc:1434] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:13:38.932504 30563 tablet_bootstrap.cc:492] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:38.938743 30563 tablet_bootstrap.cc:654] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.940806 30562 ts_tablet_manager.cc:1434] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:13:38.941860 30562 tablet_bootstrap.cc:492] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:38.950598 30562 tablet_bootstrap.cc:654] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.953603 30565 ts_tablet_manager.cc:1434] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.022s
I20260709 13:13:38.953495 30473 heartbeater.cc:499] Master 127.29.5.190:46811 was elected leader, sending a full tablet report...
I20260709 13:13:38.956668 30563 tablet_bootstrap.cc:492] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:38.957206 30563 ts_tablet_manager.cc:1403] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.010s
I20260709 13:13:38.960743 30563 raft_consensus.cc:359] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:38.961699 30563 raft_consensus.cc:385] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.962095 30563 raft_consensus.cc:740] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.962327 30565 tablet_bootstrap.cc:492] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:38.963003 30563 consensus_queue.cc:260] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:38.965219 30563 ts_tablet_manager.cc:1434] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:38.966166 30563 tablet_bootstrap.cc:492] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:38.969013 30565 tablet_bootstrap.cc:654] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.969641 30562 tablet_bootstrap.cc:492] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:38.970127 30562 ts_tablet_manager.cc:1403] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 13:13:38.972174 30563 tablet_bootstrap.cc:654] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.972957 30562 raft_consensus.cc:359] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.973701 30562 raft_consensus.cc:385] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.974009 30562 raft_consensus.cc:740] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.975023 30562 consensus_queue.cc:260] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.980120 30562 ts_tablet_manager.cc:1434] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:13:38.981228 30562 tablet_bootstrap.cc:492] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:38.984443 30565 tablet_bootstrap.cc:492] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:38.984484 30563 tablet_bootstrap.cc:492] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:38.985476 30565 ts_tablet_manager.cc:1403] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:13:38.985488 30563 ts_tablet_manager.cc:1403] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.001s
I20260709 13:13:38.987636 30562 tablet_bootstrap.cc:654] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.988760 30565 raft_consensus.cc:359] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.989543 30565 raft_consensus.cc:385] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.989225 30563 raft_consensus.cc:359] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.989991 30565 raft_consensus.cc:740] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.990041 30563 raft_consensus.cc:385] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.990593 30563 raft_consensus.cc:740] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.990942 30565 consensus_queue.cc:260] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.991703 30563 consensus_queue.cc:260] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:38.993208 30565 ts_tablet_manager.cc:1434] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:38.994148 30565 tablet_bootstrap.cc:492] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:38.994479 30563 ts_tablet_manager.cc:1434] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:38.995733 30563 tablet_bootstrap.cc:492] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:39.000638 30565 tablet_bootstrap.cc:654] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.003402 30563 tablet_bootstrap.cc:654] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.006556 30562 tablet_bootstrap.cc:492] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.007066 30562 ts_tablet_manager.cc:1403] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.010s
I20260709 13:13:39.011162 30562 raft_consensus.cc:359] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.012104 30562 raft_consensus.cc:385] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.012521 30562 raft_consensus.cc:740] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.013569 30562 consensus_queue.cc:260] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.017069 30562 ts_tablet_manager.cc:1434] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:13:39.019634 30562 tablet_bootstrap.cc:492] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:39.021271 30563 tablet_bootstrap.cc:492] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:39.021749 30563 ts_tablet_manager.cc:1403] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.013s
I20260709 13:13:39.024637 30563 raft_consensus.cc:359] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.025405 30563 raft_consensus.cc:385] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.025707 30563 raft_consensus.cc:740] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.026556 30563 consensus_queue.cc:260] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.027109 30562 tablet_bootstrap.cc:654] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.029193 30563 ts_tablet_manager.cc:1434] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:39.030725 30563 tablet_bootstrap.cc:492] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:39.035832 30565 tablet_bootstrap.cc:492] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.036358 30565 ts_tablet_manager.cc:1403] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.017s
I20260709 13:13:39.038337 30562 tablet_bootstrap.cc:492] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.038807 30562 ts_tablet_manager.cc:1403] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:13:39.039717 30563 tablet_bootstrap.cc:654] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.041488 30562 raft_consensus.cc:359] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.042047 30562 raft_consensus.cc:385] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.039322 30565 raft_consensus.cc:359] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.042301 30562 raft_consensus.cc:740] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.042542 30565 raft_consensus.cc:385] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.042902 30565 raft_consensus.cc:740] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.043311 30562 consensus_queue.cc:260] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.043694 30565 consensus_queue.cc:260] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.045943 30565 ts_tablet_manager.cc:1434] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:39.046480 30563 tablet_bootstrap.cc:492] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:39.046931 30565 tablet_bootstrap.cc:492] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.047703 30562 ts_tablet_manager.cc:1434] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:39.048709 30562 tablet_bootstrap.cc:492] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:39.049017 30566 raft_consensus.cc:493] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.049440 30566 raft_consensus.cc:515] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.046941 30563 ts_tablet_manager.cc:1403] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:13:39.054100 30571 raft_consensus.cc:493] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.054585 30571 raft_consensus.cc:515] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:39.054802 30563 raft_consensus.cc:359] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.055332 30562 tablet_bootstrap.cc:654] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.055572 30563 raft_consensus.cc:385] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.055959 30563 raft_consensus.cc:740] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.056684 30563 consensus_queue.cc:260] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.057233 30571 leader_election.cc:290] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.060532 30565 tablet_bootstrap.cc:654] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.067394 30562 tablet_bootstrap.cc:492] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.067921 30562 ts_tablet_manager.cc:1403] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 13:13:39.070871 30562 raft_consensus.cc:359] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.071795 30562 raft_consensus.cc:385] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.072168 30562 raft_consensus.cc:740] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.073269 30562 consensus_queue.cc:260] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.076301 30562 ts_tablet_manager.cc:1434] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:39.077419 30562 tablet_bootstrap.cc:492] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:39.080919 30566 leader_election.cc:290] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.083890 30562 tablet_bootstrap.cc:654] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.096987 30562 tablet_bootstrap.cc:492] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.097976 30566 raft_consensus.cc:493] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.098717 30566 raft_consensus.cc:515] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.101212 30566 leader_election.cc:290] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.097606 30562 ts_tablet_manager.cc:1403] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:13:39.105568 30562 raft_consensus.cc:359] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.106550 30562 raft_consensus.cc:385] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.106901 30562 raft_consensus.cc:740] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.112179 30562 consensus_queue.cc:260] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.114241 30570 raft_consensus.cc:493] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.114828 30570 raft_consensus.cc:515] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:39.119876 30570 leader_election.cc:290] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
W20260709 13:13:39.121749 30319 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:39.127759 30562 ts_tablet_manager.cc:1434] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:13:39.131100 30562 tablet_bootstrap.cc:492] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:39.144258 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.144968 30373 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.146374 30411 leader_election.cc:304] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.147202 30571 raft_consensus.cc:2804] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.147567 30571 raft_consensus.cc:493] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.147950 30571 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.148789 30562 tablet_bootstrap.cc:654] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.154361 30571 raft_consensus.cc:515] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:39.157085 30571 leader_election.cc:290] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.159017 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.159675 30373 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.160961 30562 tablet_bootstrap.cc:492] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.161577 30562 ts_tablet_manager.cc:1403] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.006s
I20260709 13:13:39.165062 30562 raft_consensus.cc:359] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.170688 30562 raft_consensus.cc:385] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.170882 30571 raft_consensus.cc:493] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.171522 30570 raft_consensus.cc:493] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.171065 30562 raft_consensus.cc:740] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.171587 30571 raft_consensus.cc:515] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.172094 30570 raft_consensus.cc:515] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.173367 30562 consensus_queue.cc:260] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.175482 30566 raft_consensus.cc:493] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.175972 30566 raft_consensus.cc:515] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.177078 30563 ts_tablet_manager.cc:1434] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.125s	user 0.028s	sys 0.087s
I20260709 13:13:39.178054 30566 leader_election.cc:290] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.180325 30563 tablet_bootstrap.cc:492] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:39.181946 30565 tablet_bootstrap.cc:492] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.180826 30571 leader_election.cc:290] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.182489 30565 ts_tablet_manager.cc:1403] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.136s	user 0.047s	sys 0.049s
I20260709 13:13:39.185708 30565 raft_consensus.cc:359] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.187784 30565 raft_consensus.cc:385] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.188088 30565 raft_consensus.cc:740] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.188793 30565 consensus_queue.cc:260] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.190958 30565 ts_tablet_manager.cc:1434] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:13:39.191357 30563 tablet_bootstrap.cc:654] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.192174 30565 tablet_bootstrap.cc:492] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.192404 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.193249 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.174237 30570 leader_election.cc:290] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.194048 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.194689 30447 raft_consensus.cc:2468] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.194044 30446 raft_consensus.cc:2468] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.195652 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
W20260709 13:13:39.195988 30486 leader_election.cc:343] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.196348 30372 raft_consensus.cc:2468] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.196779 30486 leader_election.cc:304] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:39.197466 30373 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.197763 30582 raft_consensus.cc:2804] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.198192 30582 raft_consensus.cc:493] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.198891 30486 leader_election.cc:304] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:39.199126 30582 raft_consensus.cc:3060] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.199746 30566 raft_consensus.cc:2804] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.200228 30566 raft_consensus.cc:493] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.200580 30566 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.199663 30411 leader_election.cc:304] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.202376 30571 raft_consensus.cc:2804] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.202734 30571 raft_consensus.cc:493] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.203069 30571 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.204115 30565 tablet_bootstrap.cc:654] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.215917 30411 leader_election.cc:304] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.230561 30582 raft_consensus.cc:515] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.230690 30566 raft_consensus.cc:515] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.233645 30566 leader_election.cc:290] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.234194 30566 raft_consensus.cc:493] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.234764 30566 raft_consensus.cc:515] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.239300 30566 leader_election.cc:290] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.235260 30571 raft_consensus.cc:515] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.245255 30582 leader_election.cc:290] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.247040 30571 leader_election.cc:290] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.247661 30571 raft_consensus.cc:493] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.258281 30570 raft_consensus.cc:493] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.258862 30600 raft_consensus.cc:2804] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.258637 30571 raft_consensus.cc:515] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.259395 30600 raft_consensus.cc:697] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:39.259017 30570 raft_consensus.cc:515] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.260284 30600 consensus_queue.cc:237] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:39.261169 30571 leader_election.cc:290] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.261917 30570 leader_election.cc:290] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
W20260709 13:13:39.263263 30411 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:35433, user_credentials={real_user=slave}} blocked reactor thread for 48521.7us
I20260709 13:13:39.264622 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.265652 30446 raft_consensus.cc:2393] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in current term 1: Already voted for candidate ea3586ed938a4ca6a85ad7830c84dc00 in this term.
I20260709 13:13:39.265409 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.266247 30373 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.282969 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.286653 30562 ts_tablet_manager.cc:1434] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.008s
I20260709 13:13:39.288112 30562 tablet_bootstrap.cc:492] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:39.285574 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.288823 30372 raft_consensus.cc:2468] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.286830 30446 raft_consensus.cc:2468] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.294207 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.294974 30447 raft_consensus.cc:3060] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.297649 30486 leader_election.cc:304] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:39.298882 30565 tablet_bootstrap.cc:492] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.298810 30582 raft_consensus.cc:2804] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.299470 30565 ts_tablet_manager.cc:1403] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.108s	user 0.023s	sys 0.052s
I20260709 13:13:39.300835 30411 leader_election.cc:304] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.299372 30582 raft_consensus.cc:493] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.302471 30582 raft_consensus.cc:3060] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.302508 30565 raft_consensus.cc:359] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.303545 30565 raft_consensus.cc:385] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.303875 30565 raft_consensus.cc:740] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.304651 30565 consensus_queue.cc:260] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.305682 30571 raft_consensus.cc:2804] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.306062 30571 raft_consensus.cc:493] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.306384 30571 raft_consensus.cc:3060] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.306864 30563 tablet_bootstrap.cc:492] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:39.306910 30565 ts_tablet_manager.cc:1434] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:13:39.308180 30565 tablet_bootstrap.cc:492] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.307685 30563 ts_tablet_manager.cc:1403] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.128s	user 0.027s	sys 0.025s
I20260709 13:13:39.315163 30565 tablet_bootstrap.cc:654] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.316286 30563 raft_consensus.cc:359] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.324139 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.326159 30448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3876fed8bcb440a89ae446a6be340322" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.327658 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
W20260709 13:13:39.328884 30337 leader_election.cc:343] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.329998 30447 raft_consensus.cc:2468] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.331404 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.331465 30486 leader_election.cc:304] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:39.332798 30599 raft_consensus.cc:2804] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.333762 30599 raft_consensus.cc:697] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:39.334825 30599 consensus_queue.cc:237] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.337301 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.337967 30522 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 0.
I20260709 13:13:39.338058 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.318046 30563 raft_consensus.cc:385] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.328727 30571 raft_consensus.cc:515] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.338212 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.344656 30372 raft_consensus.cc:2468] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.339195 30563 raft_consensus.cc:740] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.345958 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.346587 30522 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.341835 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3876fed8bcb440a89ae446a6be340322" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.342777 30446 raft_consensus.cc:2393] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f587223defdc4836bbe8ba58a69cd40e in current term 1: Already voted for candidate ea3586ed938a4ca6a85ad7830c84dc00 in this term.
I20260709 13:13:39.342252 30370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.343044 30371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.343936 30571 leader_election.cc:290] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.346282 30563 consensus_queue.cc:260] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.343874 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.341876 30368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.354280 30570 raft_consensus.cc:493] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.356659 30563 ts_tablet_manager.cc:1434] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.008s
I20260709 13:13:39.357052 30368 raft_consensus.cc:3060] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.357699 30563 tablet_bootstrap.cc:492] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:39.360944 30562 tablet_bootstrap.cc:654] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.362552 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.356343 30570 raft_consensus.cc:515] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.364084 30369 raft_consensus.cc:2468] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.365324 30563 tablet_bootstrap.cc:654] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.368423 30570 leader_election.cc:290] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.369203 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.369841 30446 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 0.
I20260709 13:13:39.371143 30337 leader_election.cc:304] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.372125 30570 raft_consensus.cc:2804] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.372654 30570 raft_consensus.cc:493] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.373054 30570 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.373946 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:39.369968 30270 catalog_manager.cc:5697] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.348021 30582 raft_consensus.cc:515] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.376266 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.377035 30565 tablet_bootstrap.cc:492] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.377316 30522 raft_consensus.cc:2393] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3586ed938a4ca6a85ad7830c84dc00 in current term 1: Already voted for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in this term.
I20260709 13:13:39.377565 30565 ts_tablet_manager.cc:1403] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.010s
I20260709 13:13:39.374177 30368 raft_consensus.cc:2468] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.378311 30521 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.381884 30565 raft_consensus.cc:359] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.382618 30565 raft_consensus.cc:385] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.382932 30565 raft_consensus.cc:740] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.383694 30565 consensus_queue.cc:260] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.385462 30565 ts_tablet_manager.cc:1434] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:39.386377 30565 tablet_bootstrap.cc:492] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.386688 30521 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.348049 30373 raft_consensus.cc:2468] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.389709 30411 leader_election.cc:304] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.390911 30600 raft_consensus.cc:2804] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.391491 30600 raft_consensus.cc:697] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:39.391985 30570 raft_consensus.cc:515] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.392848 30600 consensus_queue.cc:237] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.396245 30570 leader_election.cc:290] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.396462 30520 raft_consensus.cc:2393] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f587223defdc4836bbe8ba58a69cd40e in current term 1: Already voted for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in this term.
I20260709 13:13:39.395985 30269 catalog_manager.cc:5697] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.398046 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.400764 30446 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.411639 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:39.424276 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
W20260709 13:13:39.424382 30485 leader_election.cc:343] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.425228 30565 tablet_bootstrap.cc:654] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.425181 30522 raft_consensus.cc:2393] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea3586ed938a4ca6a85ad7830c84dc00 in current term 1: Already voted for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in this term.
I20260709 13:13:39.429461 30520 raft_consensus.cc:2393] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea3586ed938a4ca6a85ad7830c84dc00 in current term 1: Already voted for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in this term.
I20260709 13:13:39.429621 30582 leader_election.cc:290] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.425635 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.430377 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.431137 30447 raft_consensus.cc:2393] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in current term 1: Already voted for candidate ea3586ed938a4ca6a85ad7830c84dc00 in this term.
I20260709 13:13:39.430598 30521 raft_consensus.cc:2393] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3586ed938a4ca6a85ad7830c84dc00 in current term 1: Already voted for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in this term.
I20260709 13:13:39.438215 30446 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 1.
I20260709 13:13:39.439659 30337 leader_election.cc:304] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.440702 30570 raft_consensus.cc:2804] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.441349 30570 raft_consensus.cc:697] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:39.442203 30570 consensus_queue.cc:237] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.444450 30563 tablet_bootstrap.cc:492] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:39.444991 30563 ts_tablet_manager.cc:1403] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.006s
I20260709 13:13:39.425057 30485 leader_election.cc:304] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285; no voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:39.446516 30582 raft_consensus.cc:2749] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.447490 30485 leader_election.cc:304] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285; no voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:39.448204 30582 raft_consensus.cc:2749] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.448513 30562 tablet_bootstrap.cc:492] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.440699 30600 raft_consensus.cc:493] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.449438 30600 raft_consensus.cc:515] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.449054 30562 ts_tablet_manager.cc:1403] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.161s	user 0.019s	sys 0.035s
I20260709 13:13:39.449504 30563 raft_consensus.cc:359] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.450258 30339 leader_election.cc:304] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:39.453323 30562 raft_consensus.cc:359] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.457613 30563 raft_consensus.cc:385] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.457759 30562 raft_consensus.cc:385] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.458165 30563 raft_consensus.cc:740] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.458196 30562 raft_consensus.cc:740] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.455420 30600 leader_election.cc:290] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
W20260709 13:13:39.459937 30339 leader_election.cc:343] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.461688 30601 raft_consensus.cc:2764] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:39.461935 30339 leader_election.cc:304] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f587223defdc4836bbe8ba58a69cd40e; no voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:39.462785 30368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.463479 30339 leader_election.cc:304] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f587223defdc4836bbe8ba58a69cd40e; no voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:39.467084 30414 leader_election.cc:304] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00; no voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:39.467962 30601 raft_consensus.cc:2749] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.463603 30368 raft_consensus.cc:2468] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.468426 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.468706 30601 raft_consensus.cc:3060] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.469300 30411 leader_election.cc:304] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.470065 30571 raft_consensus.cc:2749] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.470657 30571 raft_consensus.cc:2804] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.471006 30571 raft_consensus.cc:493] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.470880 30562 consensus_queue.cc:260] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.471323 30571 raft_consensus.cc:3060] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.472920 30562 ts_tablet_manager.cc:1434] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:39.473778 30562 tablet_bootstrap.cc:492] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
I20260709 13:13:39.475173 30563 consensus_queue.cc:260] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.477209 30563 ts_tablet_manager.cc:1434] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:13:39.477334 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.478034 30571 raft_consensus.cc:515] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.484686 30563 tablet_bootstrap.cc:492] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:39.485853 30571 leader_election.cc:290] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.486668 30368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.487229 30368 raft_consensus.cc:3060] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.487469 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:39.491380 30563 tablet_bootstrap.cc:654] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.495190 30368 raft_consensus.cc:2468] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.496856 30411 leader_election.cc:304] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.497923 30582 raft_consensus.cc:493] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.498369 30582 raft_consensus.cc:515] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.499859 30601 raft_consensus.cc:2749] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.500310 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.500592 30582 leader_election.cc:290] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.500905 30520 raft_consensus.cc:2468] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.483460 30562 tablet_bootstrap.cc:654] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.502192 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.497946 30571 raft_consensus.cc:2804] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.503509 30571 raft_consensus.cc:697] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
W20260709 13:13:39.503542 30339 leader_election.cc:343] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.504405 30571 consensus_queue.cc:237] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.508824 30562 tablet_bootstrap.cc:492] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.509240 30562 ts_tablet_manager.cc:1403] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.002s
I20260709 13:13:39.511795 30562 raft_consensus.cc:359] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.512320 30565 tablet_bootstrap.cc:492] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.512439 30562 raft_consensus.cc:385] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.512810 30562 raft_consensus.cc:740] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.512910 30565 ts_tablet_manager.cc:1403] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.008s
I20260709 13:13:39.513552 30562 consensus_queue.cc:260] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.515842 30562 ts_tablet_manager.cc:1434] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:39.516011 30565 raft_consensus.cc:359] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.516671 30562 tablet_bootstrap.cc:492] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: Bootstrap starting.
W20260709 13:13:39.517182 30339 leader_election.cc:343] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:39.516635 30565 raft_consensus.cc:385] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.517997 30565 raft_consensus.cc:740] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.519683 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:39.518028 30267 catalog_manager.cc:5697] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 0 to 1, leader changed from <none> to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 1 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.520341 30520 raft_consensus.cc:3060] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.523028 30562 tablet_bootstrap.cc:654] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.529445 30373 raft_consensus.cc:2468] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.532832 30520 raft_consensus.cc:2468] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.533989 30562 tablet_bootstrap.cc:492] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: No bootstrap required, opened a new log
I20260709 13:13:39.533550 30565 consensus_queue.cc:260] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.534786 30562 ts_tablet_manager.cc:1403] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:13:39.535910 30565 ts_tablet_manager.cc:1434] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:13:39.534998 30270 catalog_manager.cc:5697] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.536849 30565 tablet_bootstrap.cc:492] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.537469 30562 raft_consensus.cc:359] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.538084 30562 raft_consensus.cc:385] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.538352 30562 raft_consensus.cc:740] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.539110 30562 consensus_queue.cc:260] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.541720 30562 ts_tablet_manager.cc:1434] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:39.545353 30565 tablet_bootstrap.cc:654] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.544909 30368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.546216 30368 raft_consensus.cc:2393] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in current term 1: Already voted for candidate ea3586ed938a4ca6a85ad7830c84dc00 in this term.
I20260709 13:13:39.549757 30563 tablet_bootstrap.cc:492] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:39.550208 30563 ts_tablet_manager.cc:1403] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.021s
I20260709 13:13:39.550086 30485 leader_election.cc:304] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285; no voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:39.550902 30582 raft_consensus.cc:2749] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:39.551288 30485 leader_election.cc:304] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:39.552143 30582 raft_consensus.cc:2804] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.552402 30565 tablet_bootstrap.cc:492] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.552593 30582 raft_consensus.cc:697] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:39.552811 30565 ts_tablet_manager.cc:1403] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:13:39.553001 30563 raft_consensus.cc:359] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.553646 30563 raft_consensus.cc:385] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.553422 30582 consensus_queue.cc:237] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.553917 30563 raft_consensus.cc:740] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.554607 30563 consensus_queue.cc:260] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.555505 30565 raft_consensus.cc:359] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.556154 30565 raft_consensus.cc:385] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.556425 30565 raft_consensus.cc:740] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.556828 30563 ts_tablet_manager.cc:1434] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:13:39.557132 30565 consensus_queue.cc:260] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.557840 30563 tablet_bootstrap.cc:492] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285: Bootstrap starting.
I20260709 13:13:39.559669 30565 ts_tablet_manager.cc:1434] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:39.560808 30565 tablet_bootstrap.cc:492] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.563871 30563 tablet_bootstrap.cc:654] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.569643 30565 tablet_bootstrap.cc:654] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.572736 30563 tablet_bootstrap.cc:492] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285: No bootstrap required, opened a new log
I20260709 13:13:39.573187 30563 ts_tablet_manager.cc:1403] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:13:39.574421 30270 catalog_manager.cc:5697] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.576048 30563 raft_consensus.cc:359] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.576684 30563 raft_consensus.cc:385] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.576941 30563 raft_consensus.cc:740] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.577575 30563 consensus_queue.cc:260] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.579622 30563 ts_tablet_manager.cc:1434] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:13:39.579704 30267 catalog_manager.cc:5697] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.585902 30570 raft_consensus.cc:493] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.586437 30570 raft_consensus.cc:515] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.588439 30565 tablet_bootstrap.cc:492] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.588539 30570 leader_election.cc:290] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.588920 30565 ts_tablet_manager.cc:1403] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.006s
I20260709 13:13:39.589707 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447c665260ea458c85f12d3578996f8f" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.590121 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447c665260ea458c85f12d3578996f8f" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.590338 30520 raft_consensus.cc:2468] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 0.
I20260709 13:13:39.590693 30446 raft_consensus.cc:2468] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 0.
I20260709 13:13:39.591612 30565 raft_consensus.cc:359] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.591640 30339 leader_election.cc:304] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.592308 30565 raft_consensus.cc:385] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.592617 30565 raft_consensus.cc:740] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.592650 30570 raft_consensus.cc:2804] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.593142 30570 raft_consensus.cc:493] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.593495 30570 raft_consensus.cc:3060] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.593539 30565 consensus_queue.cc:260] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.596123 30565 ts_tablet_manager.cc:1434] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:39.597002 30565 tablet_bootstrap.cc:492] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00: Bootstrap starting.
I20260709 13:13:39.599747 30582 raft_consensus.cc:493] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.600256 30582 raft_consensus.cc:515] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.600896 30570 raft_consensus.cc:515] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.602339 30582 leader_election.cc:290] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.602728 30565 tablet_bootstrap.cc:654] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.603456 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447c665260ea458c85f12d3578996f8f" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.604017 30446 raft_consensus.cc:3060] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.606489 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.607270 30447 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.607571 30570 leader_election.cc:290] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.606530 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.608410 30373 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.608529 30486 leader_election.cc:304] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:39.610025 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447c665260ea458c85f12d3578996f8f" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:39.610172 30582 raft_consensus.cc:2804] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.610350 30565 tablet_bootstrap.cc:492] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00: No bootstrap required, opened a new log
I20260709 13:13:39.610555 30582 raft_consensus.cc:493] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.610800 30565 ts_tablet_manager.cc:1403] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.007s
I20260709 13:13:39.610949 30582 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.611179 30446 raft_consensus.cc:2468] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 1.
I20260709 13:13:39.610564 30520 raft_consensus.cc:3060] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.613214 30565 raft_consensus.cc:359] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.613811 30565 raft_consensus.cc:385] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.614037 30565 raft_consensus.cc:740] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.614665 30565 consensus_queue.cc:260] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.616171 30565 ts_tablet_manager.cc:1434] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:39.612319 30337 leader_election.cc:304] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.616817 30570 raft_consensus.cc:2804] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.617283 30570 raft_consensus.cc:697] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:39.617961 30520 raft_consensus.cc:2468] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 1.
I20260709 13:13:39.618032 30570 consensus_queue.cc:237] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.622841 30582 raft_consensus.cc:515] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.624895 30582 leader_election.cc:290] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.625625 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.625941 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.626206 30373 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.626520 30446 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.628741 30267 catalog_manager.cc:5697] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 0 to 1, leader changed from <none> to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 1 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.632968 30446 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.634130 30486 leader_election.cc:304] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:39.634724 30373 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.634821 30582 raft_consensus.cc:2804] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.635385 30582 raft_consensus.cc:697] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:39.636186 30582 consensus_queue.cc:237] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.644443 30267 catalog_manager.cc:5697] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.780201 30582 consensus_queue.cc:1048] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.792330 30571 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.818879 30600 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.822477 30582 consensus_queue.cc:1048] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.830047 30600 consensus_queue.cc:1048] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.831389 30598 raft_consensus.cc:493] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.831941 30598 raft_consensus.cc:515] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.834252 30598 leader_election.cc:290] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.834153 30570 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.836614 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.837486 30369 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.839224 30411 leader_election.cc:304] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.841682 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" is_pre_election: true
I20260709 13:13:39.842568 30521 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 0.
I20260709 13:13:39.842716 30598 raft_consensus.cc:2804] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.843387 30598 raft_consensus.cc:493] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.847918 30598 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.878646 30598 raft_consensus.cc:515] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.886080 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.886724 30372 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.890498 30598 leader_election.cc:290] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:39.891204 30521 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.892462 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:39.893100 30522 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.898041 30372 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.900173 30522 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 1.
I20260709 13:13:39.900480 30411 leader_election.cc:304] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.901372 30600 consensus_queue.cc:1048] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.905386 30600 raft_consensus.cc:2804] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.905985 30600 raft_consensus.cc:697] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:39.907013 30600 consensus_queue.cc:237] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.935803 30582 raft_consensus.cc:493] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.936297 30582 raft_consensus.cc:515] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.936515 30601 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.940188 30582 leader_election.cc:290] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.940722 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.942761 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.944336 30486 leader_election.cc:304] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285; no voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:39.948918 30582 raft_consensus.cc:2749] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:39.953874 30270 catalog_manager.cc:5697] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.956568 30582 raft_consensus.cc:493] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.957010 30582 raft_consensus.cc:515] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.957201 30600 consensus_queue.cc:1048] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:39.959010 30582 leader_election.cc:290] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.960106 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3876fed8bcb440a89ae446a6be340322" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e" is_pre_election: true
I20260709 13:13:39.960342 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3876fed8bcb440a89ae446a6be340322" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" is_pre_election: true
I20260709 13:13:39.960770 30372 raft_consensus.cc:2468] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.960958 30446 raft_consensus.cc:2468] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 0.
I20260709 13:13:39.962078 30485 leader_election.cc:304] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.963084 30599 raft_consensus.cc:2804] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:39.963438 30599 raft_consensus.cc:493] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.963876 30599 raft_consensus.cc:3060] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.970425 30599 raft_consensus.cc:515] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:39.973381 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3876fed8bcb440a89ae446a6be340322" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:39.973943 30372 raft_consensus.cc:3060] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.975242 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3876fed8bcb440a89ae446a6be340322" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:39.975791 30446 raft_consensus.cc:3060] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.981382 30372 raft_consensus.cc:2468] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.972518 30599 leader_election.cc:290] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:39.982439 30485 leader_election.cc:304] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:39.982645 30446 raft_consensus.cc:2468] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 1.
I20260709 13:13:39.983182 30599 raft_consensus.cc:2804] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.983917 30599 raft_consensus.cc:697] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:39.983352 30637 consensus_queue.cc:1048] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:39.984759 30599 consensus_queue.cc:237] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.000828 30270 catalog_manager.cc:5697] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.057658 30601 consensus_queue.cc:1048] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.058328 30599 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.069761 30614 consensus_queue.cc:1048] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.075928 30599 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.131573 30599 consensus_queue.cc:1048] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.141861 30566 consensus_queue.cc:1048] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.339527 30637 consensus_queue.cc:1048] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.360826 30598 consensus_queue.cc:1048] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.385468 30446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:46962
I20260709 13:13:40.386128 30446 raft_consensus.cc:606] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:40.391641 30446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:46962
I20260709 13:13:40.392185 30446 raft_consensus.cc:606] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:40.407449 30521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:55606
I20260709 13:13:40.408121 30521 raft_consensus.cc:606] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:40.412927 30521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:55606
I20260709 13:13:40.413465 30521 raft_consensus.cc:606] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:40.426833 30521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
mode: GRACEFUL
new_leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:55606
I20260709 13:13:40.427460 30521 raft_consensus.cc:606] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Received request to transfer leadership to TS ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:40.440816 30372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "447c665260ea458c85f12d3578996f8f"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:50474
I20260709 13:13:40.441362 30372 raft_consensus.cc:606] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Received request to transfer leadership to TS ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:40.519136 30599 raft_consensus.cc:993] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: : Instructing follower ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:40.519620 30566 raft_consensus.cc:1081] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Signalling peer ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:40.521253 30446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:46946
I20260709 13:13:40.521716 30446 raft_consensus.cc:493] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.522090 30446 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.526738 30446 raft_consensus.cc:515] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.529460 30446 leader_election.cc:290] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 2 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:40.529757 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:40.529819 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:40.530407 30372 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.530467 30521 raft_consensus.cc:3055] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.530905 30521 raft_consensus.cc:740] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:40.531677 30521 consensus_queue.cc:260] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.532927 30521 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.537819 30372 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 2.
I20260709 13:13:40.538972 30411 leader_election.cc:304] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:40.539646 30598 raft_consensus.cc:2804] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.540103 30598 raft_consensus.cc:697] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:40.540266 30521 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 2.
I20260709 13:13:40.540910 30598 consensus_queue.cc:237] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.542338 30566 consensus_queue.cc:1048] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.548285 30270 catalog_manager.cc:5697] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 1 to 2, leader changed from e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131) to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.556919 30599 consensus_queue.cc:1048] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:40.618479 30601 raft_consensus.cc:993] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:40.618949 30601 raft_consensus.cc:1081] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Signalling peer ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:40.620620 30446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "447c665260ea458c85f12d3578996f8f"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:46958
I20260709 13:13:40.621107 30446 raft_consensus.cc:493] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.621425 30446 raft_consensus.cc:3060] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.626024 30446 raft_consensus.cc:515] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.627591 30446 leader_election.cc:290] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 2 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:40.628504 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447c665260ea458c85f12d3578996f8f" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:40.628628 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447c665260ea458c85f12d3578996f8f" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:40.629150 30372 raft_consensus.cc:3055] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.629225 30521 raft_consensus.cc:3060] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.629596 30372 raft_consensus.cc:740] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:40.630318 30372 consensus_queue.cc:260] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.631210 30372 raft_consensus.cc:3060] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.634729 30521 raft_consensus.cc:2468] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 2.
I20260709 13:13:40.635643 30372 raft_consensus.cc:2468] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 2.
I20260709 13:13:40.635854 30414 leader_election.cc:304] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:40.636703 30598 raft_consensus.cc:2804] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.637071 30598 raft_consensus.cc:697] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:40.637817 30598 consensus_queue.cc:237] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.643539 30270 catalog_manager.cc:5697] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 1 to 2, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.682484 30658 raft_consensus.cc:993] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.682924 30582 raft_consensus.cc:1081] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.684315 30372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50458
I20260709 13:13:40.684810 30372 raft_consensus.cc:493] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.685137 30372 raft_consensus.cc:3060] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.689666 30372 raft_consensus.cc:515] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.691401 30372 leader_election.cc:290] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:40.692220 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:40.692508 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763109a82c1545ccaba37ccbe1da2ae0" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:40.692757 30446 raft_consensus.cc:3060] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.693077 30521 raft_consensus.cc:3055] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.693356 30521 raft_consensus.cc:740] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:40.693996 30521 consensus_queue.cc:260] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.694895 30521 raft_consensus.cc:3060] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.697790 30446 raft_consensus.cc:2468] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.698998 30337 leader_election.cc:304] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:40.699790 30601 raft_consensus.cc:2804] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.699899 30521 raft_consensus.cc:2468] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.700270 30601 raft_consensus.cc:697] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:40.701082 30601 consensus_queue.cc:237] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.706949 30270 catalog_manager.cc:5697] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 1 to 2, leader changed from e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 2 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.792894 30658 raft_consensus.cc:993] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.793304 30582 raft_consensus.cc:1081] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.794715 30372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50458
I20260709 13:13:40.795284 30372 raft_consensus.cc:493] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.795565 30372 raft_consensus.cc:3060] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.800096 30372 raft_consensus.cc:515] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.801631 30372 leader_election.cc:290] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:40.802526 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:40.802816 30521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a76741587a4b67b1f5cf5a1ae981f7" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:40.803123 30446 raft_consensus.cc:3060] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.803326 30521 raft_consensus.cc:3055] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.803653 30521 raft_consensus.cc:740] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:40.804497 30521 consensus_queue.cc:260] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.805629 30521 raft_consensus.cc:3060] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.810057 30446 raft_consensus.cc:2468] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.811254 30337 leader_election.cc:304] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:40.811956 30601 raft_consensus.cc:2804] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.812345 30601 raft_consensus.cc:697] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:40.812425 30521 raft_consensus.cc:2468] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.813179 30601 consensus_queue.cc:237] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.819656 30270 catalog_manager.cc:5697] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 1 to 2, leader changed from e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 2 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.845741 30571 raft_consensus.cc:993] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.846130 30598 raft_consensus.cc:1081] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.847450 30372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50470
I20260709 13:13:40.847939 30372 raft_consensus.cc:493] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.848196 30372 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.852629 30372 raft_consensus.cc:515] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.854774 30372 leader_election.cc:290] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:40.855400 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:40.856034 30446 raft_consensus.cc:3055] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.856416 30446 raft_consensus.cc:740] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:40.856702 30522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:40.857239 30446 consensus_queue.cc:260] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.858402 30446 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.862962 30446 raft_consensus.cc:2468] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.863838 30337 leader_election.cc:304] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: e4a6e8ab7f6d48d198f3c2e4795d7285
I20260709 13:13:40.864475 30601 raft_consensus.cc:2804] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.864871 30601 raft_consensus.cc:697] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:40.865634 30601 consensus_queue.cc:237] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:40.871388 30270 catalog_manager.cc:5697] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 1 to 2, leader changed from ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 2 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.968420 30571 raft_consensus.cc:993] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.968886 30598 raft_consensus.cc:1081] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:40.970384 30372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50470
I20260709 13:13:40.970837 30372 raft_consensus.cc:493] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.971138 30372 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.975800 30372 raft_consensus.cc:515] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:40.977510 30372 leader_election.cc:290] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Requested vote from peers e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:40.978299 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:40.978580 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:40.978828 30520 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.979090 30446 raft_consensus.cc:3055] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.979382 30446 raft_consensus.cc:740] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:40.980050 30446 consensus_queue.cc:260] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:40.980904 30446 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.983489 30520 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.984490 30339 leader_election.cc:304] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:40.985249 30601 raft_consensus.cc:2804] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.985637 30601 raft_consensus.cc:697] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:40.985733 30446 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:40.986640 30601 consensus_queue.cc:237] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:40.993080 30270 catalog_manager.cc:5697] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 1 to 2, leader changed from ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 2 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.070269 30520 raft_consensus.cc:1275] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.071450 30598 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.080772 30372 raft_consensus.cc:1275] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.086071 30637 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.150120 30520 raft_consensus.cc:1275] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.151233 30601 consensus_queue.cc:1048] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.159440 30446 raft_consensus.cc:1275] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.160993 30669 consensus_queue.cc:1048] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.188098 30520 raft_consensus.cc:1275] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.189349 30571 consensus_queue.cc:1048] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.197841 30372 raft_consensus.cc:1275] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.199347 30598 consensus_queue.cc:1048] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:41.259066 30394 debug-util.cc:398] Leaking SignalData structure 0x7b08001906c0 after lost signal to thread 29721
W20260709 13:13:41.260004 30394 debug-util.cc:398] Leaking SignalData structure 0x7b08001d52e0 after lost signal to thread 30305
I20260709 13:13:41.278894 30446 raft_consensus.cc:1275] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.280337 30669 consensus_queue.cc:1048] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.291055 30520 raft_consensus.cc:1275] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.292469 30570 consensus_queue.cc:1048] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.409015 30446 raft_consensus.cc:1275] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.410334 30570 consensus_queue.cc:1048] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.421533 30520 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.431685 30520 raft_consensus.cc:1275] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.433243 30601 consensus_queue.cc:1048] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.562779 30520 raft_consensus.cc:1275] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.564174 30601 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:41.567869 30446 raft_consensus.cc:1275] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:41.569638 30601 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:43.477648 29718 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:13:43.478394 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:43.507210 30372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:13:43.507906 30372 raft_consensus.cc:606] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Received request to transfer leadership to TS e4a6e8ab7f6d48d198f3c2e4795d7285
I20260709 13:13:43.510802 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:13:43.511299 30369 raft_consensus.cc:606] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Received request to transfer leadership to TS e4a6e8ab7f6d48d198f3c2e4795d7285
I20260709 13:13:43.512471 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:43.513163 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:43.515513 30669 raft_consensus.cc:993] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:43.515990 30683 raft_consensus.cc:1081] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Signalling peer e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:43.517514 30520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:13:43.518098 30520 raft_consensus.cc:493] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.518505 30520 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.526085 30520 raft_consensus.cc:515] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:43.528252 30520 leader_election.cc:290] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 3 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:43.529043 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:43.529409 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:43.529659 30369 raft_consensus.cc:3055] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:43.529968 30446 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.530001 30369 raft_consensus.cc:740] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:43.530889 30369 consensus_queue.cc:260] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:43.531874 30369 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:43.536258 30369 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 3.
I20260709 13:13:43.536931 30446 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 3.
I20260709 13:13:43.537369 30485 leader_election.cc:304] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:43.538127 30681 raft_consensus.cc:2804] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:43.539218 30681 raft_consensus.cc:697] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:43.540051 30681 consensus_queue.cc:237] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:43.550052 30267 catalog_manager.cc:5697] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 2 to 3, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:43.850136 30669 raft_consensus.cc:993] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:43.850626 30683 raft_consensus.cc:1081] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Signalling peer e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:43.852308 30520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:13:43.852901 30520 raft_consensus.cc:493] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:43.853340 30520 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.858243 30520 raft_consensus.cc:515] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:43.860395 30520 leader_election.cc:290] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 2 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:43.860662 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:43.861454 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:43.861999 30369 raft_consensus.cc:3055] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:43.862051 30446 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.862481 30369 raft_consensus.cc:740] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:43.863327 30369 consensus_queue.cc:260] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:43.864683 30369 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:43.869231 30446 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 2.
I20260709 13:13:43.869369 30369 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 2.
I20260709 13:13:43.870368 30486 leader_election.cc:304] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:43.871209 30681 raft_consensus.cc:2804] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:43.871752 30681 raft_consensus.cc:697] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:43.872738 30681 consensus_queue.cc:237] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:43.880899 30267 catalog_manager.cc:5697] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 1 to 2, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:43.951709 30446 raft_consensus.cc:1275] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:43.953332 30681 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:43.967374 30369 raft_consensus.cc:1275] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:43.969108 30681 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:44.297873 30369 raft_consensus.cc:1275] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.299615 30681 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:44.313891 30446 raft_consensus.cc:1275] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:44.315478 30681 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.514154 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:44.525592 30520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:55606
I20260709 13:13:44.526248 30520 raft_consensus.cc:606] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:44.538553 30520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:55606
I20260709 13:13:44.539054 30520 raft_consensus.cc:606] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:44.543638 30447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:46962
I20260709 13:13:44.544258 30447 raft_consensus.cc:606] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:44.548835 30447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:46962
I20260709 13:13:44.549350 30447 raft_consensus.cc:606] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:44.554105 30447 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
mode: GRACEFUL
new_leader_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:46962
I20260709 13:13:44.554633 30447 raft_consensus.cc:606] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Received request to transfer leadership to TS f587223defdc4836bbe8ba58a69cd40e
I20260709 13:13:44.636631 30682 raft_consensus.cc:993] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.638173 30682 raft_consensus.cc:1081] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.640133 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50470
I20260709 13:13:44.640739 30369 raft_consensus.cc:493] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.641093 30369 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.647159 30369 raft_consensus.cc:515] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.648861 30369 leader_election.cc:290] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:44.649822 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:44.649971 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:44.650554 30447 raft_consensus.cc:3055] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.650599 30520 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.650916 30447 raft_consensus.cc:740] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:44.651752 30447 consensus_queue.cc:260] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.653164 30447 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.656921 30520 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:44.658053 30339 leader_election.cc:304] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:44.658886 30683 raft_consensus.cc:2804] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.659677 30447 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:44.659890 30683 raft_consensus.cc:697] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:44.661055 30683 consensus_queue.cc:237] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.667603 30267 catalog_manager.cc:5697] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 1 to 2, leader changed from ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 2 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.816937 30681 raft_consensus.cc:993] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.817466 30702 raft_consensus.cc:1081] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.818899 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50458
I20260709 13:13:44.819483 30369 raft_consensus.cc:493] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.819741 30369 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.824739 30369 raft_consensus.cc:515] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.826244 30369 leader_election.cc:290] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 3 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:44.826941 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:44.827278 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:44.827509 30447 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.827809 30520 raft_consensus.cc:3055] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:44.828054 30520 raft_consensus.cc:740] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:44.828720 30520 consensus_queue.cc:260] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.829567 30520 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.832250 30447 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 3.
I20260709 13:13:44.833392 30337 leader_election.cc:304] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:44.833674 30520 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 3.
I20260709 13:13:44.834048 30683 raft_consensus.cc:2804] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.834705 30683 raft_consensus.cc:697] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:44.835654 30683 consensus_queue.cc:237] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.841917 30267 catalog_manager.cc:5697] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 2 to 3, leader changed from e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 3 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.874526 30681 raft_consensus.cc:993] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.874960 30702 raft_consensus.cc:1081] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.876385 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50458
I20260709 13:13:44.876894 30369 raft_consensus.cc:493] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.877208 30369 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.882007 30369 raft_consensus.cc:515] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:44.883618 30369 leader_election.cc:290] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 4 election: Requested vote from peers e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:44.884545 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:44.884657 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbf052624f0413c941b658b4cc4ebfa" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:44.885134 30520 raft_consensus.cc:3055] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:44.885228 30447 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.885430 30520 raft_consensus.cc:740] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:44.886124 30520 consensus_queue.cc:260] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:44.886986 30520 raft_consensus.cc:3060] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:44.890774 30447 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 4.
I20260709 13:13:44.892053 30337 leader_election.cc:304] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ea3586ed938a4ca6a85ad7830c84dc00, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:44.892756 30520 raft_consensus.cc:2468] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 4.
I20260709 13:13:44.893002 30705 raft_consensus.cc:2804] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:44.893504 30705 raft_consensus.cc:697] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 4 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:44.894424 30705 consensus_queue.cc:237] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } }
I20260709 13:13:44.900202 30267 catalog_manager.cc:5697] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 3 to 4, leader changed from e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 4 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.947312 30700 raft_consensus.cc:993] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.947871 30704 raft_consensus.cc:1081] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.949244 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50470
I20260709 13:13:44.949669 30369 raft_consensus.cc:493] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.949937 30369 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.954623 30369 raft_consensus.cc:515] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.956710 30369 leader_election.cc:290] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 3 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:44.957772 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:44.958019 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:44.958411 30447 raft_consensus.cc:3055] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:44.958565 30520 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.958822 30447 raft_consensus.cc:740] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:44.959702 30447 consensus_queue.cc:260] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.960284 30700 raft_consensus.cc:993] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: : Instructing follower f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.960762 30704 raft_consensus.cc:1081] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Signalling peer f587223defdc4836bbe8ba58a69cd40e to start an election
I20260709 13:13:44.961064 30447 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:44.962301 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
 from {username='slave'} at 127.0.0.1:50470
I20260709 13:13:44.962826 30369 raft_consensus.cc:493] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:44.963174 30369 raft_consensus.cc:3060] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.964845 30520 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 3.
I20260709 13:13:44.965917 30339 leader_election.cc:304] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:44.967490 30683 raft_consensus.cc:2804] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:44.967808 30447 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 3.
I20260709 13:13:44.967934 30683 raft_consensus.cc:697] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:44.969348 30683 consensus_queue.cc:237] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.969722 30369 raft_consensus.cc:515] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.971736 30369 leader_election.cc:290] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Requested vote from peers ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:44.972862 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:44.973274 30520 raft_consensus.cc:3060] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.977008 30447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe4f9f19008456a9ec987928c45e766" candidate_uuid: "f587223defdc4836bbe8ba58a69cd40e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:44.977681 30447 raft_consensus.cc:3055] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:44.978062 30520 raft_consensus.cc:2468] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:44.978075 30447 raft_consensus.cc:740] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:44.979166 30339 leader_election.cc:304] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:44.979979 30683 raft_consensus.cc:2804] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:44.980072 30447 consensus_queue.cc:260] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.981420 30447 raft_consensus.cc:3060] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:44.981176 30267 catalog_manager.cc:5697] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 2 to 3, leader changed from ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 3 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:44.984328 30683 raft_consensus.cc:697] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Leader. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:44.985226 30683 consensus_queue.cc:237] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:44.987190 30447 raft_consensus.cc:2468] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f587223defdc4836bbe8ba58a69cd40e in term 2.
I20260709 13:13:44.994398 30267 catalog_manager.cc:5697] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e reported cstate change: term changed from 1 to 2, leader changed from ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130) to f587223defdc4836bbe8ba58a69cd40e (127.29.5.129). New cstate: current_term: 2 leader_uuid: "f587223defdc4836bbe8ba58a69cd40e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.083184 30447 raft_consensus.cc:1275] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.084533 30683 consensus_queue.cc:1048] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.093814 30520 raft_consensus.cc:1275] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.095659 30711 consensus_queue.cc:1048] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:45.225395 30446 raft_consensus.cc:1275] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.226502 30683 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.233835 30520 raft_consensus.cc:1275] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.235250 30711 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.395790 30520 raft_consensus.cc:1275] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:45.395816 30446 raft_consensus.cc:1275] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.398273 30711 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:45.398567 30683 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.415007 30520 raft_consensus.cc:1275] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:45.416864 30705 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:45.419166 30446 raft_consensus.cc:1275] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:45.421952 30705 consensus_queue.cc:1048] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:45.535172 30520 raft_consensus.cc:1275] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.536329 30683 consensus_queue.cc:1048] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:45.544690 30446 raft_consensus.cc:1275] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Refusing update from remote peer f587223defdc4836bbe8ba58a69cd40e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:45.546190 30705 consensus_queue.cc:1048] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.561702 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:47.570506 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:13:47.571077 30369 raft_consensus.cc:606] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Received request to transfer leadership to TS e4a6e8ab7f6d48d198f3c2e4795d7285
I20260709 13:13:47.573523 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:13:47.574016 30369 raft_consensus.cc:606] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Received request to transfer leadership to TS ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:47.576943 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:13:47.577464 30369 raft_consensus.cc:606] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Received request to transfer leadership to TS e4a6e8ab7f6d48d198f3c2e4795d7285
I20260709 13:13:47.579584 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d"
dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
mode: GRACEFUL
new_leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:50490
I20260709 13:13:47.580106 30369 raft_consensus.cc:606] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Received request to transfer leadership to TS ea3586ed938a4ca6a85ad7830c84dc00
I20260709 13:13:47.581117 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:47.581605 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:47.921130 30727 raft_consensus.cc:993] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:47.921612 30728 raft_consensus.cc:1081] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Signalling peer ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:47.922896 30446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:46958
I20260709 13:13:47.923382 30446 raft_consensus.cc:493] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.923667 30446 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.928200 30446 raft_consensus.cc:515] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.930059 30446 leader_election.cc:290] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 3 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:47.931974 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:47.932538 30520 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.933188 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cacab1c1d894d24b8256ce1f349dadd" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:47.933728 30369 raft_consensus.cc:3055] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:47.934019 30369 raft_consensus.cc:740] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:47.934098 30727 raft_consensus.cc:993] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:47.934634 30728 raft_consensus.cc:1081] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Signalling peer e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:47.934818 30369 consensus_queue.cc:260] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.936082 30369 raft_consensus.cc:3060] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.936193 30522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:13:47.936626 30522 raft_consensus.cc:493] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.936866 30522 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.939064 30520 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 3.
I20260709 13:13:47.940701 30414 leader_election.cc:304] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:47.941469 30704 raft_consensus.cc:2804] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:47.942543 30728 raft_consensus.cc:993] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:47.943058 30728 raft_consensus.cc:1081] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Signalling peer e4a6e8ab7f6d48d198f3c2e4795d7285 to start an election
I20260709 13:13:47.942997 30522 raft_consensus.cc:515] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.942890 30369 raft_consensus.cc:2468] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 3.
I20260709 13:13:47.944176 30704 raft_consensus.cc:697] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:47.945576 30520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d"
dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:13:47.946194 30520 raft_consensus.cc:493] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.946331 30522 leader_election.cc:290] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 4 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:47.945521 30704 consensus_queue.cc:237] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.947436 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:47.947999 30446 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.946588 30520 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.952397 30446 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 4.
I20260709 13:13:47.953619 30486 leader_election.cc:304] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:47.953034 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "609f8541ef3449e69b8f03a565857aa1" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:47.954391 30726 raft_consensus.cc:2804] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:47.954741 30369 raft_consensus.cc:3055] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:47.956363 30726 raft_consensus.cc:697] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:47.956063 30520 raft_consensus.cc:515] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.956693 30267 catalog_manager.cc:5697] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 2 to 3, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.957173 30726 consensus_queue.cc:237] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.955871 30369 raft_consensus.cc:740] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:47.959896 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:47.960580 30372 raft_consensus.cc:3055] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:47.960994 30372 raft_consensus.cc:740] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:47.960512 30369 consensus_queue.cc:260] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.961910 30372 consensus_queue.cc:260] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.962808 30369 raft_consensus.cc:3060] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.963286 30372 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.970213 30372 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 4.
I20260709 13:13:47.971517 30485 leader_election.cc:304] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, f587223defdc4836bbe8ba58a69cd40e; no voters: 
I20260709 13:13:47.972304 30446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b0e95e1f0994e8e99ebaac95422ea2d" candidate_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
I20260709 13:13:47.972581 30731 raft_consensus.cc:2804] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:47.972836 30446 raft_consensus.cc:3060] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:47.975706 30369 raft_consensus.cc:2468] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 4.
I20260709 13:13:47.981076 30731 raft_consensus.cc:697] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 LEADER]: Becoming Leader. State: Replica: e4a6e8ab7f6d48d198f3c2e4795d7285, State: Running, Role: LEADER
I20260709 13:13:47.982277 30731 consensus_queue.cc:237] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:47.984408 30446 raft_consensus.cc:2468] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4a6e8ab7f6d48d198f3c2e4795d7285 in term 4.
I20260709 13:13:47.984179 30270 catalog_manager.cc:5697] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 3 to 4, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 4 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.986088 30520 leader_election.cc:290] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [CANDIDATE]: Term 4 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627)
I20260709 13:13:47.993628 30727 raft_consensus.cc:993] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: : Instructing follower ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:47.994133 30728 raft_consensus.cc:1081] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Signalling peer ea3586ed938a4ca6a85ad7830c84dc00 to start an election
I20260709 13:13:47.995510 30446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d"
dest_uuid: "ea3586ed938a4ca6a85ad7830c84dc00"
 from {username='slave'} at 127.0.0.1:46958
I20260709 13:13:47.995936 30446 raft_consensus.cc:493] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:47.996182 30446 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:47.998843 30270 catalog_manager.cc:5697] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 reported cstate change: term changed from 3 to 4, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131). New cstate: current_term: 4 leader_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:48.000520 30446 raft_consensus.cc:515] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:48.002105 30446 leader_election.cc:290] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 3 election: Requested vote from peers f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433), e4a6e8ab7f6d48d198f3c2e4795d7285 (127.29.5.131:42419)
I20260709 13:13:48.002664 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f587223defdc4836bbe8ba58a69cd40e"
I20260709 13:13:48.003104 30369 raft_consensus.cc:3055] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:48.003346 30369 raft_consensus.cc:740] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f587223defdc4836bbe8ba58a69cd40e, State: Running, Role: LEADER
I20260709 13:13:48.004010 30369 consensus_queue.cc:260] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:48.004715 30520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89590aa8fa0b4270ba6f2a1ffad3467d" candidate_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285"
I20260709 13:13:48.004962 30369 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.005151 30520 raft_consensus.cc:3060] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:48.009609 30520 raft_consensus.cc:2468] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 3.
I20260709 13:13:48.009732 30369 raft_consensus.cc:2468] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3586ed938a4ca6a85ad7830c84dc00 in term 3.
I20260709 13:13:48.010502 30414 leader_election.cc:304] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4a6e8ab7f6d48d198f3c2e4795d7285, ea3586ed938a4ca6a85ad7830c84dc00; no voters: 
I20260709 13:13:48.011198 30704 raft_consensus.cc:2804] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:48.011658 30704 raft_consensus.cc:697] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 LEADER]: Becoming Leader. State: Replica: ea3586ed938a4ca6a85ad7830c84dc00, State: Running, Role: LEADER
I20260709 13:13:48.012447 30704 consensus_queue.cc:237] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } }
I20260709 13:13:48.019023 30270 catalog_manager.cc:5697] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 reported cstate change: term changed from 2 to 3, leader changed from f587223defdc4836bbe8ba58a69cd40e (127.29.5.129) to ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:48.346118 30369 raft_consensus.cc:1275] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.347234 30704 consensus_queue.cc:1048] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.355609 30520 raft_consensus.cc:1275] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.357129 30729 consensus_queue.cc:1048] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.425299 30369 raft_consensus.cc:1275] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:48.426579 30731 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:48.434619 30446 raft_consensus.cc:1275] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:48.436720 30735 consensus_queue.cc:1048] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:48.445266 30446 raft_consensus.cc:1275] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:48.446412 30735 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3586ed938a4ca6a85ad7830c84dc00" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 44627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:48.455454 30369 raft_consensus.cc:1275] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Refusing update from remote peer e4a6e8ab7f6d48d198f3c2e4795d7285: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:48.456689 30731 consensus_queue.cc:1048] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:48.475286 30520 raft_consensus.cc:1275] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.476429 30729 consensus_queue.cc:1048] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4a6e8ab7f6d48d198f3c2e4795d7285" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 42419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:48.485198 30369 raft_consensus.cc:1275] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Refusing update from remote peer ea3586ed938a4ca6a85ad7830c84dc00: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:48.487546 30750 consensus_queue.cc:1048] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f587223defdc4836bbe8ba58a69cd40e" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:48.582418 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:48.588831 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
I20260709 13:13:48.612350 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:48.613252 29718 tablet_replica.cc:333] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.613873 29718 raft_consensus.cc:2243] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.614356 29718 raft_consensus.cc:2272] T 447c665260ea458c85f12d3578996f8f P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.616266 29718 tablet_replica.cc:333] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.616778 29718 raft_consensus.cc:2243] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.617197 29718 raft_consensus.cc:2272] T 4cacab1c1d894d24b8256ce1f349dadd P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.619992 29718 tablet_replica.cc:333] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.620512 29718 raft_consensus.cc:2243] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.621320 29718 raft_consensus.cc:2272] T 763109a82c1545ccaba37ccbe1da2ae0 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.623195 29718 tablet_replica.cc:333] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.623710 29718 raft_consensus.cc:2243] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.624179 29718 raft_consensus.cc:2272] T 3876fed8bcb440a89ae446a6be340322 P f587223defdc4836bbe8ba58a69cd40e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.625926 29718 tablet_replica.cc:333] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.626432 29718 raft_consensus.cc:2243] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.627133 29718 raft_consensus.cc:2272] T e4a76741587a4b67b1f5cf5a1ae981f7 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.628969 29718 tablet_replica.cc:333] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.629475 29718 raft_consensus.cc:2243] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.629869 29718 raft_consensus.cc:2272] T 3b0e95e1f0994e8e99ebaac95422ea2d P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.632166 29718 tablet_replica.cc:333] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.632655 29718 raft_consensus.cc:2243] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.633046 29718 raft_consensus.cc:2272] T 609f8541ef3449e69b8f03a565857aa1 P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.634912 29718 tablet_replica.cc:333] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.635394 29718 raft_consensus.cc:2243] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.636155 29718 raft_consensus.cc:2272] T 3fe4f9f19008456a9ec987928c45e766 P f587223defdc4836bbe8ba58a69cd40e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.637728 29718 tablet_replica.cc:333] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.638185 29718 raft_consensus.cc:2243] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.638563 29718 raft_consensus.cc:2272] T 89590aa8fa0b4270ba6f2a1ffad3467d P f587223defdc4836bbe8ba58a69cd40e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.640723 29718 tablet_replica.cc:333] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e: stopping tablet replica
I20260709 13:13:48.641168 29718 raft_consensus.cc:2243] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.641847 29718 raft_consensus.cc:2272] T 0bbf052624f0413c941b658b4cc4ebfa P f587223defdc4836bbe8ba58a69cd40e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.684825 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
W20260709 13:13:48.701902 30411 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:35433: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 13:13:48.705724 30411 consensus_peers.cc:597] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 -> Peer f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433): Couldn't send request to peer f587223defdc4836bbe8ba58a69cd40e. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:35433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.706534 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
I20260709 13:13:48.731058 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:48.731854 29718 tablet_replica.cc:333] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.732429 29718 raft_consensus.cc:2243] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.733227 29718 raft_consensus.cc:2272] T 4cacab1c1d894d24b8256ce1f349dadd P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.735754 29718 tablet_replica.cc:333] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.736378 29718 raft_consensus.cc:2243] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.737154 29718 raft_consensus.cc:2272] T 447c665260ea458c85f12d3578996f8f P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.738816 29718 tablet_replica.cc:333] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.739332 29718 raft_consensus.cc:2243] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.739730 29718 raft_consensus.cc:2272] T 3b0e95e1f0994e8e99ebaac95422ea2d P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.741894 29718 tablet_replica.cc:333] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.742400 29718 raft_consensus.cc:2243] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.742789 29718 raft_consensus.cc:2272] T 3fe4f9f19008456a9ec987928c45e766 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.744303 29718 tablet_replica.cc:333] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.744801 29718 raft_consensus.cc:2243] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.745476 29718 raft_consensus.cc:2272] T 89590aa8fa0b4270ba6f2a1ffad3467d P ea3586ed938a4ca6a85ad7830c84dc00 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.747277 29718 tablet_replica.cc:333] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.747756 29718 raft_consensus.cc:2243] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.748209 29718 raft_consensus.cc:2272] T 609f8541ef3449e69b8f03a565857aa1 P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.750159 29718 tablet_replica.cc:333] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.750638 29718 raft_consensus.cc:2243] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.751040 29718 raft_consensus.cc:2272] T e4a76741587a4b67b1f5cf5a1ae981f7 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.752585 29718 tablet_replica.cc:333] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.753036 29718 raft_consensus.cc:2243] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.753424 29718 raft_consensus.cc:2272] T 3876fed8bcb440a89ae446a6be340322 P ea3586ed938a4ca6a85ad7830c84dc00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.754956 29718 tablet_replica.cc:333] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.755389 29718 raft_consensus.cc:2243] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.755812 29718 raft_consensus.cc:2272] T 763109a82c1545ccaba37ccbe1da2ae0 P ea3586ed938a4ca6a85ad7830c84dc00 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.757325 29718 tablet_replica.cc:333] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00: stopping tablet replica
I20260709 13:13:48.757750 29718 raft_consensus.cc:2243] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.758144 29718 raft_consensus.cc:2272] T 0bbf052624f0413c941b658b4cc4ebfa P ea3586ed938a4ca6a85ad7830c84dc00 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:48.780259 30486 consensus_peers.cc:597] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 -> Peer ea3586ed938a4ca6a85ad7830c84dc00 (127.29.5.130:44627): Couldn't send request to peer ea3586ed938a4ca6a85ad7830c84dc00. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:44627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.785141 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
W20260709 13:13:48.803445 30485 consensus_peers.cc:597] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 -> Peer f587223defdc4836bbe8ba58a69cd40e (127.29.5.129:35433): Couldn't send request to peer f587223defdc4836bbe8ba58a69cd40e. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:35433: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.804450 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
I20260709 13:13:48.828877 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:48.829679 29718 tablet_replica.cc:333] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.830317 29718 raft_consensus.cc:2243] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.830806 29718 raft_consensus.cc:2272] T 447c665260ea458c85f12d3578996f8f P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.832672 29718 tablet_replica.cc:333] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.833201 29718 raft_consensus.cc:2243] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.833633 29718 raft_consensus.cc:2272] T e4a76741587a4b67b1f5cf5a1ae981f7 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.835409 29718 tablet_replica.cc:333] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.835950 29718 raft_consensus.cc:2243] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.836324 29718 raft_consensus.cc:2272] T 4cacab1c1d894d24b8256ce1f349dadd P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.838339 29718 tablet_replica.cc:333] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.838860 29718 raft_consensus.cc:2243] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.839251 29718 raft_consensus.cc:2272] T 0bbf052624f0413c941b658b4cc4ebfa P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.840941 29718 tablet_replica.cc:333] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.841414 29718 raft_consensus.cc:2243] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.842154 29718 raft_consensus.cc:2272] T 3876fed8bcb440a89ae446a6be340322 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.843741 29718 tablet_replica.cc:333] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.844301 29718 raft_consensus.cc:2243] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.844688 29718 raft_consensus.cc:2272] T 763109a82c1545ccaba37ccbe1da2ae0 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.846599 29718 tablet_replica.cc:333] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.847083 29718 raft_consensus.cc:2243] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.847718 29718 raft_consensus.cc:2272] T 609f8541ef3449e69b8f03a565857aa1 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.850133 29718 tablet_replica.cc:333] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.850641 29718 raft_consensus.cc:2243] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.851276 29718 raft_consensus.cc:2272] T 3b0e95e1f0994e8e99ebaac95422ea2d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.853106 29718 tablet_replica.cc:333] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.853497 29718 raft_consensus.cc:2243] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.853827 29718 raft_consensus.cc:2272] T 3fe4f9f19008456a9ec987928c45e766 P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.855193 29718 tablet_replica.cc:333] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285: stopping tablet replica
I20260709 13:13:48.855551 29718 raft_consensus.cc:2243] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.855958 29718 raft_consensus.cc:2272] T 89590aa8fa0b4270ba6f2a1ffad3467d P e4a6e8ab7f6d48d198f3c2e4795d7285 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.883065 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
I20260709 13:13:48.900991 29718 master.cc:562] Master@127.29.5.190:46811 shutting down...
I20260709 13:13:48.920950 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:48.921530 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.921818 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc32bb966c8745c3b97949ab8e0d7a2f: stopping tablet replica
I20260709 13:13:48.943041 29718 master.cc:584] Master@127.29.5.190:46811 shutdown complete.
e4a6e8ab7f6d48d198f3c2e4795d7285  1
ea3586ed938a4ca6a85ad7830c84dc00  4
f587223defdc4836bbe8ba58a69cd40e  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10997 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:13:48.984777 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:37151
I20260709 13:13:48.985919 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:48.991851 30757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:48.992280 30756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:48.992707 30759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:48.994822 29718 server_base.cc:1061] running on GCE node
I20260709 13:13:48.995617 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:48.995850 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:48.995982 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602828995970 us; error 0 us; skew 500 ppm
I20260709 13:13:48.996430 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:48.999001 29718 webserver.cc:533] Webserver started at http://127.29.5.190:37541/ using document root <none> and password file <none>
I20260709 13:13:48.999413 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:48.999559 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:48.999822 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:49.000906 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "9bcfacd34c704ab69ff2de017b2e1fb5"
format_stamp: "Formatted at 2026-07-09 13:13:48 on dist-test-slave-kgkf"
I20260709 13:13:49.005003 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:49.008150 30764 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.008864 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:49.009234 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "9bcfacd34c704ab69ff2de017b2e1fb5"
format_stamp: "Formatted at 2026-07-09 13:13:48 on dist-test-slave-kgkf"
I20260709 13:13:49.009625 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:49.022490 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:49.023741 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:49.062590 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:37151
I20260709 13:13:49.062688 30815 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:37151 every 8 connection(s)
I20260709 13:13:49.066457 30816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.077553 30816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Bootstrap starting.
I20260709 13:13:49.082304 30816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.086604 30816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: No bootstrap required, opened a new log
I20260709 13:13:49.088893 30816 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" member_type: VOTER }
I20260709 13:13:49.089272 30816 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.089545 30816 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bcfacd34c704ab69ff2de017b2e1fb5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.090153 30816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" member_type: VOTER }
I20260709 13:13:49.090615 30816 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:49.090840 30816 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:49.091102 30816 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.095221 30816 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" member_type: VOTER }
I20260709 13:13:49.095767 30816 leader_election.cc:304] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bcfacd34c704ab69ff2de017b2e1fb5; no voters: 
I20260709 13:13:49.096941 30816 leader_election.cc:290] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:49.097249 30819 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.098644 30819 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 1 LEADER]: Becoming Leader. State: Replica: 9bcfacd34c704ab69ff2de017b2e1fb5, State: Running, Role: LEADER
I20260709 13:13:49.099337 30819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" member_type: VOTER }
I20260709 13:13:49.100003 30816 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:49.104080 30821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bcfacd34c704ab69ff2de017b2e1fb5. Latest consensus state: current_term: 1 leader_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" member_type: VOTER } }
I20260709 13:13:49.104604 30821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:49.104873 30820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bcfacd34c704ab69ff2de017b2e1fb5" member_type: VOTER } }
I20260709 13:13:49.105604 30820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:49.111224 30825 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:49.116392 30825 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:49.117434 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:49.125699 30825 catalog_manager.cc:1383] Generated new cluster ID: 1eda7a0b938949ae92eb830b0caa4c59
I20260709 13:13:49.126037 30825 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:49.154634 30825 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:49.156172 30825 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:49.171481 30825 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Generated new TSK 0
I20260709 13:13:49.172148 30825 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:49.183955 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:49.190228 30837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:49.191310 30838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:49.192966 30840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.193516 29718 server_base.cc:1061] running on GCE node
I20260709 13:13:49.194329 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:49.194525 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:49.194701 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602829194683 us; error 0 us; skew 500 ppm
I20260709 13:13:49.195219 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:49.197470 29718 webserver.cc:533] Webserver started at http://127.29.5.129:38279/ using document root <none> and password file <none>
I20260709 13:13:49.197943 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:49.198132 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:49.198423 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:49.199520 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "95b998a6735f4180986a8b8f7d84b8fc"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-kgkf"
I20260709 13:13:49.203958 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:49.207062 30845 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.207899 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:49.208153 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "95b998a6735f4180986a8b8f7d84b8fc"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-kgkf"
I20260709 13:13:49.208403 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:49.232115 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:49.233325 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:49.234804 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:49.237088 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:49.237269 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.237601 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:49.237753 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.281757 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:41351
I20260709 13:13:49.281872 30907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:41351 every 8 connection(s)
I20260709 13:13:49.286742 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:49.293835 30912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:49.294384 30913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.297833 29718 server_base.cc:1061] running on GCE node
W20260709 13:13:49.298152 30915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.299247 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:49.299516 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:49.299718 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602829299693 us; error 0 us; skew 500 ppm
I20260709 13:13:49.300319 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:49.300803 30908 heartbeater.cc:344] Connected to a master server at 127.29.5.190:37151
I20260709 13:13:49.301195 30908 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:49.301997 30908 heartbeater.cc:507] Master 127.29.5.190:37151 requested a full tablet report, sending...
I20260709 13:13:49.303141 29718 webserver.cc:533] Webserver started at http://127.29.5.130:35259/ using document root <none> and password file <none>
I20260709 13:13:49.303658 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:49.303895 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:49.304164 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:49.304181 30781 ts_manager.cc:194] Registered new tserver with Master: 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:13:49.305364 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "bda0856a7efd4d0e96615b66bef383c6"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-kgkf"
I20260709 13:13:49.306063 30781 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54990
I20260709 13:13:49.309881 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:49.313323 30920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.314149 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:49.314538 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "bda0856a7efd4d0e96615b66bef383c6"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-kgkf"
I20260709 13:13:49.314823 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:49.350237 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:49.351490 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:49.352965 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:49.355149 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:49.355384 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.355624 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:49.355816 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.395211 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:46199
I20260709 13:13:49.395340 30982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:46199 every 8 connection(s)
I20260709 13:13:49.400221 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:49.407438 30986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.416774 30983 heartbeater.cc:344] Connected to a master server at 127.29.5.190:37151
W20260709 13:13:49.416891 30987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.417366 30983 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:49.417529 30989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:49.418413 30983 heartbeater.cc:507] Master 127.29.5.190:37151 requested a full tablet report, sending...
I20260709 13:13:49.419605 29718 server_base.cc:1061] running on GCE node
I20260709 13:13:49.420583 30781 ts_manager.cc:194] Registered new tserver with Master: bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:49.420624 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:49.421031 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:49.421267 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602829421179 us; error 0 us; skew 500 ppm
I20260709 13:13:49.421903 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:49.422163 30781 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54998
I20260709 13:13:49.424717 29718 webserver.cc:533] Webserver started at http://127.29.5.131:46185/ using document root <none> and password file <none>
I20260709 13:13:49.425297 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:49.425469 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:49.425668 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:49.426806 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "f535fccbafb14e3f92bd45065da403db"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-kgkf"
I20260709 13:13:49.431321 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:13:49.434684 30994 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.435546 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:49.435987 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "f535fccbafb14e3f92bd45065da403db"
format_stamp: "Formatted at 2026-07-09 13:13:49 on dist-test-slave-kgkf"
I20260709 13:13:49.436299 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:49.457734 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:49.458977 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:49.460513 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:49.462849 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:49.463086 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.463344 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:49.463521 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:49.504972 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:37487
I20260709 13:13:49.505095 31056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:37487 every 8 connection(s)
I20260709 13:13:49.519134 31057 heartbeater.cc:344] Connected to a master server at 127.29.5.190:37151
I20260709 13:13:49.519520 31057 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:49.520262 31057 heartbeater.cc:507] Master 127.29.5.190:37151 requested a full tablet report, sending...
I20260709 13:13:49.522037 30781 ts_manager.cc:194] Registered new tserver with Master: f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:49.523034 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014589571s
I20260709 13:13:49.523350 30781 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55002
I20260709 13:13:49.548617 30781 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55016:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:49.554744 30781 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:49.756026 30948 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe26980d1594c1eb11b68b8a2a07295 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:49.757511 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe26980d1594c1eb11b68b8a2a07295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.763888 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 668bd932e9e04f40b8ccf829b43b99d0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:49.765420 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668bd932e9e04f40b8ccf829b43b99d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.767422 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 668bd932e9e04f40b8ccf829b43b99d0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:49.768769 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668bd932e9e04f40b8ccf829b43b99d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.768962 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe26980d1594c1eb11b68b8a2a07295 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:49.770221 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe26980d1594c1eb11b68b8a2a07295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.772828 30871 tablet_service.cc:1511] Processing CreateTablet for tablet 0ada02d2b3964383bd24a8a7b03c7ceb (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:49.774103 30871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ada02d2b3964383bd24a8a7b03c7ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.776834 30870 tablet_service.cc:1511] Processing CreateTablet for tablet b53c19478dc740149d296778042dd3a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:49.778126 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53c19478dc740149d296778042dd3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.780918 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 9a98a12e85a64722a1c7f956eb64734e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:49.782214 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a98a12e85a64722a1c7f956eb64734e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.784914 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 6bc558c3b0eb4c249f836374861bb23c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:49.784968 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 0ada02d2b3964383bd24a8a7b03c7ceb (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:49.786329 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc558c3b0eb4c249f836374861bb23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.786803 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ada02d2b3964383bd24a8a7b03c7ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.797905 30945 tablet_service.cc:1511] Processing CreateTablet for tablet b53c19478dc740149d296778042dd3a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:49.799397 30945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53c19478dc740149d296778042dd3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.811738 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 92cbaf1d3603474f977498657c46f628 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:49.813143 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cbaf1d3603474f977498657c46f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.815047 30864 tablet_service.cc:1511] Processing CreateTablet for tablet ecebd472a2fc4b768869e3daa594c692 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:49.816452 30864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecebd472a2fc4b768869e3daa594c692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.816975 30866 tablet_service.cc:1511] Processing CreateTablet for tablet a248ff3a5e13493783eef6f7b80fb0ea (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:49.820902 30944 tablet_service.cc:1511] Processing CreateTablet for tablet 9a98a12e85a64722a1c7f956eb64734e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:49.821684 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a248ff3a5e13493783eef6f7b80fb0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.822235 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a98a12e85a64722a1c7f956eb64734e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.820902 30865 tablet_service.cc:1511] Processing CreateTablet for tablet b8e3faee40af435fab9e73535ef9df52 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:49.825215 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3faee40af435fab9e73535ef9df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.834686 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 92cbaf1d3603474f977498657c46f628 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:49.837212 30941 tablet_service.cc:1511] Processing CreateTablet for tablet a248ff3a5e13493783eef6f7b80fb0ea (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:49.813176 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 41ab89a799c64088901472d6633cfb83 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:49.839710 30940 tablet_service.cc:1511] Processing CreateTablet for tablet b8e3faee40af435fab9e73535ef9df52 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:49.844419 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 6bc558c3b0eb4c249f836374861bb23c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:49.841361 30939 tablet_service.cc:1511] Processing CreateTablet for tablet ecebd472a2fc4b768869e3daa594c692 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:49.850716 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a248ff3a5e13493783eef6f7b80fb0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.840998 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ab89a799c64088901472d6633cfb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.856262 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cbaf1d3603474f977498657c46f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.859819 31022 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe26980d1594c1eb11b68b8a2a07295 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:49.860198 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc558c3b0eb4c249f836374861bb23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.861234 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe26980d1594c1eb11b68b8a2a07295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.861898 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3faee40af435fab9e73535ef9df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.864187 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecebd472a2fc4b768869e3daa594c692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.869561 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 668bd932e9e04f40b8ccf829b43b99d0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:49.870956 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668bd932e9e04f40b8ccf829b43b99d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.878916 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 0ada02d2b3964383bd24a8a7b03c7ceb (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:49.880825 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ada02d2b3964383bd24a8a7b03c7ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.889374 31019 tablet_service.cc:1511] Processing CreateTablet for tablet b53c19478dc740149d296778042dd3a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:49.889724 31018 tablet_service.cc:1511] Processing CreateTablet for tablet 9a98a12e85a64722a1c7f956eb64734e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:49.892228 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53c19478dc740149d296778042dd3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.893987 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 6bc558c3b0eb4c249f836374861bb23c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:49.894560 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a98a12e85a64722a1c7f956eb64734e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.896113 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc558c3b0eb4c249f836374861bb23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.896906 31072 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:49.897516 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 23d60dde9ca04c6d8ed4b863efa56b5c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:49.898804 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d60dde9ca04c6d8ed4b863efa56b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.901667 31016 tablet_service.cc:1511] Processing CreateTablet for tablet 92cbaf1d3603474f977498657c46f628 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:49.903017 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cbaf1d3603474f977498657c46f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.906385 31015 tablet_service.cc:1511] Processing CreateTablet for tablet a248ff3a5e13493783eef6f7b80fb0ea (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:49.912240 31073 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:49.912845 31014 tablet_service.cc:1511] Processing CreateTablet for tablet b8e3faee40af435fab9e73535ef9df52 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:49.917853 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a248ff3a5e13493783eef6f7b80fb0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.923313 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3faee40af435fab9e73535ef9df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.928447 31013 tablet_service.cc:1511] Processing CreateTablet for tablet ecebd472a2fc4b768869e3daa594c692 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:49.916074 30948 tablet_service.cc:1511] Processing CreateTablet for tablet 41ab89a799c64088901472d6633cfb83 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:49.933105 31013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecebd472a2fc4b768869e3daa594c692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.933403 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ab89a799c64088901472d6633cfb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.941936 31072 tablet_bootstrap.cc:654] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.944777 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 23d60dde9ca04c6d8ed4b863efa56b5c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:49.945247 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 9f210916a06449d99b2c71170e4d3d68 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:49.946162 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d60dde9ca04c6d8ed4b863efa56b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.946973 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f210916a06449d99b2c71170e4d3d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.956470 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 9f210916a06449d99b2c71170e4d3d68 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:49.958540 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f210916a06449d99b2c71170e4d3d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.957235 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce19c3ff1834bd091f05b950c3df1e1 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:49.962038 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce19c3ff1834bd091f05b950c3df1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.990585 31074 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:49.990449 30865 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce19c3ff1834bd091f05b950c3df1e1 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:49.990978 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 23d60dde9ca04c6d8ed4b863efa56b5c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:49.990981 31013 tablet_service.cc:1511] Processing CreateTablet for tablet 41ab89a799c64088901472d6633cfb83 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:49.992185 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce19c3ff1834bd091f05b950c3df1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.993506 30872 tablet_service.cc:1511] Processing CreateTablet for tablet fe74086270b4498abc8ede59e5e23f3a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:49.994745 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe74086270b4498abc8ede59e5e23f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.992286 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d60dde9ca04c6d8ed4b863efa56b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.002313 31013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ab89a799c64088901472d6633cfb83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.004256 30866 tablet_service.cc:1511] Processing CreateTablet for tablet 57205f89b2ab4d2c8a699a5178d20da0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:50.005570 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57205f89b2ab4d2c8a699a5178d20da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.014127 31073 tablet_bootstrap.cc:654] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.010515 30941 tablet_service.cc:1511] Processing CreateTablet for tablet fe74086270b4498abc8ede59e5e23f3a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:50.017387 30945 tablet_service.cc:1511] Processing CreateTablet for tablet 57205f89b2ab4d2c8a699a5178d20da0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:50.028399 31074 tablet_bootstrap.cc:654] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.013060 31022 tablet_service.cc:1511] Processing CreateTablet for tablet 57205f89b2ab4d2c8a699a5178d20da0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:50.037963 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe74086270b4498abc8ede59e5e23f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.038792 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57205f89b2ab4d2c8a699a5178d20da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.039357 30871 tablet_service.cc:1511] Processing CreateTablet for tablet 7d317b7eabb7461fb2fd34c7ccc257b2 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:50.047065 30945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57205f89b2ab4d2c8a699a5178d20da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.047680 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9907b959044453b57011278bbecdff (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:50.049067 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9907b959044453b57011278bbecdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.050057 31072 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:50.056505 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce19c3ff1834bd091f05b950c3df1e1 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:50.056766 30948 tablet_service.cc:1511] Processing CreateTablet for tablet adb189bd941147e0924cc38c9f01bd11 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:50.057816 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce19c3ff1834bd091f05b950c3df1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.058004 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb189bd941147e0924cc38c9f01bd11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.059494 30864 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9907b959044453b57011278bbecdff (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:50.060737 30864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9907b959044453b57011278bbecdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.068110 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 5924d1603d2049ddae792a7d77c50cf2 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:50.017239 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 5924d1603d2049ddae792a7d77c50cf2 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:50.069410 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5924d1603d2049ddae792a7d77c50cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.069612 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5924d1603d2049ddae792a7d77c50cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.069496 31015 tablet_service.cc:1511] Processing CreateTablet for tablet 9f210916a06449d99b2c71170e4d3d68 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:50.070741 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f210916a06449d99b2c71170e4d3d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.072579 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 7d317b7eabb7461fb2fd34c7ccc257b2 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:50.073802 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d317b7eabb7461fb2fd34c7ccc257b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.073796 31017 tablet_service.cc:1511] Processing CreateTablet for tablet fe74086270b4498abc8ede59e5e23f3a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:50.075129 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe74086270b4498abc8ede59e5e23f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.081885 30946 tablet_service.cc:1511] Processing CreateTablet for tablet cb2fb5af0cc748fc9f94576b72a2157d (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:50.082440 31074 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:50.082903 31074 ts_tablet_manager.cc:1403] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.005s
I20260709 13:13:50.083182 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2fb5af0cc748fc9f94576b72a2157d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.092370 31017 tablet_service.cc:1511] Processing CreateTablet for tablet adb189bd941147e0924cc38c9f01bd11 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:50.092821 31019 tablet_service.cc:1511] Processing CreateTablet for tablet 7d317b7eabb7461fb2fd34c7ccc257b2 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:50.093724 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb189bd941147e0924cc38c9f01bd11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.095920 30939 tablet_service.cc:1511] Processing CreateTablet for tablet 6167067c2f0e477d90c7f8d4171022d3 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:50.096016 31074 raft_consensus.cc:359] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.096748 31074 raft_consensus.cc:385] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.097061 31074 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.097211 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6167067c2f0e477d90c7f8d4171022d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.138038 31013 tablet_service.cc:1511] Processing CreateTablet for tablet 154fc3698684427dab2fe05492989f2e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:50.142521 30943 tablet_service.cc:1511] Processing CreateTablet for tablet d72ea41cd9114780855924982fc9b2a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:50.143941 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ea41cd9114780855924982fc9b2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.148980 31022 tablet_service.cc:1511] Processing CreateTablet for tablet 305d528ec3044fc288a8d49789c8d2ab (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:50.149830 31073 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:50.150316 31073 ts_tablet_manager.cc:1403] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.238s	user 0.009s	sys 0.004s
I20260709 13:13:50.152045 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 154fc3698684427dab2fe05492989f2e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:50.157564 31014 tablet_service.cc:1511] Processing CreateTablet for tablet 7378a710ae3644c686285da393d03ae1 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:50.158097 31073 raft_consensus.cc:359] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.159008 31073 raft_consensus.cc:385] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.159320 31073 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.128048 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d317b7eabb7461fb2fd34c7ccc257b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.160516 31013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154fc3698684427dab2fe05492989f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.102392 30944 tablet_service.cc:1511] Processing CreateTablet for tablet 154fc3698684427dab2fe05492989f2e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:50.161576 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154fc3698684427dab2fe05492989f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.161733 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305d528ec3044fc288a8d49789c8d2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.105805 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 6167067c2f0e477d90c7f8d4171022d3 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:50.110616 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 2c9907b959044453b57011278bbecdff (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 13:13:50.110982 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:50.112349 30940 tablet_service.cc:1511] Processing CreateTablet for tablet 7378a710ae3644c686285da393d03ae1 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:50.113827 30871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d317b7eabb7461fb2fd34c7ccc257b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.165091 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9907b959044453b57011278bbecdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.165337 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7378a710ae3644c686285da393d03ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.166242 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154fc3698684427dab2fe05492989f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.127208 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 305d528ec3044fc288a8d49789c8d2ab (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:50.168051 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6167067c2f0e477d90c7f8d4171022d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.168355 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305d528ec3044fc288a8d49789c8d2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.115710 30870 tablet_service.cc:1511] Processing CreateTablet for tablet cb2fb5af0cc748fc9f94576b72a2157d (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:50.172518 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2fb5af0cc748fc9f94576b72a2157d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.115947 31072 ts_tablet_manager.cc:1403] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.000s
I20260709 13:13:50.178623 31072 raft_consensus.cc:359] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.179358 31072 raft_consensus.cc:385] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.133232 31074 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.133930 31018 tablet_service.cc:1511] Processing CreateTablet for tablet cb2fb5af0cc748fc9f94576b72a2157d (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:50.181049 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2fb5af0cc748fc9f94576b72a2157d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.134549 30869 tablet_service.cc:1511] Processing CreateTablet for tablet adb189bd941147e0924cc38c9f01bd11 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:50.182932 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb189bd941147e0924cc38c9f01bd11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.183451 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7378a710ae3644c686285da393d03ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.182518 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 076984be4730440fba459e1d130954f5 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:50.189512 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076984be4730440fba459e1d130954f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.101835 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 5924d1603d2049ddae792a7d77c50cf2 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:50.179657 31072 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.192605 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5924d1603d2049ddae792a7d77c50cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.160055 31073 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.198884 30866 tablet_service.cc:1511] Processing CreateTablet for tablet 7378a710ae3644c686285da393d03ae1 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:50.200366 31072 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.202769 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 305d528ec3044fc288a8d49789c8d2ab (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:50.122505 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 6167067c2f0e477d90c7f8d4171022d3 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:50.204357 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6167067c2f0e477d90c7f8d4171022d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.207044 31016 tablet_service.cc:1511] Processing CreateTablet for tablet d72ea41cd9114780855924982fc9b2a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:50.210918 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ea41cd9114780855924982fc9b2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.211629 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7378a710ae3644c686285da393d03ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.239362 31072 ts_tablet_manager.cc:1434] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.009s
I20260709 13:13:50.238982 30865 tablet_service.cc:1511] Processing CreateTablet for tablet d72ea41cd9114780855924982fc9b2a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:50.240124 30983 heartbeater.cc:499] Master 127.29.5.190:37151 was elected leader, sending a full tablet report...
I20260709 13:13:50.247068 31072 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:50.248183 30908 heartbeater.cc:499] Master 127.29.5.190:37151 was elected leader, sending a full tablet report...
I20260709 13:13:50.233196 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305d528ec3044fc288a8d49789c8d2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.264181 31074 ts_tablet_manager.cc:1434] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.181s	user 0.018s	sys 0.003s
I20260709 13:13:50.276314 31072 tablet_bootstrap.cc:654] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.286917 31073 ts_tablet_manager.cc:1434] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.136s	user 0.013s	sys 0.003s
I20260709 13:13:50.300740 31073 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:50.270272 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ea41cd9114780855924982fc9b2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.303377 31057 heartbeater.cc:499] Master 127.29.5.190:37151 was elected leader, sending a full tablet report...
I20260709 13:13:50.308246 31015 tablet_service.cc:1511] Processing CreateTablet for tablet 076984be4730440fba459e1d130954f5 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:50.309736 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076984be4730440fba459e1d130954f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.321947 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 0daef7b4af5348a298c365152f0bea47 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:50.324080 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daef7b4af5348a298c365152f0bea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.321893 31074 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:50.327633 30939 tablet_service.cc:1511] Processing CreateTablet for tablet 0daef7b4af5348a298c365152f0bea47 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:50.329641 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daef7b4af5348a298c365152f0bea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.331954 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 076984be4730440fba459e1d130954f5 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:50.333199 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 076984be4730440fba459e1d130954f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.345381 31074 tablet_bootstrap.cc:654] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.347275 31014 tablet_service.cc:1511] Processing CreateTablet for tablet 0daef7b4af5348a298c365152f0bea47 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:50.349745 31073 tablet_bootstrap.cc:654] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.353751 30868 tablet_service.cc:1511] Processing CreateTablet for tablet c9e26088d2e34c8f8fa1005abb24a48e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:50.355077 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e26088d2e34c8f8fa1005abb24a48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.355587 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daef7b4af5348a298c365152f0bea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.361349 31072 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:50.361848 31072 ts_tablet_manager.cc:1403] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.009s
I20260709 13:13:50.362939 30947 tablet_service.cc:1511] Processing CreateTablet for tablet c9e26088d2e34c8f8fa1005abb24a48e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:50.364702 31072 raft_consensus.cc:359] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.365433 31072 raft_consensus.cc:385] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.365720 31072 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.366046 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e26088d2e34c8f8fa1005abb24a48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.366592 31072 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.367089 31016 tablet_service.cc:1511] Processing CreateTablet for tablet c9e26088d2e34c8f8fa1005abb24a48e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:50.368456 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e26088d2e34c8f8fa1005abb24a48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.368743 31072 ts_tablet_manager.cc:1434] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:13:50.369673 31072 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:50.376273 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 0407b8cc64ba44db9159961c6f9cd76b (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:50.377671 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0407b8cc64ba44db9159961c6f9cd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.383137 31018 tablet_service.cc:1511] Processing CreateTablet for tablet 0407b8cc64ba44db9159961c6f9cd76b (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:50.384192 31072 tablet_bootstrap.cc:654] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.384549 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0407b8cc64ba44db9159961c6f9cd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.385730 31073 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:50.386245 31073 ts_tablet_manager.cc:1403] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.004s
I20260709 13:13:50.375279 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 0407b8cc64ba44db9159961c6f9cd76b (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:50.389159 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0407b8cc64ba44db9159961c6f9cd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.392561 30866 tablet_service.cc:1511] Processing CreateTablet for tablet d310a2b2db8c4c22a71ff675ed506d7e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:50.395744 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d310a2b2db8c4c22a71ff675ed506d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.389178 31073 raft_consensus.cc:359] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.404951 30939 tablet_service.cc:1511] Processing CreateTablet for tablet d310a2b2db8c4c22a71ff675ed506d7e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:50.406433 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d310a2b2db8c4c22a71ff675ed506d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.409480 31073 raft_consensus.cc:385] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.409986 31073 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.410432 31022 tablet_service.cc:1511] Processing CreateTablet for tablet d310a2b2db8c4c22a71ff675ed506d7e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:50.411742 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d310a2b2db8c4c22a71ff675ed506d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.416193 31073 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.420094 31073 ts_tablet_manager.cc:1434] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.034s	user 0.001s	sys 0.008s
I20260709 13:13:50.421145 31073 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:50.422362 31078 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.422861 31078 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.439653 31074 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:50.440254 31074 ts_tablet_manager.cc:1403] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.006s
I20260709 13:13:50.442622 31074 raft_consensus.cc:359] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.457501 31073 tablet_bootstrap.cc:654] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.458130 31072 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:50.457928 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 26cbe63a7a21474a881ca2ae72df9719 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:50.458773 31072 ts_tablet_manager.cc:1403] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.019s
I20260709 13:13:50.459450 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cbe63a7a21474a881ca2ae72df9719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.436273 31078 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:50.443234 31074 raft_consensus.cc:385] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.468031 31074 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.473839 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 26cbe63a7a21474a881ca2ae72df9719 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:50.475302 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cbe63a7a21474a881ca2ae72df9719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.477278 31074 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.470757 31072 raft_consensus.cc:359] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.488831 31072 raft_consensus.cc:385] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.489151 31072 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.491808 31072 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.494025 31072 ts_tablet_manager.cc:1434] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:13:50.495014 31072 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:50.497459 30947 tablet_service.cc:1511] Processing CreateTablet for tablet d95504ff00154bdf99a5de1ad11f4f58 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:50.497637 30873 tablet_service.cc:1511] Processing CreateTablet for tablet d95504ff00154bdf99a5de1ad11f4f58 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:50.498922 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95504ff00154bdf99a5de1ad11f4f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.499080 31018 tablet_service.cc:1511] Processing CreateTablet for tablet d95504ff00154bdf99a5de1ad11f4f58 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:50.500360 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95504ff00154bdf99a5de1ad11f4f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.504288 31074 ts_tablet_manager.cc:1434] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 13:13:50.505270 31074 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:50.507970 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:50.511305 30868 tablet_service.cc:1511] Processing CreateTablet for tablet ee5193a8eea94bdd87b6db99fc59a40e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:50.512615 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5193a8eea94bdd87b6db99fc59a40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.498929 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95504ff00154bdf99a5de1ad11f4f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.512219 31022 tablet_service.cc:1511] Processing CreateTablet for tablet 26cbe63a7a21474a881ca2ae72df9719 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:50.514716 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cbe63a7a21474a881ca2ae72df9719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.517411 31073 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:50.526762 31073 ts_tablet_manager.cc:1403] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.017s
I20260709 13:13:50.518606 30948 tablet_service.cc:1511] Processing CreateTablet for tablet ee5193a8eea94bdd87b6db99fc59a40e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:50.528558 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5193a8eea94bdd87b6db99fc59a40e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:50.520109 30998 leader_election.cc:343] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.534442 31074 tablet_bootstrap.cc:654] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.535030 31073 raft_consensus.cc:359] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.535547 31073 raft_consensus.cc:385] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.535738 31073 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.536733 31073 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.539242 31073 ts_tablet_manager.cc:1434] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:13:50.542866 31072 tablet_bootstrap.cc:654] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.553387 31073 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:50.560024 31016 tablet_service.cc:1511] Processing CreateTablet for tablet ee5193a8eea94bdd87b6db99fc59a40e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:50.561405 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5193a8eea94bdd87b6db99fc59a40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.562263 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 1293e489425441668ab2722e4649ca3f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:50.563508 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1293e489425441668ab2722e4649ca3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.566135 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 1293e489425441668ab2722e4649ca3f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:50.566505 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:50.568184 30958 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:50.568780 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1293e489425441668ab2722e4649ca3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.569473 30997 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:50.570633 31078 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.570967 31079 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.570998 31078 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.571457 31079 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.572089 31078 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.574512 31079 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:50.576893 31014 tablet_service.cc:1511] Processing CreateTablet for tablet 1293e489425441668ab2722e4649ca3f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:50.578692 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1293e489425441668ab2722e4649ca3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.579129 30866 tablet_service.cc:1511] Processing CreateTablet for tablet 43a26907cc3847ef873d80998378ce0a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:50.580375 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a26907cc3847ef873d80998378ce0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.588053 30948 tablet_service.cc:1511] Processing CreateTablet for tablet 43a26907cc3847ef873d80998378ce0a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:50.589808 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a26907cc3847ef873d80998378ce0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.589573 31078 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.592825 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:13:50.594789 30998 leader_election.cc:343] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.602831 31073 tablet_bootstrap.cc:654] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.602742 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 43a26907cc3847ef873d80998378ce0a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:50.604084 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a26907cc3847ef873d80998378ce0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.607328 31078 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:50.607565 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:50.608166 30958 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.611464 30872 tablet_service.cc:1511] Processing CreateTablet for tablet f167b704a74542d08476d7ce70c368d0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:50.613281 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f167b704a74542d08476d7ce70c368d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.617009 30947 tablet_service.cc:1511] Processing CreateTablet for tablet f167b704a74542d08476d7ce70c368d0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:50.619024 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f167b704a74542d08476d7ce70c368d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.631464 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:50.632838 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.634984 30958 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:50.634737 30865 tablet_service.cc:1511] Processing CreateTablet for tablet e61719587d824d0680b05c15592027a3 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:50.636022 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61719587d824d0680b05c15592027a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.637192 31016 tablet_service.cc:1511] Processing CreateTablet for tablet f167b704a74542d08476d7ce70c368d0 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:50.638237 30939 tablet_service.cc:1511] Processing CreateTablet for tablet e61719587d824d0680b05c15592027a3 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:50.639428 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61719587d824d0680b05c15592027a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.640736 31018 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:50.641446 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:50.641948 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.646153 30997 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:50.648022 31015 tablet_service.cc:1511] Processing CreateTablet for tablet e61719587d824d0680b05c15592027a3 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:50.652099 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9efafd3545426e86d2b3a0961f36cd (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:50.656081 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.656391 31078 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.667572 31080 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.668110 31080 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.670631 30941 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9efafd3545426e86d2b3a0961f36cd (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:50.673769 31079 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.679829 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 3909ef5ede2e43f1872fec585566b998 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:50.680195 31079 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.682293 31079 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:50.674417 31080 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:13:50.675352 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61719587d824d0680b05c15592027a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.683440 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 3909ef5ede2e43f1872fec585566b998 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:50.702428 31072 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:50.703235 31072 ts_tablet_manager.cc:1403] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.208s	user 0.025s	sys 0.024s
I20260709 13:13:50.695984 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9efafd3545426e86d2b3a0961f36cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.711422 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3909ef5ede2e43f1872fec585566b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.711374 30871 tablet_service.cc:1511] Processing CreateTablet for tablet 50513ab15e104c00b0e439d104e5e2a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:50.717133 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9efafd3545426e86d2b3a0961f36cd (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:50.696271 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9efafd3545426e86d2b3a0961f36cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.721405 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f167b704a74542d08476d7ce70c368d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.725425 31079 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.726011 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 3909ef5ede2e43f1872fec585566b998 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:50.742025 31079 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.742659 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3909ef5ede2e43f1872fec585566b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.729604 31073 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:50.731727 30948 tablet_service.cc:1511] Processing CreateTablet for tablet 50513ab15e104c00b0e439d104e5e2a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:50.740065 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 03793cde81754b27ba1c03bc763faac4 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:50.740837 30864 tablet_service.cc:1511] Processing CreateTablet for tablet bca3b2e6549e45b7bced35922035bc4e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:50.698374 31078 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:50.747143 31073 ts_tablet_manager.cc:1403] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.026s
I20260709 13:13:50.754513 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50513ab15e104c00b0e439d104e5e2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.754942 31079 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:50.749997 30871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50513ab15e104c00b0e439d104e5e2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.760951 31022 tablet_service.cc:1511] Processing CreateTablet for tablet 50513ab15e104c00b0e439d104e5e2a8 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:50.761644 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3909ef5ede2e43f1872fec585566b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.763502 31096 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.764091 31096 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.773631 31096 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:13:50.773636 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03793cde81754b27ba1c03bc763faac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.775843 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 3b00f9d4e8d04efbaf4620845ca672d7 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:50.777107 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b00f9d4e8d04efbaf4620845ca672d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.780174 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:50.780853 30883 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:50.782078 30998 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:50.782964 31096 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.783439 31096 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.783806 31096 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.784135 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:50.785851 30883 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:50.787673 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:50.788748 31080 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.789180 31080 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.789608 31080 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.751502 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9efafd3545426e86d2b3a0961f36cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.792348 31019 tablet_service.cc:1511] Processing CreateTablet for tablet 03793cde81754b27ba1c03bc763faac4 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:50.793711 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03793cde81754b27ba1c03bc763faac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.794008 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 03793cde81754b27ba1c03bc763faac4 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:50.796849 31017 tablet_service.cc:1511] Processing CreateTablet for tablet bca3b2e6549e45b7bced35922035bc4e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:50.797153 30944 tablet_service.cc:1511] Processing CreateTablet for tablet 3b00f9d4e8d04efbaf4620845ca672d7 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:50.798132 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca3b2e6549e45b7bced35922035bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.795642 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03793cde81754b27ba1c03bc763faac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.800076 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50513ab15e104c00b0e439d104e5e2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.802568 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b00f9d4e8d04efbaf4620845ca672d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.806546 30864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca3b2e6549e45b7bced35922035bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.807695 30865 tablet_service.cc:1511] Processing CreateTablet for tablet ef66bbb42e064e8da439f811c09eb47c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:50.809031 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66bbb42e064e8da439f811c09eb47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.812772 31013 tablet_service.cc:1511] Processing CreateTablet for tablet 3b00f9d4e8d04efbaf4620845ca672d7 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:50.814082 31013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b00f9d4e8d04efbaf4620845ca672d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.815472 30941 tablet_service.cc:1511] Processing CreateTablet for tablet bca3b2e6549e45b7bced35922035bc4e (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:50.816851 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca3b2e6549e45b7bced35922035bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.821846 31074 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:50.822324 31074 ts_tablet_manager.cc:1403] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.317s	user 0.029s	sys 0.021s
I20260709 13:13:50.822237 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:50.822817 31078 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.823375 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:50.824816 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:50.825089 31080 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.827030 30958 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:50.829632 31074 raft_consensus.cc:359] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.830427 31074 raft_consensus.cc:385] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.830760 31074 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.771338 31073 raft_consensus.cc:359] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.832113 31074 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.832803 31073 raft_consensus.cc:385] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.833143 31073 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
W20260709 13:13:50.844839 30848 leader_election.cc:343] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.844475 31073 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:50.845669 30848 leader_election.cc:343] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.846982 30945 tablet_service.cc:1511] Processing CreateTablet for tablet ef66bbb42e064e8da439f811c09eb47c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:50.847393 31100 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.848364 30945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66bbb42e064e8da439f811c09eb47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.848448 31100 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.857080 31014 tablet_service.cc:1511] Processing CreateTablet for tablet ef66bbb42e064e8da439f811c09eb47c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:50.858237 30870 tablet_service.cc:1511] Processing CreateTablet for tablet c01eed2523a3452fbe85af4db99a20bf (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:50.859161 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66bbb42e064e8da439f811c09eb47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.859579 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01eed2523a3452fbe85af4db99a20bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.862385 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:50.863647 31073 ts_tablet_manager.cc:1434] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.001s
I20260709 13:13:50.866283 31072 raft_consensus.cc:359] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.878978 30940 tablet_service.cc:1511] Processing CreateTablet for tablet c01eed2523a3452fbe85af4db99a20bf (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:50.882014 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01eed2523a3452fbe85af4db99a20bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.884037 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:50.885421 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:50.883289 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:50.888094 30848 leader_election.cc:343] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.888532 30848 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:50.889297 31079 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:50.889675 30848 leader_election.cc:343] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.890115 30848 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:50.890971 31079 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.891259 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:50.873592 31072 raft_consensus.cc:385] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.894045 31072 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.895279 31072 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.900902 31079 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.902088 31074 ts_tablet_manager.cc:1434] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.003s
I20260709 13:13:50.904166 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:50.904943 30958 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:50.911469 31104 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.916105 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:50.924964 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 93599b7a5b2c4798aaa9425aa5ecc686 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:50.926306 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93599b7a5b2c4798aaa9425aa5ecc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.918807 30781 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.928956 31073 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:50.943017 31015 tablet_service.cc:1511] Processing CreateTablet for tablet c01eed2523a3452fbe85af4db99a20bf (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:50.938418 31079 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.923677 31096 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:50.981700 31032 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:50.956944 31100 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:50.958209 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 93599b7a5b2c4798aaa9425aa5ecc686 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:50.983227 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93599b7a5b2c4798aaa9425aa5ecc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.985250 31096 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:13:50.986326 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:50.987078 30958 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:50.944783 31080 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:13:50.960368 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:50.965600 31073 tablet_bootstrap.cc:654] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.988637 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 93599b7a5b2c4798aaa9425aa5ecc686 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:13:50.994356 30923 leader_election.cc:343] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.967908 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01eed2523a3452fbe85af4db99a20bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:50.968286 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:51.000070 31079 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.000754 31079 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:50.969141 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:51.004433 30924 leader_election.cc:343] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.005034 30924 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.006062 31080 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.979698 31074 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.021018 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.022486 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93599b7a5b2c4798aaa9425aa5ecc686. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:51.026986 30848 leader_election.cc:343] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.027516 31079 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.028918 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:51.030324 30848 leader_election.cc:343] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.030741 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.031800 31079 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.936226 31104 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.053509 30946 tablet_service.cc:1511] Processing CreateTablet for tablet db4763729fc346458245f7d6bca89a8c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:51.056496 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4763729fc346458245f7d6bca89a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.068315 31074 tablet_bootstrap.cc:654] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.070700 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 7959c8f3c783472ab0e42eac55ff018a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:51.072077 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7959c8f3c783472ab0e42eac55ff018a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.071630 30941 tablet_service.cc:1511] Processing CreateTablet for tablet 7959c8f3c783472ab0e42eac55ff018a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:51.073375 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7959c8f3c783472ab0e42eac55ff018a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.073668 30939 tablet_service.cc:1511] Processing CreateTablet for tablet fea166084ed848e08ef7f36b2a4b4e5f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:51.074965 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea166084ed848e08ef7f36b2a4b4e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.054649 31022 tablet_service.cc:1511] Processing CreateTablet for tablet db4763729fc346458245f7d6bca89a8c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:51.077072 31022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4763729fc346458245f7d6bca89a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.079952 30948 tablet_service.cc:1511] Processing CreateTablet for tablet fdbb6fa9a0f3410e860b9d01eb25293d (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:51.081315 30948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbb6fa9a0f3410e860b9d01eb25293d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.070700 31018 tablet_service.cc:1511] Processing CreateTablet for tablet fdbb6fa9a0f3410e860b9d01eb25293d (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:51.085150 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbb6fa9a0f3410e860b9d01eb25293d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.087459 31104 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.088538 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:51.089233 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:51.090014 30923 leader_election.cc:343] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:51.090590 30924 leader_election.cc:343] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.091004 30924 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.096478 31072 ts_tablet_manager.cc:1434] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.393s	user 0.009s	sys 0.008s
I20260709 13:13:51.097901 31072 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.097792 31020 tablet_service.cc:1511] Processing CreateTablet for tablet fea166084ed848e08ef7f36b2a4b4e5f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:51.099092 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea166084ed848e08ef7f36b2a4b4e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.101328 31015 tablet_service.cc:1511] Processing CreateTablet for tablet 7c96de632da240f8a659ee13a19ef435 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:51.102769 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c96de632da240f8a659ee13a19ef435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.110261 31104 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.118112 30944 tablet_service.cc:1511] Processing CreateTablet for tablet bced1836a1cd4749bcd4db4d53decc9a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:51.119711 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bced1836a1cd4749bcd4db4d53decc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.128885 31019 tablet_service.cc:1511] Processing CreateTablet for tablet bced1836a1cd4749bcd4db4d53decc9a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:51.130821 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bced1836a1cd4749bcd4db4d53decc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.064873 30883 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:51.138284 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.138612 30940 tablet_service.cc:1511] Processing CreateTablet for tablet 7c96de632da240f8a659ee13a19ef435 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:51.139700 31104 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.140043 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c96de632da240f8a659ee13a19ef435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.140524 31104 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:51.140442 30943 tablet_service.cc:1511] Processing CreateTablet for tablet bd89ff847a344f8a8ef89d9556b85846 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:51.141786 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd89ff847a344f8a8ef89d9556b85846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.141476 31104 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:13:51.146057 31073 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.146530 31073 ts_tablet_manager.cc:1403] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.024s
I20260709 13:13:51.154650 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 7959c8f3c783472ab0e42eac55ff018a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:51.156075 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7959c8f3c783472ab0e42eac55ff018a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.176424 30873 tablet_service.cc:1511] Processing CreateTablet for tablet 7c96de632da240f8a659ee13a19ef435 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:51.177783 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c96de632da240f8a659ee13a19ef435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.172260 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:51.185490 31015 tablet_service.cc:1511] Processing CreateTablet for tablet bd89ff847a344f8a8ef89d9556b85846 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:51.187124 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd89ff847a344f8a8ef89d9556b85846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.192639 30867 tablet_service.cc:1511] Processing CreateTablet for tablet db4763729fc346458245f7d6bca89a8c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:13:51.193568 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:51.193915 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4763729fc346458245f7d6bca89a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.194417 30883 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:51.249459 30873 tablet_service.cc:1511] Processing CreateTablet for tablet fdbb6fa9a0f3410e860b9d01eb25293d (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:51.250789 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbb6fa9a0f3410e860b9d01eb25293d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.250885 30946 tablet_service.cc:1511] Processing CreateTablet for tablet fa9513cbd3af40a4a69f7a596298664c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:51.252315 31072 tablet_bootstrap.cc:654] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.262888 31073 raft_consensus.cc:359] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.272819 30945 tablet_service.cc:1511] Processing CreateTablet for tablet b1c88e7048de4bf6844c6d2a437a128f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:51.273699 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9513cbd3af40a4a69f7a596298664c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.276855 30945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c88e7048de4bf6844c6d2a437a128f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.283893 31017 tablet_service.cc:1511] Processing CreateTablet for tablet fa9513cbd3af40a4a69f7a596298664c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:51.285038 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9513cbd3af40a4a69f7a596298664c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.297382 31096 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.271178 31073 raft_consensus.cc:385] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.301291 31073 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.301873 31096 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.292184 31014 tablet_service.cc:1511] Processing CreateTablet for tablet b1c88e7048de4bf6844c6d2a437a128f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:51.302984 31073 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.303756 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c88e7048de4bf6844c6d2a437a128f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.306779 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.307582 31073 ts_tablet_manager.cc:1434] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.161s	user 0.017s	sys 0.004s
W20260709 13:13:51.308403 30997 leader_election.cc:343] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.308652 31073 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.309399 31096 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:51.312577 30873 tablet_service.cc:1511] Processing CreateTablet for tablet fea166084ed848e08ef7f36b2a4b4e5f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:51.317693 30870 tablet_service.cc:1511] Processing CreateTablet for tablet bd89ff847a344f8a8ef89d9556b85846 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:51.322007 30864 tablet_service.cc:1511] Processing CreateTablet for tablet fa9513cbd3af40a4a69f7a596298664c (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:51.317884 30780 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.322480 30944 tablet_service.cc:1511] Processing CreateTablet for tablet fd69fc9d45f54c7d900248ad54571d11 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:51.322769 30871 tablet_service.cc:1511] Processing CreateTablet for tablet b1c88e7048de4bf6844c6d2a437a128f (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:51.324573 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd69fc9d45f54c7d900248ad54571d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.324738 30866 tablet_service.cc:1511] Processing CreateTablet for tablet fd69fc9d45f54c7d900248ad54571d11 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:51.325361 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd89ff847a344f8a8ef89d9556b85846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.329397 30998 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:51.330438 30865 tablet_service.cc:1511] Processing CreateTablet for tablet bced1836a1cd4749bcd4db4d53decc9a (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:51.331818 31018 tablet_service.cc:1511] Processing CreateTablet for tablet fd69fc9d45f54c7d900248ad54571d11 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:51.333073 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd69fc9d45f54c7d900248ad54571d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.336793 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 72bcdd8ce60141b4a8ae93bf6451b437 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:51.341157 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bcdd8ce60141b4a8ae93bf6451b437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.338449 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.336869 31096 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.353014 30871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c88e7048de4bf6844c6d2a437a128f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.354936 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd69fc9d45f54c7d900248ad54571d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.355899 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bced1836a1cd4749bcd4db4d53decc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.360582 30864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9513cbd3af40a4a69f7a596298664c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:51.360743 30998 leader_election.cc:343] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.361223 30998 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:51.364022 31096 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.364944 30873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea166084ed848e08ef7f36b2a4b4e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.367322 31074 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.358775 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 72bcdd8ce60141b4a8ae93bf6451b437 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:51.368726 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bcdd8ce60141b4a8ae93bf6451b437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.373921 31096 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.367825 31074 ts_tablet_manager.cc:1403] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.426s	user 0.069s	sys 0.067s
I20260709 13:13:51.380234 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 72bcdd8ce60141b4a8ae93bf6451b437 (DEFAULT_TABLE table=test-workload [id=e436a38e5fbb442c80119635c71a3d0d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:51.381294 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bcdd8ce60141b4a8ae93bf6451b437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:51.386480 31072 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.386962 31072 ts_tablet_manager.cc:1403] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.289s	user 0.015s	sys 0.012s
I20260709 13:13:51.389302 31072 raft_consensus.cc:359] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.389866 31072 raft_consensus.cc:385] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.390113 31072 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.390743 31072 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.400696 31074 raft_consensus.cc:359] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.409345 31074 raft_consensus.cc:385] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.410998 31074 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.410408 31072 ts_tablet_manager.cc:1434] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:13:51.427480 31073 tablet_bootstrap.cc:654] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.437000 31106 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.437525 31106 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.438432 31073 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.438905 31073 ts_tablet_manager.cc:1403] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.001s
I20260709 13:13:51.439651 31106 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.441931 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.442623 30956 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:51.443651 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:51.445392 30848 leader_election.cc:343] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.446131 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.435484 31074 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.447190 31106 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.447553 31106 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.448873 31106 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.449738 31073 raft_consensus.cc:359] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.450462 31073 raft_consensus.cc:385] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.450783 31073 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.451484 31073 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:51.452675 30998 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:51.454067 31073 ts_tablet_manager.cc:1434] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:51.455266 31073 tablet_bootstrap.cc:492] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.455056 31106 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.456679 31074 ts_tablet_manager.cc:1434] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:13:51.457727 31074 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.462020 31072 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.463722 31074 tablet_bootstrap.cc:654] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.464587 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:51.465626 30956 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.474560 31072 tablet_bootstrap.cc:654] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.476066 31073 tablet_bootstrap.cc:654] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.477579 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:51.479451 30848 leader_election.cc:343] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.480249 31106 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.483589 30956 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:51.485385 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.487107 31106 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.487638 31106 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:51.488530 31106 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.490535 31073 tablet_bootstrap.cc:492] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.491086 31073 ts_tablet_manager.cc:1403] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.013s
I20260709 13:13:51.492120 31072 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.492580 31072 ts_tablet_manager.cc:1403] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.010s
I20260709 13:13:51.494104 31073 raft_consensus.cc:359] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.494882 31073 raft_consensus.cc:385] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.495205 31073 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.495363 31072 raft_consensus.cc:359] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.496083 31072 raft_consensus.cc:385] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.496454 31072 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.496004 31073 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.497155 31072 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.498643 31073 ts_tablet_manager.cc:1434] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:51.499423 31072 ts_tablet_manager.cc:1434] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:51.499671 31073 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.502488 31072 tablet_bootstrap.cc:492] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.502754 31074 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.503259 31074 ts_tablet_manager.cc:1403] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 13:13:51.506359 31074 raft_consensus.cc:359] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.507122 31074 raft_consensus.cc:385] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.507433 31074 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.507551 31073 tablet_bootstrap.cc:654] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.508253 31074 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.509626 31072 tablet_bootstrap.cc:654] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.505481 30780 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.520776 31074 ts_tablet_manager.cc:1434] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 13:13:51.528136 31074 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.537245 31074 tablet_bootstrap.cc:654] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.540838 31073 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.541404 31073 ts_tablet_manager.cc:1403] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.023s
I20260709 13:13:51.549552 31073 raft_consensus.cc:359] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.550271 31073 raft_consensus.cc:385] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.550509 31073 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.551106 31073 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.551433 31072 tablet_bootstrap.cc:492] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.551430 31074 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.552158 31072 ts_tablet_manager.cc:1403] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.024s
I20260709 13:13:51.552227 31074 ts_tablet_manager.cc:1403] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 13:13:51.552866 31073 ts_tablet_manager.cc:1434] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:51.554057 31073 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.555335 31072 raft_consensus.cc:359] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.556116 31072 raft_consensus.cc:385] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.556408 31072 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.557163 31072 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.559420 31072 ts_tablet_manager.cc:1434] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:51.559434 31073 tablet_bootstrap.cc:654] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.560572 31074 raft_consensus.cc:359] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.561398 31074 raft_consensus.cc:385] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.562388 31072 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.562584 31074 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.568735 31073 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.563447 31074 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.569339 31073 ts_tablet_manager.cc:1403] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:13:51.569391 31072 tablet_bootstrap.cc:654] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.570909 31074 ts_tablet_manager.cc:1434] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:13:51.572341 31073 raft_consensus.cc:359] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.573072 31073 raft_consensus.cc:385] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.573398 31073 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.574173 31073 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.575867 31074 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.576517 31073 ts_tablet_manager.cc:1434] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:51.577426 31073 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.581312 31106 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.581786 31106 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.582537 31074 tablet_bootstrap.cc:654] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.584817 31106 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.584997 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.585584 30956 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:51.586392 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:51.587747 30848 leader_election.cc:343] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.589087 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.590198 31073 tablet_bootstrap.cc:654] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.590112 31106 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.590605 31106 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.590958 31106 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.596616 31072 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.597051 31072 ts_tablet_manager.cc:1403] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.007s
I20260709 13:13:51.597092 31106 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.600960 31072 raft_consensus.cc:359] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.601802 31072 raft_consensus.cc:385] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.602128 31072 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.602999 31072 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.603972 31104 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.609238 31072 ts_tablet_manager.cc:1434] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:51.601033 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:51.610515 30956 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.611289 31072 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.615032 31103 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.615470 31103 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.615907 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:51.617488 30848 leader_election.cc:343] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.618332 30956 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:51.618873 31103 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.619117 31104 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.619562 31104 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.620724 31074 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.621342 31074 ts_tablet_manager.cc:1403] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.012s
I20260709 13:13:51.621850 31104 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.622586 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:51.623193 31032 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:51.624349 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:51.625177 31104 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.625500 31104 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.625826 31104 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.627877 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:51.629124 30923 leader_election.cc:343] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.629848 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.629944 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.630432 30882 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:51.631006 30881 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:51.631559 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.632351 31079 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.633529 30924 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:51.633424 31074 raft_consensus.cc:359] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.634546 31074 raft_consensus.cc:385] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.634795 31103 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.635385 31103 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.635689 31072 tablet_bootstrap.cc:654] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.635838 31103 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.634940 31074 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.640197 31074 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.643229 31074 ts_tablet_manager.cc:1434] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:13:51.644546 31074 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.645315 31103 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.646521 31106 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.650545 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:51.651103 30881 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.653981 31102 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.654609 31102 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.657963 31102 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:51.658030 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:51.659736 30998 leader_election.cc:343] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.658643 31104 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.660389 31074 tablet_bootstrap.cc:654] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.662389 30881 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:51.662545 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:51.663964 30882 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.665961 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:51.666512 31031 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.671149 30882 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:51.672513 30924 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:51.673661 31031 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:51.674909 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:51.663125 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.685415 31103 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.691366 31103 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.691918 31103 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:13:51.692049 30997 leader_election.cc:343] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.692528 30997 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:51.693672 31102 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.693466 31103 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.688817 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:51.700139 31073 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.700591 31073 ts_tablet_manager.cc:1403] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.123s	user 0.029s	sys 0.051s
I20260709 13:13:51.701154 31074 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.701588 31074 ts_tablet_manager.cc:1403] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.018s
I20260709 13:13:51.703219 31073 raft_consensus.cc:359] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.703878 31073 raft_consensus.cc:385] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.704165 31073 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.703981 31074 raft_consensus.cc:359] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.704630 31074 raft_consensus.cc:385] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.704746 31135 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.704994 31074 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.705358 31135 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.706087 31074 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.707096 31073 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:51.708148 30923 leader_election.cc:343] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.709133 31073 ts_tablet_manager.cc:1434] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:51.710044 31073 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.710166 31104 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.713347 31074 ts_tablet_manager.cc:1434] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:51.685845 31134 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.715628 31134 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:51.718804 31074 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.719340 31136 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.720155 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.720712 31073 tablet_bootstrap.cc:654] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.720767 30883 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:51.724524 30924 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:51.726315 30779 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.728439 31138 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.728689 31079 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:51.728879 31138 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.729334 31138 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.729508 31072 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.730021 31072 ts_tablet_manager.cc:1403] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.119s	user 0.035s	sys 0.014s
I20260709 13:13:51.729635 31079 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.732515 31072 raft_consensus.cc:359] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.733155 31072 raft_consensus.cc:385] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.733436 31072 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.716782 31134 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.734151 31072 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.736208 31072 ts_tablet_manager.cc:1434] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:51.737082 31072 tablet_bootstrap.cc:492] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.739512 31074 tablet_bootstrap.cc:654] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.742208 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:51.743003 31072 tablet_bootstrap.cc:654] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:51.744094 30923 leader_election.cc:343] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.745218 31135 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.746676 31073 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.747262 31073 ts_tablet_manager.cc:1403] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.005s
I20260709 13:13:51.749857 31073 raft_consensus.cc:359] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.750530 31073 raft_consensus.cc:385] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.750839 31073 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.751544 31073 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.753484 31073 ts_tablet_manager.cc:1434] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:51.754333 31073 tablet_bootstrap.cc:492] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.753363 31138 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.756095 30778 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.757717 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:51.758468 30882 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.759972 31073 tablet_bootstrap.cc:654] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.769351 31072 tablet_bootstrap.cc:492] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.769152 30882 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:51.769834 31072 ts_tablet_manager.cc:1403] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.008s
I20260709 13:13:51.771381 30924 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:51.772570 31135 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.773092 31135 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:51.773913 31135 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.778736 31072 raft_consensus.cc:359] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.779537 31072 raft_consensus.cc:385] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.779948 31072 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.781023 30781 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.783358 31074 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.784189 31074 ts_tablet_manager.cc:1403] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.008s
I20260709 13:13:51.786998 31138 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.787070 31074 raft_consensus.cc:359] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.787894 31074 raft_consensus.cc:385] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.787564 31073 tablet_bootstrap.cc:492] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.788275 31074 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.788786 31073 ts_tablet_manager.cc:1403] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.005s
I20260709 13:13:51.791160 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:51.792505 30923 leader_election.cc:343] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.792235 31072 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.788956 31074 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.794229 31072 ts_tablet_manager.cc:1434] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:13:51.795365 31074 ts_tablet_manager.cc:1434] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:13:51.796247 31074 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.791478 31073 raft_consensus.cc:359] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.799276 31073 raft_consensus.cc:385] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.799554 31073 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.800231 31072 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.802580 31074 tablet_bootstrap.cc:654] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.801378 31073 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.805948 30778 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.809679 31073 ts_tablet_manager.cc:1434] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:13:51.811865 31073 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.813477 31072 tablet_bootstrap.cc:654] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.814116 31074 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.814605 31074 ts_tablet_manager.cc:1403] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:13:51.817713 31074 raft_consensus.cc:359] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.818599 31074 raft_consensus.cc:385] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.818902 31074 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.819183 31073 tablet_bootstrap.cc:654] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.819518 31074 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.821487 31074 ts_tablet_manager.cc:1434] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:51.822753 31074 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.829269 31074 tablet_bootstrap.cc:654] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.830338 31073 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.830929 31073 ts_tablet_manager.cc:1403] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:13:51.833909 31073 raft_consensus.cc:359] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.834540 31073 raft_consensus.cc:385] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.834600 31072 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.835062 31072 ts_tablet_manager.cc:1403] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.011s
I20260709 13:13:51.835736 31074 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.835865 31073 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.836232 31074 ts_tablet_manager.cc:1403] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:13:51.836903 31073 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.837647 31072 raft_consensus.cc:359] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.838285 31072 raft_consensus.cc:385] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.838560 31072 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.839277 31072 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.841323 31072 ts_tablet_manager.cc:1434] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:13:51.839272 31074 raft_consensus.cc:359] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.842192 31074 raft_consensus.cc:385] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.842473 31074 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.843120 31074 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.845109 31074 ts_tablet_manager.cc:1434] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:13:51.846155 31074 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.847333 31073 ts_tablet_manager.cc:1434] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:13:51.851889 31074 tablet_bootstrap.cc:654] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.852919 31072 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.856361 31073 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.859127 31072 tablet_bootstrap.cc:654] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.859594 31079 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.860394 31079 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.862690 31079 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.864236 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:51.865145 31031 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:51.866415 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:51.867242 31079 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.867626 31079 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.867976 31079 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.868117 31073 tablet_bootstrap.cc:654] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.868870 31072 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.869306 31072 ts_tablet_manager.cc:1403] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 13:13:51.864216 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.871978 30956 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:51.872146 31072 raft_consensus.cc:359] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.872859 31072 raft_consensus.cc:385] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.873214 31072 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.874047 31074 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.873839 31072 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.874465 31074 ts_tablet_manager.cc:1403] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.001s
I20260709 13:13:51.875864 31072 ts_tablet_manager.cc:1434] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:51.876703 31079 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.876801 31074 raft_consensus.cc:359] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.877329 31074 raft_consensus.cc:385] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.877529 31074 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.878137 31074 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.878473 31079 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.879151 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:51.879675 30956 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.879642 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:51.880379 31031 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.880690 31073 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.881096 31073 ts_tablet_manager.cc:1403] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 13:13:51.883669 31073 raft_consensus.cc:359] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.884320 31073 raft_consensus.cc:385] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.884564 31073 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.885269 31073 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.887054 31031 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:51.887612 31073 ts_tablet_manager.cc:1434] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:51.888526 31074 ts_tablet_manager.cc:1434] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:13:51.889042 31073 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:51.893302 30883 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.895102 31073 tablet_bootstrap.cc:654] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.897670 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:51.898434 31072 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:51.899310 30956 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:51.901901 31074 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:51.915657 31079 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.916159 31079 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:51.916632 31072 tablet_bootstrap.cc:654] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.917001 31079 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.922248 31074 tablet_bootstrap.cc:654] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:51.922260 31032 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.927080 31102 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.927754 31102 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.928880 31130 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:51.930938 31096 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.931579 31096 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.935207 31096 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:51.937206 31135 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.937525 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.937668 31135 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.938301 30883 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:51.938205 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.938537 31102 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:13:51.939595 30997 leader_election.cc:343] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.940249 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.940709 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.941277 30883 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
W20260709 13:13:51.941565 30998 leader_election.cc:343] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.942001 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:51.942495 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.944155 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:51.945119 31102 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.945688 30924 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:51.939692 31135 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.946101 31102 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.946708 31138 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.947153 31138 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.947485 31138 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.956888 31138 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.957137 30781 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.960492 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:51.961195 30883 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.961364 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:51.962648 30923 leader_election.cc:343] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.964363 31130 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.964802 31102 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:51.965926 31130 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.966461 31130 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.968701 31130 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.973526 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:51.973753 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:51.968984 31072 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:51.969493 31074 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:51.974520 31074 ts_tablet_manager.cc:1403] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.005s
I20260709 13:13:51.976719 31135 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:51.976926 30848 leader_election.cc:343] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.977192 31135 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.977252 31074 raft_consensus.cc:359] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.978128 31074 raft_consensus.cc:385] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.978399 31074 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.979197 31074 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.980252 31135 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:51.980873 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:51.981576 31074 ts_tablet_manager.cc:1434] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:51.981779 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:51.981714 31032 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:51.982489 31074 tablet_bootstrap.cc:492] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
W20260709 13:13:51.983403 30924 leader_election.cc:343] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:51.983958 30923 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:51.984958 31135 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:51.985344 31135 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.985664 31135 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.988051 31072 ts_tablet_manager.cc:1403] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.002s
I20260709 13:13:51.973137 31073 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:51.989260 31073 ts_tablet_manager.cc:1403] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.038s
I20260709 13:13:51.991338 30883 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:51.992035 31073 raft_consensus.cc:359] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.992684 31073 raft_consensus.cc:385] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.992627 30924 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:51.993044 31073 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.993639 31141 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:51.993678 31073 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.994228 31141 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:51.995048 31141 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.997953 31072 raft_consensus.cc:359] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:51.998610 31072 raft_consensus.cc:385] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.998986 31072 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.999816 31072 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.000128 31134 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.000622 31134 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.001861 31072 ts_tablet_manager.cc:1434] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:52.002595 31134 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.004577 31074 tablet_bootstrap.cc:654] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.005009 31073 ts_tablet_manager.cc:1434] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:52.004703 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.004593 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.005550 30882 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:52.006009 31032 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:52.006939 30924 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:52.007880 31133 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.008308 31133 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.008630 31133 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.008864 31073 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
W20260709 13:13:52.010125 30848 leader_election.cc:343] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.014622 31073 tablet_bootstrap.cc:654] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.017184 31133 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.011245 30848 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:52.022084 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.023105 30882 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.021420 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.025110 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.026866 31074 tablet_bootstrap.cc:492] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.029452 31074 ts_tablet_manager.cc:1403] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
W20260709 13:13:52.030225 30923 leader_election.cc:343] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.030913 31032 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.019701 31133 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.033728 31074 raft_consensus.cc:359] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.034446 31074 raft_consensus.cc:385] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.034734 31074 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.035523 31074 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.037957 31074 ts_tablet_manager.cc:1434] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:52.037664 31135 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.038810 31074 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.040868 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.036633 30882 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:52.042110 31130 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:52.042210 30924 leader_election.cc:343] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.043071 30924 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:52.028988 31073 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.043820 31102 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.044276 31073 ts_tablet_manager.cc:1403] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.007s
I20260709 13:13:52.044286 31141 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.044368 31102 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.045051 31141 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:52.045881 31141 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.047802 31102 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.047559 31073 raft_consensus.cc:359] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.048233 31073 raft_consensus.cc:385] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.048516 31073 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.049155 31073 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.050760 31073 ts_tablet_manager.cc:1434] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:52.052418 31074 tablet_bootstrap.cc:654] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.053927 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.054708 30956 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:52.023281 31138 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.002729 31072 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.060730 31032 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:52.062291 31073 tablet_bootstrap.cc:492] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:52.062440 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.064055 30998 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:52.064904 31135 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.065167 31102 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.066371 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.067001 31032 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.069607 31073 tablet_bootstrap.cc:654] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.073963 31032 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:52.074572 31072 tablet_bootstrap.cc:654] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.075063 30923 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:52.076241 31141 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.076475 31074 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.076730 31141 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:52.076936 31074 ts_tablet_manager.cc:1403] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 13:13:52.077577 31141 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.079295 31102 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.080384 31130 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.083853 31130 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.084525 31073 tablet_bootstrap.cc:492] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.085148 31073 ts_tablet_manager.cc:1403] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:13:52.087371 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.088017 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:52.088299 31073 raft_consensus.cc:359] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.088733 31130 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.088958 31073 raft_consensus.cc:385] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.079473 31074 raft_consensus.cc:359] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.089368 31074 raft_consensus.cc:385] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.089222 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:52.089663 31074 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.090070 31130 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.088580 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.082602 30779 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.090411 31130 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.091383 31130 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.091831 31032 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:52.093752 31073 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.094491 31073 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.095854 31072 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:52.096827 31072 ts_tablet_manager.cc:1403] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.002s
I20260709 13:13:52.090378 31074 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.099689 31102 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.100333 31102 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.107174 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.108140 30883 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:52.109561 31074 ts_tablet_manager.cc:1434] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:13:52.110492 31074 tablet_bootstrap.cc:492] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.111212 30998 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.093400 30779 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.113003 31096 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.113381 31096 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.113715 31096 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.116156 31102 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.116335 31072 raft_consensus.cc:359] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.117322 31073 ts_tablet_manager.cc:1434] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.032s	user 0.012s	sys 0.001s
I20260709 13:13:52.117372 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.118472 31073 tablet_bootstrap.cc:492] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
W20260709 13:13:52.118938 30997 leader_election.cc:343] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.117473 31072 raft_consensus.cc:385] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.122155 31072 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.122874 31072 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.125187 31072 ts_tablet_manager.cc:1434] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:13:52.124984 31096 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.126014 31073 tablet_bootstrap.cc:654] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.126132 31072 tablet_bootstrap.cc:492] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.128415 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.128974 30883 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.132395 31074 tablet_bootstrap.cc:654] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.135208 30883 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:52.136941 30998 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.137588 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.137938 31102 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.138520 31096 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.138969 31072 tablet_bootstrap.cc:654] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:52.143786 30997 leader_election.cc:343] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.130290 31130 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.147782 31130 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.149856 31102 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:52.150825 31102 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.153139 31074 tablet_bootstrap.cc:492] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.152874 31138 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.153630 31074 ts_tablet_manager.cc:1403] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 13:13:52.153676 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.154368 30956 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.154466 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.155122 31031 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.156999 31074 raft_consensus.cc:359] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.158012 31074 raft_consensus.cc:385] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.158301 31074 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.159051 31074 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.161235 31074 ts_tablet_manager.cc:1434] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:13:52.162214 31074 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.164515 31130 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:52.149163 30781 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.170639 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:52.172477 31031 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:52.175467 31074 tablet_bootstrap.cc:654] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.179391 31073 tablet_bootstrap.cc:492] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.179953 31073 ts_tablet_manager.cc:1403] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.007s
I20260709 13:13:52.177896 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:52.191601 31130 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.192160 31130 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:52.193409 31130 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.195056 30779 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.209563 31072 tablet_bootstrap.cc:492] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:52.212231 31079 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.217056 31073 raft_consensus.cc:359] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.217964 31073 raft_consensus.cc:385] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.218252 31073 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.219156 31073 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.215188 31072 ts_tablet_manager.cc:1403] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.018s
I20260709 13:13:52.257496 31074 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.257797 31073 ts_tablet_manager.cc:1434] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 13:13:52.258039 31074 ts_tablet_manager.cc:1403] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.008s
I20260709 13:13:52.258800 31073 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:52.261336 31079 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.261811 31079 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.263927 31133 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.264724 31072 raft_consensus.cc:359] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.265458 31072 raft_consensus.cc:385] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.265760 31072 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.266639 31072 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.267241 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.268272 31032 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:52.269941 31074 raft_consensus.cc:359] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.270756 31079 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.271991 31072 ts_tablet_manager.cc:1434] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.003s
W20260709 13:13:52.272692 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:52.273010 31072 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.270766 31074 raft_consensus.cc:385] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.280622 31074 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.281203 31072 tablet_bootstrap.cc:654] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.281893 31074 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.286695 31074 ts_tablet_manager.cc:1434] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:13:52.287606 31074 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.288153 31102 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.288784 31102 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.291218 31102 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.291975 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.292604 30881 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:52.293613 30998 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.294178 31073 tablet_bootstrap.cc:654] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.295110 31096 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.295468 31096 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.295812 31096 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.302994 31074 tablet_bootstrap.cc:654] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.306672 31106 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.311220 31134 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.315958 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.321674 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.310195 30781 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:52.328506 30997 leader_election.cc:343] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.326562 31102 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.327329 31103 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:52.342161 31172 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.344272 31172 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.346369 31172 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.346899 31133 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.347062 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.332971 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:52.347694 30881 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:52.348488 31106 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.350850 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.351462 30958 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:52.338416 31096 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.363471 31096 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.338690 31102 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.357652 30998 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.358963 31074 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.356503 31030 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.368278 31074 ts_tablet_manager.cc:1403] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.007s
I20260709 13:13:52.379344 31072 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:52.382357 31072 ts_tablet_manager.cc:1403] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.009s
I20260709 13:13:52.388583 31072 raft_consensus.cc:359] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.392814 31102 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.377790 31096 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.394466 31181 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.394382 31096 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.395026 31096 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.395005 31181 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.389303 31072 raft_consensus.cc:385] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.396310 31072 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.375725 31106 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.401324 31072 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.399430 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.404472 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.406787 30882 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.406982 30880 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:52.414120 30998 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.414712 30882 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
W20260709 13:13:52.414866 30923 consensus_peers.cc:597] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.415107 31102 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.416517 31102 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.417306 31102 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.417711 31181 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.418131 31072 ts_tablet_manager.cc:1434] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:13:52.419507 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.419827 31181 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.420190 30957 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:52.419082 31072 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.421653 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.422209 30955 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:52.423394 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.424220 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.424659 30998 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.424883 31133 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.425413 31172 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:52.426676 30848 leader_election.cc:343] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.427785 31181 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.428436 31181 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.435791 31073 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.435984 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.436408 31073 ts_tablet_manager.cc:1403] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.013s
W20260709 13:13:52.437407 30848 leader_election.cc:343] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.439914 31073 raft_consensus.cc:359] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.441720 31073 raft_consensus.cc:385] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.442070 31073 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.443560 31073 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.435783 31181 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.447558 31073 ts_tablet_manager.cc:1434] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:52.449178 31073 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:52.447984 31172 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:52.451033 31172 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.456113 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:52.457855 31181 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:52.458068 30997 leader_election.cc:343] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.458240 31181 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.458530 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.473678 31074 raft_consensus.cc:359] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.482223 31074 raft_consensus.cc:385] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.482663 31074 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
W20260709 13:13:52.503368 31187 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:52.514047 31102 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.481163 31096 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.458611 31181 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.524050 31074 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.526070 31074 ts_tablet_manager.cc:1434] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.157s	user 0.004s	sys 0.005s
I20260709 13:13:52.527240 31074 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.528527 31096 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.529508 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.532845 30883 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:52.531140 30848 leader_election.cc:343] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.534690 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:52.535293 31079 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.525919 31133 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:52.542117 31172 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.542515 31102 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.542645 31172 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.543133 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.543736 30881 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.553640 31072 tablet_bootstrap.cc:654] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.554082 31172 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.552552 31134 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:13:52.546185 30883 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:52.570221 30998 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.572459 31172 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.573004 31172 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:52.574069 31172 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.588246 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.584920 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.591517 31103 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.592270 30956 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:52.602474 30998 leader_election.cc:343] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.612625 31073 tablet_bootstrap.cc:654] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.618346 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.619017 30958 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.620249 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.623299 31130 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:52.625563 30997 leader_election.cc:343] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.626147 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:52.627753 31172 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:52.636636 30997 consensus_peers.cc:597] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.639190 31138 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.650596 30958 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:52.656318 30956 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:52.653551 31138 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.658438 31134 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.658890 31074 tablet_bootstrap.cc:654] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.658929 31138 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.659936 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.659859 31181 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.660974 31031 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:52.646545 30778 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.662322 31181 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.651988 30881 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:52.664222 30923 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.665037 31134 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.665189 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.665406 31134 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.665745 31134 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.667062 31073 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.667503 31073 ts_tablet_manager.cc:1403] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.219s	user 0.014s	sys 0.006s
I20260709 13:13:52.666715 31172 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.671686 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.672241 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.672546 31102 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.672842 30883 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:52.673149 31102 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:52.673429 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.673983 30956 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:52.674044 30848 leader_election.cc:343] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.674278 31102 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.679451 31073 raft_consensus.cc:359] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.680016 31073 raft_consensus.cc:385] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.680336 31073 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.678340 31138 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:52.680938 31073 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.682468 31073 ts_tablet_manager.cc:1434] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.000s
I20260709 13:13:52.733944 31074 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.734438 31074 ts_tablet_manager.cc:1403] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.003s
I20260709 13:13:52.737707 31134 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.740466 31073 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:52.743664 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:52.741778 31074 raft_consensus.cc:359] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.745095 31074 raft_consensus.cc:385] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.745344 31074 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.745958 30883 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.746145 31074 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.753146 30956 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:52.754168 31074 ts_tablet_manager.cc:1434] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:13:52.755004 31074 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.750948 31072 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:52.758020 31072 ts_tablet_manager.cc:1403] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.339s	user 0.032s	sys 0.017s
I20260709 13:13:52.760856 31073 tablet_bootstrap.cc:654] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.783964 31074 tablet_bootstrap.cc:654] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.767204 31102 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.812595 31102 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.814407 31072 raft_consensus.cc:359] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.815258 31102 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:52.816018 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.818138 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.818830 31031 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.815055 31072 raft_consensus.cc:385] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.821643 31072 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.822384 31072 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.793444 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:52.824592 31181 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.825068 31181 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:52.811980 31134 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.825628 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.825860 31181 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.826571 31106 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:52.829793 30883 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:52.830986 30924 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:52.835098 31073 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.835542 31073 ts_tablet_manager.cc:1403] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.021s
I20260709 13:13:52.835912 31133 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.835456 30779 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.836409 31133 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:52.837216 31133 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.839134 31073 raft_consensus.cc:359] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.839798 31073 raft_consensus.cc:385] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.840077 31073 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.837544 30998 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:52.843060 31031 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:52.843468 31096 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.843710 31074 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.844228 31074 ts_tablet_manager.cc:1403] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.017s
I20260709 13:13:52.847456 31074 raft_consensus.cc:359] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.848107 31074 raft_consensus.cc:385] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.848387 31074 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.848886 31074 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.850344 31074 ts_tablet_manager.cc:1434] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:52.851014 31074 tablet_bootstrap.cc:492] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.840791 31073 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.840559 30779 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.852742 31072 ts_tablet_manager.cc:1434] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.024s
I20260709 13:13:52.853466 31073 ts_tablet_manager.cc:1434] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:13:52.853615 31072 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.854375 31073 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:52.854657 30778 catalog_manager.cc:5697] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.861110 31072 tablet_bootstrap.cc:654] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.862191 31106 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.862705 31106 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.864202 31074 tablet_bootstrap.cc:654] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.864899 31106 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.865866 31073 tablet_bootstrap.cc:654] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.865958 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:52.866621 31031 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:52.867708 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:52.868534 31106 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:52.874574 31106 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.874915 31106 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.880229 31032 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.886595 31102 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:52.891573 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:52.892277 30957 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:52.895692 31106 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.907140 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:52.907730 30957 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.917147 30957 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:52.918933 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:52.919932 31181 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:52.920387 31181 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:52.921175 31181 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.922034 31072 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:52.922650 31072 ts_tablet_manager.cc:1403] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.003s
I20260709 13:13:52.923364 31106 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.924983 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:52.925540 31031 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:52.926360 31072 raft_consensus.cc:359] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.927243 31072 raft_consensus.cc:385] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.927568 31072 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.928448 31072 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.931244 31072 ts_tablet_manager.cc:1434] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:52.932226 31072 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.935328 31031 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:52.940596 31072 tablet_bootstrap.cc:654] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:52.947158 30997 consensus_peers.cc:597] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.948107 31133 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.948580 31133 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.952402 31133 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:52.953349 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:52.955334 30923 leader_election.cc:343] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.957448 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:52.945554 30779 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:52.959277 30924 leader_election.cc:343] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:52.959985 30924 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:52.960789 31133 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:52.963848 31073 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.963855 31074 tablet_bootstrap.cc:492] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:52.964473 31074 ts_tablet_manager.cc:1403] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.114s	user 0.016s	sys 0.036s
I20260709 13:13:52.964473 31073 ts_tablet_manager.cc:1403] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.050s
I20260709 13:13:52.967195 31073 raft_consensus.cc:359] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.967356 31074 raft_consensus.cc:359] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.967967 31073 raft_consensus.cc:385] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.968377 31073 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.969063 31073 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.967986 31074 raft_consensus.cc:385] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.969730 31072 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:52.969834 31074 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.970196 31072 ts_tablet_manager.cc:1403] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 13:13:52.971015 31073 ts_tablet_manager.cc:1434] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:13:52.970659 31074 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.972092 31073 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:52.972697 31072 raft_consensus.cc:359] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.973317 31072 raft_consensus.cc:385] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.973567 31072 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.974301 31072 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.972726 31074 ts_tablet_manager.cc:1434] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:52.976003 31074 tablet_bootstrap.cc:492] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:52.976404 30781 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:52.977982 31073 tablet_bootstrap.cc:654] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.983106 31072 ts_tablet_manager.cc:1434] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:13:52.984295 31072 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:52.990676 31074 tablet_bootstrap.cc:654] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.995445 31181 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.996383 31072 tablet_bootstrap.cc:654] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.997387 31181 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:52.998674 31073 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:52.999111 31073 ts_tablet_manager.cc:1403] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.009s
I20260709 13:13:53.000658 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.001329 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.001911 31031 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:53.002075 31181 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:13:53.002447 30848 leader_election.cc:343] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.003060 31074 tablet_bootstrap.cc:492] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:53.001914 31073 raft_consensus.cc:359] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.003219 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:53.003504 31074 ts_tablet_manager.cc:1403] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:13:53.003685 31073 raft_consensus.cc:385] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.004217 31073 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.005131 31073 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.006166 31074 raft_consensus.cc:359] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.006538 31106 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.006803 31074 raft_consensus.cc:385] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.006958 31106 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.007148 31074 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.007375 31106 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.008244 31073 ts_tablet_manager.cc:1434] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.009s
I20260709 13:13:53.007887 31074 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.009279 31073 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:53.013093 31074 ts_tablet_manager.cc:1434] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:53.013993 31074 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:53.014369 31106 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.016050 31073 tablet_bootstrap.cc:654] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.016366 31106 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.018131 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:53.018677 31031 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.019486 31074 tablet_bootstrap.cc:654] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.025159 31072 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.025604 31072 ts_tablet_manager.cc:1403] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.008s
I20260709 13:13:53.027941 30957 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.027801 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:53.028270 31072 raft_consensus.cc:359] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.028923 31072 raft_consensus.cc:385] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.029173 31072 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.029906 31072 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.032176 31072 ts_tablet_manager.cc:1434] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:13:53.033004 31072 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
W20260709 13:13:53.034263 30848 leader_election.cc:343] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.038686 31072 tablet_bootstrap.cc:654] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.049970 31072 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.050446 31072 ts_tablet_manager.cc:1403] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:13:53.053354 31072 raft_consensus.cc:359] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.054003 31072 raft_consensus.cc:385] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.054286 31072 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.055099 31072 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.057770 31072 ts_tablet_manager.cc:1434] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:53.056871 31031 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:53.059561 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:53.060322 31106 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.060787 31106 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:53.062572 31072 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.061573 31106 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.065979 31102 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.074149 31133 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.074644 31133 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.076730 31133 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.080495 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.081214 30883 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:53.080495 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.082756 31032 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:53.084077 31072 tablet_bootstrap.cc:654] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.083920 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.085527 31141 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.086012 31141 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.086431 31141 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.094503 31102 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.095270 31102 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.099146 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:53.100944 30998 leader_election.cc:343] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.101657 31072 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.102123 31072 ts_tablet_manager.cc:1403] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:13:53.102660 31102 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.105212 31072 raft_consensus.cc:359] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.105844 31072 raft_consensus.cc:385] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.106117 31072 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.106807 31072 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.108667 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.108672 31190 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.109234 31072 ts_tablet_manager.cc:1434] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
W20260709 13:13:53.110383 30997 leader_election.cc:343] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.110816 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:53.111967 31190 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.111937 31072 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.115252 31141 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.118979 31072 tablet_bootstrap.cc:654] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.119055 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.119977 30881 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.131579 30780 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.132740 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:53.133327 31031 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.133569 31074 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:53.134145 31074 ts_tablet_manager.cc:1403] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.120s	user 0.034s	sys 0.055s
I20260709 13:13:53.140425 31096 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.142516 31031 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:53.144270 31181 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.144054 31141 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.146266 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.146919 31181 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.147486 31141 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.148011 31141 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:53.148888 31181 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.149119 31072 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.148823 31141 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.149602 31072 ts_tablet_manager.cc:1403] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 13:13:53.151536 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.152384 31072 raft_consensus.cc:359] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.153497 31072 raft_consensus.cc:385] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.153877 31072 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.154699 31072 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:53.156273 30848 leader_election.cc:343] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.157353 31074 raft_consensus.cc:359] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.158046 31074 raft_consensus.cc:385] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.158290 31074 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.160041 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.161484 31074 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.162881 31073 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:53.163452 31073 ts_tablet_manager.cc:1403] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.154s	user 0.028s	sys 0.049s
I20260709 13:13:53.163749 31074 ts_tablet_manager.cc:1434] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:13:53.164687 31074 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
W20260709 13:13:53.167294 30848 leader_election.cc:343] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.160604 31072 ts_tablet_manager.cc:1434] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:53.168956 30848 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.168839 30881 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:53.169893 31072 tablet_bootstrap.cc:492] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.170174 31106 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.188053 31073 raft_consensus.cc:359] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.188817 31073 raft_consensus.cc:385] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.189121 31073 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.189810 31073 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.192262 31073 ts_tablet_manager.cc:1434] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:13:53.192081 30780 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.193302 31073 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:53.199106 31191 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.201325 31072 tablet_bootstrap.cc:654] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.203598 31074 tablet_bootstrap.cc:654] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.210987 31072 tablet_bootstrap.cc:492] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.211687 31072 ts_tablet_manager.cc:1403] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.004s
I20260709 13:13:53.215318 31072 raft_consensus.cc:359] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.215988 31072 raft_consensus.cc:385] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.216249 31072 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.217048 31072 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.218447 31073 tablet_bootstrap.cc:654] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.220005 31072 ts_tablet_manager.cc:1434] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:53.226334 31074 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:53.226761 31074 ts_tablet_manager.cc:1403] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.000s
I20260709 13:13:53.227015 31072 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.229499 31074 raft_consensus.cc:359] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.230173 31074 raft_consensus.cc:385] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.230454 31074 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.231267 31074 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.233884 31072 tablet_bootstrap.cc:654] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.238974 31073 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:53.239454 31073 ts_tablet_manager.cc:1403] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.004s
I20260709 13:13:53.241983 31073 raft_consensus.cc:359] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.242695 31073 raft_consensus.cc:385] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.243005 31073 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.243701 31073 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.250098 31073 ts_tablet_manager.cc:1434] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:53.251044 31073 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:53.252774 31141 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.255638 31074 ts_tablet_manager.cc:1434] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:13:53.256793 31073 tablet_bootstrap.cc:654] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.257206 31074 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:53.262249 31072 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.262694 31072 ts_tablet_manager.cc:1403] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 13:13:53.265255 31072 raft_consensus.cc:359] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.265944 31072 raft_consensus.cc:385] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.266252 31072 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.266875 31072 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.269129 31072 ts_tablet_manager.cc:1434] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:53.270840 31074 tablet_bootstrap.cc:654] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.276477 31072 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.283129 31072 tablet_bootstrap.cc:654] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.284694 31172 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.285144 31172 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.287150 31172 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.290143 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.290998 30882 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:53.291477 31072 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.291966 31072 ts_tablet_manager.cc:1403] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 13:13:53.292847 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.294044 31172 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.294472 31172 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.294585 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.294906 31172 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.295261 30957 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:53.295588 31074 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:53.296067 31074 ts_tablet_manager.cc:1403] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.004s
I20260709 13:13:53.298511 31072 raft_consensus.cc:359] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.299155 31072 raft_consensus.cc:385] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.298889 31074 raft_consensus.cc:359] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.299424 31072 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.299484 31074 raft_consensus.cc:385] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.299922 31074 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.300591 31074 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.301391 31073 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:53.300774 31072 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.301981 31073 ts_tablet_manager.cc:1403] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.018s
I20260709 13:13:53.304508 31072 ts_tablet_manager.cc:1434] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:53.305394 31072 tablet_bootstrap.cc:492] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.305276 31073 raft_consensus.cc:359] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.305975 31073 raft_consensus.cc:385] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.306257 31073 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.306991 31074 ts_tablet_manager.cc:1434] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:13:53.306933 31073 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.309190 31073 ts_tablet_manager.cc:1434] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:53.309334 31133 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.312860 31074 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:53.317772 31073 tablet_bootstrap.cc:492] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:53.318584 31106 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.317793 31172 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:53.322705 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:53.323485 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.324112 30881 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.328711 31106 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.329411 31074 tablet_bootstrap.cc:654] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.329526 31072 tablet_bootstrap.cc:654] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.332626 31191 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.332798 31032 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.333184 31191 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.335217 31191 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.336272 31073 tablet_bootstrap.cc:654] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.338267 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:53.338843 30958 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.339917 31190 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.340406 31190 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.341324 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.329222 31106 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:53.342729 30998 leader_election.cc:343] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.344198 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.344769 30956 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:53.345028 31106 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.348038 30997 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:53.349378 31191 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.349813 31191 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.350204 31191 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.349992 30881 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:53.351861 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.352317 31190 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.353116 31190 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.354530 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.355831 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.323515 31172 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:13:53.357360 30848 leader_election.cc:343] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.361720 31190 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:53.362812 31190 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.367290 31181 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.368425 31106 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.369038 31106 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.375538 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:53.377156 30848 leader_election.cc:343] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.377948 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.378000 31106 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.378221 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.379001 30957 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:53.378825 31106 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.381973 31133 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.383740 31072 tablet_bootstrap.cc:492] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.381983 30958 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:53.383935 31133 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.386155 31133 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.390658 31191 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.388897 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.392200 31073 tablet_bootstrap.cc:492] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:53.392791 31073 ts_tablet_manager.cc:1403] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.009s
I20260709 13:13:53.392976 31191 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.396174 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.396018 31073 raft_consensus.cc:359] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.396977 31073 raft_consensus.cc:385] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.397325 31073 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
W20260709 13:13:53.397565 30998 leader_election.cc:343] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.399127 31072 ts_tablet_manager.cc:1403] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.009s
I20260709 13:13:53.398902 31073 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.401855 31072 raft_consensus.cc:359] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.402493 31072 raft_consensus.cc:385] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.402755 31072 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.403515 31072 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.409476 31073 ts_tablet_manager.cc:1434] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
W20260709 13:13:53.411167 30848 leader_election.cc:343] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.414600 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.414784 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:53.426815 31072 ts_tablet_manager.cc:1434] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.004s
I20260709 13:13:53.426754 31073 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:53.432102 31072 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.435952 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.436460 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:53.437702 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.438481 30957 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.441627 31191 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:53.418689 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.443809 31106 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.443416 31130 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.444240 30956 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.446571 31072 tablet_bootstrap.cc:654] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.444284 31106 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.451242 31106 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.452312 31074 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:53.453020 31074 ts_tablet_manager.cc:1403] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.145s	user 0.028s	sys 0.021s
I20260709 13:13:53.456477 31073 tablet_bootstrap.cc:654] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.474391 30924 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.510509 31133 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.511176 31133 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.540817 31191 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.553333 31191 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.553683 31074 raft_consensus.cc:359] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.554473 31074 raft_consensus.cc:385] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.554821 31074 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.567116 31074 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.570425 31141 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.570739 31074 ts_tablet_manager.cc:1434] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.000s
I20260709 13:13:53.580410 31106 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.589357 30779 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.591058 31191 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.583729 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.584543 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.587446 31141 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.567898 31133 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.593382 31141 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.593992 30882 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
W20260709 13:13:53.594105 30923 leader_election.cc:343] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.595112 30998 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.596534 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.597296 31032 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
W20260709 13:13:53.545729 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 71458.6us
I20260709 13:13:53.600522 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.601372 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.601503 31191 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.601653 31141 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.601990 30881 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:53.602065 31141 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.602577 31141 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.602916 31191 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.603410 31191 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.605732 30954 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.608992 31106 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.612025 31074 tablet_bootstrap.cc:492] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:53.609863 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.616994 31133 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.618573 31141 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.623302 30882 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:53.623226 31133 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.621369 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.625794 30954 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:53.626029 31133 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.626564 31141 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.627449 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:53.628122 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:53.628353 31190 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.628625 30957 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:53.628849 31190 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.627712 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.630415 31032 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:53.634711 31138 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:53.635456 30923 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.637068 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.637264 31141 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:53.637614 31141 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.637715 30882 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:53.638028 31141 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.638896 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.634124 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.639807 31172 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.641453 31138 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.641884 31172 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.641934 31138 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.642378 31172 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.642441 31138 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.643477 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.646472 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.638173 31190 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.647156 30882 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.653045 31106 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.655979 31072 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:53.656574 31072 ts_tablet_manager.cc:1403] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.225s	user 0.013s	sys 0.031s
I20260709 13:13:53.656567 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:53.657256 31135 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:13:53.665151 30848 leader_election.cc:343] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.665129 31181 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.667879 31138 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.668399 30997 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:53.669055 31181 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:53.661175 30956 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.678515 31172 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.674557 31255 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.680051 31255 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:53.680850 31255 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.686592 31073 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:53.687037 31073 ts_tablet_manager.cc:1403] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.261s	user 0.021s	sys 0.009s
I20260709 13:13:53.690506 31073 raft_consensus.cc:359] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.691179 31073 raft_consensus.cc:385] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.691450 31073 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.693686 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.695263 30956 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:53.696102 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.696812 30883 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.697547 31074 tablet_bootstrap.cc:654] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.714934 31073 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.714594 31072 raft_consensus.cc:359] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.717325 31072 raft_consensus.cc:385] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.717629 31072 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.710448 31138 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.721117 31172 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.723829 31073 ts_tablet_manager.cc:1434] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:13:53.723871 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.724527 30881 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.724813 31073 tablet_bootstrap.cc:492] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:53.732365 31072 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.736486 31191 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.737740 31030 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:13:53.723124 30997 leader_election.cc:343] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.742875 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.743172 31072 ts_tablet_manager.cc:1434] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.001s
I20260709 13:13:53.744208 31072 tablet_bootstrap.cc:492] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:53.723299 31141 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.744374 31191 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.760732 31181 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.759166 31134 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:53.751959 30883 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:53.761615 30957 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:53.754575 30881 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:53.764467 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.766857 31106 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.767323 31106 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:53.761358 31181 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.768178 31106 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.769219 31181 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.770169 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.771145 31134 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.767323 31141 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.771646 31134 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.772274 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.774159 31134 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:53.774570 30779 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.776527 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:53.777034 31255 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.777511 31255 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:53.778107 31255 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:53.791589 30923 leader_election.cc:343] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:53.796533 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:53.802270 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:53.802943 31030 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:53.803588 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.804409 30954 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:53.815997 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:53.818571 30882 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:53.819975 30780 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.823563 31130 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.824656 31130 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:53.825067 31130 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:53.826124 31130 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.827567 30779 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.829348 31072 tablet_bootstrap.cc:654] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.831223 31073 tablet_bootstrap.cc:654] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.836099 31130 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:53.836460 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:53.865190 31252 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.892100 31074 tablet_bootstrap.cc:492] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:53.892547 31074 ts_tablet_manager.cc:1403] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.281s	user 0.010s	sys 0.023s
I20260709 13:13:53.893182 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.896862 31074 raft_consensus.cc:359] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.901579 31074 raft_consensus.cc:385] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.901962 31074 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.887645 31134 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:53.923261 31074 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:53.886719 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50370.9us
I20260709 13:13:53.922195 31134 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.944290 31134 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.949348 31074 ts_tablet_manager.cc:1434] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:13:53.952000 31172 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.952693 31172 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.956846 31074 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:53.955456 31172 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:53.903209 31252 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:53.969693 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:53.979585 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:53.980000 30954 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.980464 30955 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:53.980247 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:53.981084 30879 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:53.982576 31073 tablet_bootstrap.cc:492] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:53.983042 31073 ts_tablet_manager.cc:1403] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.258s	user 0.015s	sys 0.005s
I20260709 13:13:53.974423 30882 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:53.986326 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:53.987725 31135 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.987453 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:53.992250 31135 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:53.999342 31135 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.000100 31072 tablet_bootstrap.cc:492] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:54.000548 31072 ts_tablet_manager.cc:1403] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.257s	user 0.031s	sys 0.039s
I20260709 13:13:54.000376 31096 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.004089 31072 raft_consensus.cc:359] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.005056 31072 raft_consensus.cc:385] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.005543 31072 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.009522 31072 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.013127 31252 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.014271 31072 ts_tablet_manager.cc:1434] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:54.015519 31072 tablet_bootstrap.cc:492] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:54.021771 30954 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:54.023895 30924 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.025851 30924 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.025969 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:54.026609 31141 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:54.026744 31031 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:54.027281 31141 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.027735 31141 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:54.022245 31074 tablet_bootstrap.cc:654] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.032303 31141 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.046494 31073 raft_consensus.cc:359] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.047513 31073 raft_consensus.cc:385] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.048174 31073 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.050593 31073 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.052706 31134 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.056823 31073 ts_tablet_manager.cc:1434] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.002s
I20260709 13:13:54.062676 31073 tablet_bootstrap.cc:492] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
W20260709 13:13:54.063495 31260 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.099s	user 0.003s	sys 0.000s
I20260709 13:13:54.064967 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:54.066360 31106 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.066733 31106 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.067073 31106 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.067215 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:54.068704 31172 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.078544 31172 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.079107 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:54.080382 31172 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.088202 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.088964 30955 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:54.096007 31134 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.097343 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:54.097987 31031 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.109440 31072 tablet_bootstrap.cc:654] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.119954 31031 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:54.122991 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:54.101954 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.123746 31135 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.124233 31135 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:54.124444 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:54.125069 31135 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.125567 31172 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.126555 31106 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.127871 31252 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.129236 30881 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:54.133692 31074 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:54.134310 31074 ts_tablet_manager.cc:1403] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.184s	user 0.018s	sys 0.019s
I20260709 13:13:54.136399 31073 tablet_bootstrap.cc:654] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.141938 30780 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.143716 30780 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.146486 31074 raft_consensus.cc:359] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.147142 31074 raft_consensus.cc:385] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.147426 31074 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.149443 31252 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.142272 31106 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.159032 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:54.159870 31029 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:54.165390 31134 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.166884 31134 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.169309 31074 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.173151 31074 ts_tablet_manager.cc:1434] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:13:54.174196 31074 tablet_bootstrap.cc:492] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:54.175524 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:54.182941 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.184455 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:54.178992 31134 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.185233 31265 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.184666 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:54.190117 30924 leader_election.cc:343] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:54.191429 30923 leader_election.cc:343] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.191876 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.193230 31271 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.192675 30779 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.195289 31072 tablet_bootstrap.cc:492] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:54.195802 31072 ts_tablet_manager.cc:1403] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.004s
I20260709 13:13:54.196946 31073 tablet_bootstrap.cc:492] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:54.197371 31073 ts_tablet_manager.cc:1403] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.135s	user 0.007s	sys 0.005s
I20260709 13:13:54.200331 31074 tablet_bootstrap.cc:654] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.200671 31072 raft_consensus.cc:359] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.201372 31072 raft_consensus.cc:385] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.201648 31072 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.202316 31072 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.204715 31072 ts_tablet_manager.cc:1434] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:54.204975 31073 raft_consensus.cc:359] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.205658 31072 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:54.205623 31073 raft_consensus.cc:385] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.206107 31073 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.207991 31074 tablet_bootstrap.cc:492] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:54.208922 31074 ts_tablet_manager.cc:1403] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:13:54.208523 31073 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.211944 31072 tablet_bootstrap.cc:654] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.212832 31073 ts_tablet_manager.cc:1434] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:13:54.213330 31074 raft_consensus.cc:359] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.213778 31073 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:54.213901 31074 raft_consensus.cc:385] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.214262 31074 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.214890 31074 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.217362 31074 ts_tablet_manager.cc:1434] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:13:54.218870 31074 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:54.222302 31073 tablet_bootstrap.cc:654] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.261564 31172 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.265713 31172 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.285153 31074 tablet_bootstrap.cc:654] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.300539 31255 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.301704 31102 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.326344 31265 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.327420 31265 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.333916 31265 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.335366 31072 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:54.342922 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:54.343943 30882 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:54.345245 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:54.347122 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:54.350351 31102 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.350806 31102 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.351248 31102 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:54.353211 30848 leader_election.cc:343] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.348040 31072 ts_tablet_manager.cc:1403] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.143s	user 0.010s	sys 0.012s
I20260709 13:13:54.393229 31072 raft_consensus.cc:359] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.397081 31073 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:54.402446 31072 raft_consensus.cc:385] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.402608 31073 ts_tablet_manager.cc:1403] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.189s	user 0.050s	sys 0.037s
I20260709 13:13:54.398018 31102 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.403544 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.404937 30953 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:54.409675 31096 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.408967 31073 raft_consensus.cc:359] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.410490 31073 raft_consensus.cc:385] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.410857 31073 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.410398 31096 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.417402 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.420745 31072 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.425482 31265 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.425958 31265 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.422549 31102 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:54.428663 31265 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.430480 31073 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.430583 31072 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.437014 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:54.439633 31096 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:54.445036 31073 ts_tablet_manager.cc:1434] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:13:54.447508 30957 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.448361 31073 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:54.454466 31252 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.453516 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:54.457867 30882 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.460659 30957 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:54.466388 31031 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.467221 31172 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:54.505966 31265 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:54.534528 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 73216.9us
I20260709 13:13:54.535105 31074 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:54.535955 31074 ts_tablet_manager.cc:1403] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.317s	user 0.017s	sys 0.013s
I20260709 13:13:54.537532 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:54.538753 31172 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.536010 31072 ts_tablet_manager.cc:1434] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.180s	user 0.009s	sys 0.010s
I20260709 13:13:54.546332 31072 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:54.549083 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.549902 30953 raft_consensus.cc:2376] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1. Re-sending same reply.
I20260709 13:13:54.557036 31285 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:13:54.547442 30882 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:54.562033 31135 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.566200 31074 raft_consensus.cc:359] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.569722 31074 raft_consensus.cc:385] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.570001 31074 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.571056 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:54.573338 31172 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.576517 31172 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:13:54.576697 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:54.577603 31172 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.579193 31073 tablet_bootstrap.cc:654] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.583125 31074 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.572815 31265 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.588835 31074 ts_tablet_manager.cc:1434] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:13:54.590001 31074 tablet_bootstrap.cc:492] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:54.574811 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.618506 31072 tablet_bootstrap.cc:654] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.652623 30997 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:54.658116 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:54.659299 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:54.659965 30957 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.660843 31252 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.671036 31284 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.671682 31072 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:54.672137 31072 ts_tablet_manager.cc:1403] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.008s
I20260709 13:13:54.699142 31072 raft_consensus.cc:359] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.701030 31072 raft_consensus.cc:385] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.701362 31072 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
W20260709 13:13:54.695739 30848 leader_election.cc:343] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.703879 31072 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.705719 31138 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.705750 31291 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.706995 31291 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.707619 31135 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.709147 31291 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.709465 31135 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.712483 31074 tablet_bootstrap.cc:654] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.715902 31072 ts_tablet_manager.cc:1434] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.004s
I20260709 13:13:54.722230 31072 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:54.723564 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:54.727370 30924 leader_election.cc:343] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.743599 31073 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:54.744196 31073 ts_tablet_manager.cc:1403] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.296s	user 0.025s	sys 0.034s
I20260709 13:13:54.749243 31072 tablet_bootstrap.cc:654] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.752981 31181 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.753448 31181 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.755470 31181 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.757055 30957 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:54.760211 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:54.762861 30848 leader_election.cc:343] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.762926 31073 raft_consensus.cc:359] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.763522 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.763828 31073 raft_consensus.cc:385] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.764171 31073 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.764326 31181 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.765062 31181 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:54.765357 31073 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.768692 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.776602 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:54.769724 31073 ts_tablet_manager.cc:1434] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:13:54.778714 31073 tablet_bootstrap.cc:492] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:54.780237 31181 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.777262 31027 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:54.784801 31271 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.786720 31293 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.785633 30954 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:54.788965 31074 tablet_bootstrap.cc:492] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:54.789573 31074 ts_tablet_manager.cc:1403] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.200s	user 0.019s	sys 0.011s
I20260709 13:13:54.801775 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:54.799443 31074 raft_consensus.cc:359] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.804920 31074 raft_consensus.cc:385] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.805301 31074 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.808531 31293 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.808925 31293 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.809252 31293 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.816233 31074 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.841282 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.842638 31130 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.843015 31130 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.843351 31130 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.848757 31265 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.849277 31265 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.851337 31265 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.853930 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:54.855536 30848 leader_election.cc:343] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.852941 31130 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.829007 31293 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.859419 31293 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.859983 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:54.861507 30848 leader_election.cc:343] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.861498 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.862644 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:54.862972 31130 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:54.863231 30957 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.863974 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:54.864725 31029 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.871456 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:54.872644 31096 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.873096 31096 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:54.874558 30848 leader_election.cc:343] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.875022 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.876062 31130 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.876546 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:54.875180 31096 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:54.879570 30957 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
W20260709 13:13:54.880800 30924 leader_election.cc:343] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.884640 31074 ts_tablet_manager.cc:1434] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.004s
I20260709 13:13:54.888846 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:54.889516 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:54.890280 30957 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:54.890338 31130 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.890868 31130 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:54.891656 31074 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:54.899609 31073 tablet_bootstrap.cc:654] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.892228 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:54.903431 31172 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.891671 31130 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.894863 31029 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:54.932444 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:54.938161 31293 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.942333 31293 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:54.943327 31072 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:54.943148 31293 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.943804 31072 ts_tablet_manager.cc:1403] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.222s	user 0.051s	sys 0.040s
I20260709 13:13:54.949452 31172 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.949589 31074 tablet_bootstrap.cc:654] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.964809 31072 raft_consensus.cc:359] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.976305 31072 raft_consensus.cc:385] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.976593 31072 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.977226 31072 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.979419 31072 ts_tablet_manager.cc:1434] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:13:54.980460 31072 tablet_bootstrap.cc:492] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:54.962865 30780 catalog_manager.cc:5697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.985359 31073 tablet_bootstrap.cc:492] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:54.987221 31073 ts_tablet_manager.cc:1403] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.018s
I20260709 13:13:54.986243 31072 tablet_bootstrap.cc:654] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.990370 31074 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:54.990137 31073 raft_consensus.cc:359] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.990813 31074 ts_tablet_manager.cc:1403] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.010s
I20260709 13:13:54.990773 31073 raft_consensus.cc:385] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.991197 31073 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.992048 31073 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.994092 31073 ts_tablet_manager.cc:1434] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:54.993891 31074 raft_consensus.cc:359] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.994518 31074 raft_consensus.cc:385] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.994822 31074 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.995110 31073 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:54.995592 31074 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:54.997816 31074 ts_tablet_manager.cc:1434] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:54.998919 31074 tablet_bootstrap.cc:492] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.002945 31073 tablet_bootstrap.cc:654] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.006480 31074 tablet_bootstrap.cc:654] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.006925 31072 tablet_bootstrap.cc:492] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.007462 31072 ts_tablet_manager.cc:1403] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 13:13:55.010577 31072 raft_consensus.cc:359] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.011656 31072 raft_consensus.cc:385] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.012120 31072 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.013113 31072 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.015892 31072 ts_tablet_manager.cc:1434] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:55.017333 31072 tablet_bootstrap.cc:492] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.017765 31073 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.018359 31073 ts_tablet_manager.cc:1403] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.010s
I20260709 13:13:55.025475 31072 tablet_bootstrap.cc:654] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.021485 31073 raft_consensus.cc:359] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.039074 31072 tablet_bootstrap.cc:492] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.040623 31073 raft_consensus.cc:385] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.040952 31073 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.040285 31074 tablet_bootstrap.cc:492] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.041033 31072 ts_tablet_manager.cc:1403] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:13:55.041505 31074 ts_tablet_manager.cc:1403] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.015s
I20260709 13:13:55.041643 31073 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.043448 31073 ts_tablet_manager.cc:1434] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:13:55.044080 31074 raft_consensus.cc:359] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.044624 31073 tablet_bootstrap.cc:492] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.044348 31072 raft_consensus.cc:359] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.045133 31072 raft_consensus.cc:385] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.045469 31072 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.046175 31072 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.047713 31072 ts_tablet_manager.cc:1434] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:55.048769 31072 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.044801 31074 raft_consensus.cc:385] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.048045 30779 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.049185 31074 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.049998 31074 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.051771 31073 tablet_bootstrap.cc:654] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.052198 31074 ts_tablet_manager.cc:1434] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:55.053287 31074 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.062611 31074 tablet_bootstrap.cc:654] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.074250 31172 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.067436 31072 tablet_bootstrap.cc:654] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.066959 30777 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.080607 31074 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.081169 31074 ts_tablet_manager.cc:1403] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.005s
I20260709 13:13:55.083966 31181 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.091481 31181 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.091984 31073 tablet_bootstrap.cc:492] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.092451 31073 ts_tablet_manager.cc:1403] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.008s
I20260709 13:13:55.094694 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.095335 30954 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:55.095135 31073 raft_consensus.cc:359] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.096024 31073 raft_consensus.cc:385] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.096321 31073 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.097033 31073 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.099220 31073 ts_tablet_manager.cc:1434] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:55.085960 31074 raft_consensus.cc:359] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.101099 31074 raft_consensus.cc:385] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.101440 31074 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.102228 31074 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.103466 31073 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.103919 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:55.105805 31130 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.106189 31130 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.106498 31130 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.107527 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.108026 31074 ts_tablet_manager.cc:1434] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 13:13:55.108171 31031 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:55.109092 31074 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.117256 30780 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.118734 31102 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.119642 31072 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.120131 31072 ts_tablet_manager.cc:1403] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.001s
I20260709 13:13:55.105839 31181 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.126994 31073 tablet_bootstrap.cc:654] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.131201 31130 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.139047 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:55.139679 30957 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.141264 31293 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.141721 31293 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.144008 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:55.144587 31031 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.144959 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.145291 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.145612 30879 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:55.146863 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:13:55.147384 30923 leader_election.cc:343] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.148577 31141 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.148962 31141 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.149295 31141 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.149816 30957 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:55.151494 31031 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:55.151497 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:55.153258 31130 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.134253 31072 raft_consensus.cc:359] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.153908 31072 raft_consensus.cc:385] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.154302 31072 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.153913 31265 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.156358 31265 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:55.157138 31191 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.157207 31265 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.158843 31072 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.160581 31293 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.165290 31072 ts_tablet_manager.cc:1434] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.005s
I20260709 13:13:55.167315 31072 tablet_bootstrap.cc:492] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.170727 31074 tablet_bootstrap.cc:654] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.171895 31191 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.181339 31191 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.190528 31141 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.183701 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.185976 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.192925 30954 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:55.192927 30879 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:55.195091 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.195739 30881 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.195739 30997 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.199779 31073 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.200238 31073 ts_tablet_manager.cc:1403] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.026s
I20260709 13:13:55.201347 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:55.202567 30923 leader_election.cc:343] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.202196 31141 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.202941 31102 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.203429 31102 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.203799 31102 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.206768 30881 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:55.208184 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.208927 31293 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.209748 31293 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:55.211179 31293 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.218991 31074 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.221997 31074 ts_tablet_manager.cc:1403] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.009s
I20260709 13:13:55.220391 31073 raft_consensus.cc:359] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.220688 30777 catalog_manager.cc:5697] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.222661 31073 raft_consensus.cc:385] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.222963 31073 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.223588 31073 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.224995 31074 raft_consensus.cc:359] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.225672 31074 raft_consensus.cc:385] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.225992 31073 ts_tablet_manager.cc:1434] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:13:55.226018 31074 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.221350 31102 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.227173 31074 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.228747 31102 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.229832 31073 tablet_bootstrap.cc:492] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.229789 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.230489 30880 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.233399 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:55.234038 30957 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.234391 31074 ts_tablet_manager.cc:1434] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:55.221692 31072 tablet_bootstrap.cc:654] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.236596 31073 tablet_bootstrap.cc:654] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.238147 30880 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:55.239416 30998 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.240132 31102 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.240609 31102 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:55.241446 31102 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.243199 31074 tablet_bootstrap.cc:492] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.244869 31138 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.245395 31138 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.247560 31138 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.248216 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:55.250324 30924 leader_election.cc:343] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.252264 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.253026 31031 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:55.254160 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:55.255244 31138 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.255570 31138 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.255946 31138 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.262308 31074 tablet_bootstrap.cc:654] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.252614 30957 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:55.269632 31072 tablet_bootstrap.cc:492] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.270080 31072 ts_tablet_manager.cc:1403] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.006s
I20260709 13:13:55.262876 30780 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.272380 31072 raft_consensus.cc:359] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.273190 31072 raft_consensus.cc:385] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.273489 31072 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.274042 31072 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.271054 30777 catalog_manager.cc:5697] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.275533 31072 ts_tablet_manager.cc:1434] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:55.276322 31072 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.281875 31072 tablet_bootstrap.cc:654] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.284988 31074 tablet_bootstrap.cc:492] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.284875 31138 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.285427 31074 ts_tablet_manager.cc:1403] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 13:13:55.287027 31138 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.287555 31073 tablet_bootstrap.cc:492] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.287978 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:55.288059 31074 raft_consensus.cc:359] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.288626 31031 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.288833 31074 raft_consensus.cc:385] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.288910 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.289214 31074 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.289865 31074 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.287971 31073 ts_tablet_manager.cc:1403] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.005s
W20260709 13:13:55.292758 30924 leader_election.cc:343] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.293043 31031 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:55.295452 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:55.291901 31074 ts_tablet_manager.cc:1434] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:55.292174 31102 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:13:55.296440 31073 raft_consensus.cc:359] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.296684 31138 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.297158 31074 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.297124 31073 raft_consensus.cc:385] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.296720 31102 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.297509 31073 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.297463 31138 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:55.298316 31073 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.300137 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.299480 31138 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.308384 30880 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:13:55.309363 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.310137 31191 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:55.310539 31191 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:13:55.310890 31191 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.312885 31072 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.313320 31072 ts_tablet_manager.cc:1403] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:13:55.316309 31265 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.318224 31191 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.300488 31102 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.301441 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.322836 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.323419 30957 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:55.316332 31072 raft_consensus.cc:359] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.306615 31074 tablet_bootstrap.cc:654] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.328126 31072 raft_consensus.cc:385] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.328514 31072 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.329131 31072 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.329442 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:55.329542 30880 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:13:55.330271 30957 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:55.330695 31072 ts_tablet_manager.cc:1434] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:13:55.330897 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.331779 31191 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.331794 31102 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.300880 31073 ts_tablet_manager.cc:1434] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:55.332772 31102 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:55.333247 31073 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.333797 31102 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.331837 31072 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.343897 31031 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.344424 31072 tablet_bootstrap.cc:654] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.351912 31265 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.352566 30777 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.358785 31073 tablet_bootstrap.cc:654] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.361696 31130 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.362193 31130 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.365033 31252 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.371902 31074 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.372395 31074 ts_tablet_manager.cc:1403] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.002s
I20260709 13:13:55.376127 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.378916 31138 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.379657 31130 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.382444 31072 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.379652 31138 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.382869 31072 ts_tablet_manager.cc:1403] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.000s
I20260709 13:13:55.384331 31138 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.384929 30880 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.386108 31072 raft_consensus.cc:359] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.386775 31072 raft_consensus.cc:385] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.387032 31072 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.388036 31072 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.389521 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.389967 31072 ts_tablet_manager.cc:1434] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:13:55.390359 30881 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:55.390918 31072 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.394622 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:55.399384 30777 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.400213 31074 raft_consensus.cc:359] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.400868 31074 raft_consensus.cc:385] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.403651 31074 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.404174 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.404325 31074 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.405856 31074 ts_tablet_manager.cc:1434] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:13:55.405951 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.406661 31031 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:55.406852 31074 tablet_bootstrap.cc:492] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.408079 30848 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.415493 31138 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.415939 31138 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.416287 31138 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.417448 31291 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.425561 31138 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.432803 31138 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.487190 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.488090 30882 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.492095 31072 tablet_bootstrap.cc:654] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:55.494201 30923 leader_election.cc:343] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.498216 30882 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:55.506465 31191 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.506575 31265 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.507248 31191 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.509939 31191 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.512421 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.514348 30880 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:55.519389 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:55.520460 31291 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.521153 31291 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:55.522188 31291 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.489873 31074 tablet_bootstrap.cc:654] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.520481 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.524976 31191 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.525437 31191 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.525894 31191 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.535584 31134 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.545759 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:55.553722 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.559707 31074 tablet_bootstrap.cc:492] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.560372 31074 ts_tablet_manager.cc:1403] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.030s
I20260709 13:13:55.563102 31130 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:55.570078 31074 raft_consensus.cc:359] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.570813 31074 raft_consensus.cc:385] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.571081 31074 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.571714 31074 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:55.574222 30923 leader_election.cc:343] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.579305 31074 ts_tablet_manager.cc:1434] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:55.579519 31073 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.580106 31073 ts_tablet_manager.cc:1403] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.247s	user 0.086s	sys 0.098s
I20260709 13:13:55.580411 31074 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.573619 31191 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.582823 31073 raft_consensus.cc:359] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.583599 31073 raft_consensus.cc:385] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.583976 31073 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.584863 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.585467 30880 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.585052 31073 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.587913 31073 ts_tablet_manager.cc:1434] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:55.589088 31073 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.595485 31073 tablet_bootstrap.cc:654] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:55.597668 30997 leader_election.cc:343] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.601423 31191 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.610782 30880 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:55.617177 31074 tablet_bootstrap.cc:654] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.620942 31073 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.621522 31073 ts_tablet_manager.cc:1403] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.013s
I20260709 13:13:55.621074 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.631228 31191 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.631958 31191 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:55.633059 31191 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.636091 31073 raft_consensus.cc:359] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.636998 31073 raft_consensus.cc:385] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.637348 31073 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.623561 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:55.642169 31130 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:55.643187 30997 leader_election.cc:343] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.638185 31073 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.644073 31134 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.652076 31134 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.654073 31134 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.658859 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.667807 31252 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.668651 31252 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:55.672297 30923 leader_election.cc:343] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.672540 31073 ts_tablet_manager.cc:1434] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:13:55.673748 31073 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.678627 31072 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.679105 31072 ts_tablet_manager.cc:1403] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.288s	user 0.013s	sys 0.008s
I20260709 13:13:55.683008 31072 raft_consensus.cc:359] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.688390 31252 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.688676 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.689352 30880 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:55.690871 30924 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.683696 31072 raft_consensus.cc:385] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.686892 30778 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.692516 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.695595 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.696847 31291 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.697472 31291 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.698361 31291 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.699110 30780 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.691555 31072 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
W20260709 13:13:55.702018 30848 leader_election.cc:343] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.704195 31072 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:55.704847 30848 leader_election.cc:343] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.705180 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.709100 31350 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.717962 31191 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.718703 31191 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.721061 31191 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:55.721725 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.716512 31252 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:13:55.722209 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.722543 30881 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:55.724195 30998 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:55.724848 31072 ts_tablet_manager.cc:1434] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:13:55.725414 31096 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.727936 31072 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.725736 31102 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.741779 31096 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.743726 31255 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:55.750674 31074 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.751178 31074 ts_tablet_manager.cc:1403] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.171s	user 0.007s	sys 0.009s
I20260709 13:13:55.754212 31074 raft_consensus.cc:359] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.754765 31074 raft_consensus.cc:385] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.755010 31074 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.761195 31073 tablet_bootstrap.cc:654] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.761888 31072 tablet_bootstrap.cc:654] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.755610 31074 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.766261 31291 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.772046 31291 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.772145 31134 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.773337 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:55.775033 30923 leader_election.cc:343] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.775384 31074 ts_tablet_manager.cc:1434] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:13:55.776201 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:55.776428 31074 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.776746 30881 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:55.781944 30924 consensus_peers.cc:597] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.791528 30881 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:55.794864 30924 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.797528 31072 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.801084 31072 ts_tablet_manager.cc:1403] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.001s
I20260709 13:13:55.805801 31134 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.806777 31072 raft_consensus.cc:359] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.807687 31072 raft_consensus.cc:385] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.814379 31072 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.814996 31072 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.815666 31291 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:55.817730 31291 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:55.817121 31072 ts_tablet_manager.cc:1434] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:13:55.812904 31073 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:55.819413 31073 ts_tablet_manager.cc:1403] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.021s
I20260709 13:13:55.820604 31072 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.828567 31074 tablet_bootstrap.cc:654] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.832060 31073 raft_consensus.cc:359] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.832888 31073 raft_consensus.cc:385] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.833241 31073 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.834194 31073 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.829052 31135 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.839063 31135 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.841073 31073 ts_tablet_manager.cc:1434] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:13:55.842381 31073 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:55.842883 31291 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.845103 31135 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.846728 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:55.854967 30924 leader_election.cc:343] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:55.858660 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.875864 30956 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.878933 31096 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.883172 31073 tablet_bootstrap.cc:654] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:55.886663 30923 leader_election.cc:343] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:55.887251 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:55.887120 30923 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.888751 31138 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.896832 31072 tablet_bootstrap.cc:654] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:55.903892 31074 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:55.904372 31074 ts_tablet_manager.cc:1403] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.044s
I20260709 13:13:55.905333 31138 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:55.918016 31074 raft_consensus.cc:359] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.918789 31074 raft_consensus.cc:385] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.919143 31074 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.919987 31074 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.922220 31074 ts_tablet_manager.cc:1434] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:13:55.936941 31134 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.939158 30778 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.936437 31350 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.957489 31350 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.958519 31072 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:55.959002 31072 ts_tablet_manager.cc:1403] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.139s	user 0.008s	sys 0.002s
I20260709 13:13:55.961928 31072 raft_consensus.cc:359] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.962628 31072 raft_consensus.cc:385] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:55.962903 31072 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:55.963901 31074 tablet_bootstrap.cc:492] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:55.948084 31134 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:55.951424 30923 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.959489 31350 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.968703 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.973140 31134 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:55.976971 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:55.977648 31032 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:55.978226 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:55.981348 30848 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:55.983402 30882 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.963873 31072 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:55.984886 31072 ts_tablet_manager.cc:1434] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:13:55.984987 31255 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.989955 31072 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:55.986470 30923 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:55.991976 31135 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:55.992415 31135 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.992830 31135 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:55.986537 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:55.987905 31130 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:55.994185 30880 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:55.985296 31291 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.019516 31073 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.020138 31073 ts_tablet_manager.cc:1403] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.178s	user 0.044s	sys 0.051s
I20260709 13:13:56.022765 31135 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.024385 31072 tablet_bootstrap.cc:654] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.026368 31074 tablet_bootstrap.cc:654] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.039489 31073 raft_consensus.cc:359] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.040455 31073 raft_consensus.cc:385] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.040721 31073 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.041321 31073 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.044384 31073 ts_tablet_manager.cc:1434] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:13:56.049862 31135 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.050827 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:56.051440 30879 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.051344 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.052023 31027 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.055330 31255 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.056155 31073 tablet_bootstrap.cc:492] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.055907 31255 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.060089 31072 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.060243 30957 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.060647 31072 ts_tablet_manager.cc:1403] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.002s
I20260709 13:13:56.063532 31072 raft_consensus.cc:359] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.065337 31072 raft_consensus.cc:385] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.065671 31072 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.066401 31072 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.068658 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.070468 31072 ts_tablet_manager.cc:1434] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:56.064019 31255 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:56.074586 31130 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.075124 31130 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.075933 31291 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.076399 31291 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.073623 31073 tablet_bootstrap.cc:654] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.075606 31072 tablet_bootstrap.cc:492] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
W20260709 13:13:56.073997 30997 leader_election.cc:343] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.078820 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.091117 31074 tablet_bootstrap.cc:492] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.091641 31074 ts_tablet_manager.cc:1403] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.009s
I20260709 13:13:56.091881 31072 tablet_bootstrap.cc:654] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:56.091941 30848 leader_election.cc:343] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.094540 31074 raft_consensus.cc:359] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.095264 31074 raft_consensus.cc:385] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.095588 31074 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.079548 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.080626 31291 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.081832 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.084394 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.096642 30954 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:56.096779 30881 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:56.084496 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.098053 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:13:56.098532 30998 leader_election.cc:343] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.098848 31350 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.098941 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:56.099263 31350 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.099632 31350 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.089283 31073 tablet_bootstrap.cc:492] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.088469 30879 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:56.100724 31073 ts_tablet_manager.cc:1403] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.005s
I20260709 13:13:56.100821 30924 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:56.102349 31074 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.103484 31135 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:56.103904 31135 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.103619 31073 raft_consensus.cc:359] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.099606 31255 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.104269 31135 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.104341 31073 raft_consensus.cc:385] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.104859 31073 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.089826 31102 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:13:56.105649 31073 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.106074 31074 ts_tablet_manager.cc:1434] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:13:56.077389 31130 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.107206 31074 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:56.107957 31073 ts_tablet_manager.cc:1434] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:56.108330 31027 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:56.108875 31073 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.111418 30924 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:56.112165 31291 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.112617 31291 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:56.113425 31291 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.114951 31073 tablet_bootstrap.cc:654] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.123435 31074 tablet_bootstrap.cc:654] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.128863 31102 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.133687 31350 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.134805 31073 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.135293 31073 ts_tablet_manager.cc:1403] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:13:56.148849 31074 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.137225 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.149456 31074 ts_tablet_manager.cc:1403] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
W20260709 13:13:56.150192 30848 leader_election.cc:343] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.145895 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:56.151160 30954 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.153105 31074 raft_consensus.cc:359] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.153852 31074 raft_consensus.cc:385] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.154165 31074 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.138057 31073 raft_consensus.cc:359] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.154881 31073 raft_consensus.cc:385] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.155222 31073 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.154961 31074 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.155895 31073 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.157486 31074 ts_tablet_manager.cc:1434] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:56.158231 31073 ts_tablet_manager.cc:1434] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:13:56.135737 31350 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.162560 30954 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:56.163870 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.162919 30780 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.165582 31130 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.166060 31130 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:56.166564 31073 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.144160 31135 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.166926 31130 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.167466 30957 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:56.168864 31135 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.173636 31072 tablet_bootstrap.cc:492] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.174068 31072 ts_tablet_manager.cc:1403] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.010s
I20260709 13:13:56.175442 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:56.176695 31072 raft_consensus.cc:359] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.177416 31072 raft_consensus.cc:385] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.178045 31072 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.178751 31072 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.180210 31073 tablet_bootstrap.cc:654] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.181552 31072 ts_tablet_manager.cc:1434] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:56.182286 31255 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.183025 31255 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:56.183342 31255 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:56.184152 31255 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.184795 31072 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.185214 31255 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:56.190254 31291 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.190650 31135 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.190946 31291 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.191293 31135 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.193614 31291 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.194751 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.194947 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.195390 30879 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:56.196640 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:13:56.197439 30924 leader_election.cc:343] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.198081 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:56.198786 31291 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.199148 31291 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.199481 31291 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.198086 31072 tablet_bootstrap.cc:654] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.203899 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:56.207870 30923 leader_election.cc:343] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.208328 30923 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.209431 31134 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.209879 31029 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:13:56.211050 31291 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.212397 30880 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.213044 30923 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.213605 31073 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.213959 31134 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:56.214059 31073 ts_tablet_manager.cc:1403] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.010s
I20260709 13:13:56.216897 31074 tablet_bootstrap.cc:492] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:56.217006 31073 raft_consensus.cc:359] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.217907 31073 raft_consensus.cc:385] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.218164 31073 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.218899 31073 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.220744 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.221449 31029 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:56.221814 31073 ts_tablet_manager.cc:1434] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:56.222878 31073 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.219218 31135 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.226022 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:56.226327 31291 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.226647 30879 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.227473 31255 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.229682 31073 tablet_bootstrap.cc:654] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.231346 31350 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.232442 31255 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.232479 31350 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.235416 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.236001 31029 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.237548 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.238123 31031 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:56.235587 31350 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.257236 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.262290 31073 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.262961 31073 ts_tablet_manager.cc:1403] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.007s
I20260709 13:13:56.263376 30954 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:56.266855 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.267060 31073 raft_consensus.cc:359] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.267587 31181 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.267978 31073 raft_consensus.cc:385] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.268044 31181 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.268499 31073 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.268569 31181 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.263301 30879 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:56.271417 31073 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.274076 31073 ts_tablet_manager.cc:1434] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:56.274351 31029 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:56.275401 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.276258 31291 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.276870 31291 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:56.277922 31291 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.275420 31073 tablet_bootstrap.cc:492] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.286077 31181 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.289415 31073 tablet_bootstrap.cc:654] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.289971 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:56.290603 30954 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.292214 31181 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.294726 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.295503 31029 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.304993 30780 catalog_manager.cc:5697] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.309161 30954 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:56.313138 31029 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:56.315105 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.316341 31252 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.316920 31252 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:56.317929 31252 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.324379 31074 tablet_bootstrap.cc:654] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.329190 31072 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.329655 31072 ts_tablet_manager.cc:1403] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.147s	user 0.030s	sys 0.031s
I20260709 13:13:56.331426 31031 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.332326 31072 raft_consensus.cc:359] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.333218 31072 raft_consensus.cc:385] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.333549 31072 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.334318 31072 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.331455 31255 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:56.339953 31291 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.344223 31135 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.346309 31072 ts_tablet_manager.cc:1434] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:13:56.349188 31072 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.346740 31073 tablet_bootstrap.cc:492] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.350445 31028 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.352826 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.360119 31073 ts_tablet_manager.cc:1403] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.013s
I20260709 13:13:56.365465 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.379014 30998 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:56.382181 31252 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.386370 31252 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.382565 30780 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.388464 31252 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.388550 30780 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.390532 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.385761 31072 tablet_bootstrap.cc:654] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.392576 31074 tablet_bootstrap.cc:492] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.393028 31074 ts_tablet_manager.cc:1403] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.177s	user 0.008s	sys 0.009s
I20260709 13:13:56.394819 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:13:56.391903 30848 leader_election.cc:343] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.395651 30954 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:56.396724 31384 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.399281 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.400061 31252 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.400491 31252 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.400800 31252 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.400849 31130 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.401383 31130 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.404466 31130 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.406860 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.408618 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:13:56.409085 30848 leader_election.cc:343] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:56.409772 30848 leader_election.cc:343] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.410128 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.411639 31181 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.416265 31252 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.423971 31252 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.424605 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:56.425357 30954 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.426738 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.427536 31074 raft_consensus.cc:359] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.428426 31074 raft_consensus.cc:385] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.428784 31074 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.429473 31074 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:56.429947 30848 leader_election.cc:343] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.431841 31074 ts_tablet_manager.cc:1434] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:13:56.432730 31074 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:56.428082 31073 raft_consensus.cc:359] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.436017 31073 raft_consensus.cc:385] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.437021 31073 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.449046 31072 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.449213 30954 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:56.449575 31072 ts_tablet_manager.cc:1403] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.101s	user 0.003s	sys 0.018s
I20260709 13:13:56.450322 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.450548 31073 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.452935 31181 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.454697 31181 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:56.455164 31074 tablet_bootstrap.cc:654] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.455550 31181 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.458964 31072 raft_consensus.cc:359] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.459646 31072 raft_consensus.cc:385] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.459939 31072 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.460278 31073 ts_tablet_manager.cc:1434] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.003s
I20260709 13:13:56.461323 31073 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.461148 31072 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.463171 31072 ts_tablet_manager.cc:1434] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 13:13:56.466144 31072 tablet_bootstrap.cc:492] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.467811 31073 tablet_bootstrap.cc:654] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.473519 31072 tablet_bootstrap.cc:654] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.480212 31074 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.483239 31074 ts_tablet_manager.cc:1403] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:13:56.483893 31073 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.484397 31073 ts_tablet_manager.cc:1403] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:13:56.486083 31384 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.486562 31384 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.488641 31384 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:56.490036 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.490689 30881 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:56.491966 30998 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.492962 31384 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.493409 31384 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.493803 31384 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.495142 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.496145 30780 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.497251 31072 tablet_bootstrap.cc:492] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.497712 31072 ts_tablet_manager.cc:1403] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.006s
W20260709 13:13:56.497987 30997 leader_election.cc:343] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.501032 31073 raft_consensus.cc:359] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.501230 31072 raft_consensus.cc:359] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.501705 31073 raft_consensus.cc:385] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.501811 31072 raft_consensus.cc:385] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.502054 31073 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.502084 31072 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.503088 31073 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.503194 31072 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.505265 31073 ts_tablet_manager.cc:1434] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:13:56.505283 31072 ts_tablet_manager.cc:1434] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:56.506331 31072 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.507015 31074 raft_consensus.cc:359] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.507671 31074 raft_consensus.cc:385] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.508018 31074 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.508704 31074 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.507512 31384 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.511648 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:56.512111 31072 tablet_bootstrap.cc:654] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.512178 30881 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.506331 31073 tablet_bootstrap.cc:492] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.526984 31072 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.527510 31072 ts_tablet_manager.cc:1403] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 13:13:56.529536 31074 ts_tablet_manager.cc:1434] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:13:56.530027 31072 raft_consensus.cc:359] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.530700 31072 raft_consensus.cc:385] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.530958 31072 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.531714 31072 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.532106 31252 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.532601 31252 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.534077 31072 ts_tablet_manager.cc:1434] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:56.534534 31252 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.535305 31072 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.536484 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.537151 31028 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:56.537437 31073 tablet_bootstrap.cc:654] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.538183 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.538993 31252 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.539394 31252 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.539795 31252 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.536509 31074 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:56.541509 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.542095 30954 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:56.546073 31384 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:56.547039 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:56.547622 30954 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.550802 31252 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.553309 30881 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:56.557678 30954 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:56.560552 31252 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.561554 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.562052 31028 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.564340 31072 tablet_bootstrap.cc:654] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.564194 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.566304 31384 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.566781 31384 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:56.567551 31384 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.568161 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:56.568876 30954 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.570518 31028 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:56.572211 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.573539 31252 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.574008 31135 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.575080 31252 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:56.576009 31252 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.586572 31072 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.587101 31072 ts_tablet_manager.cc:1403] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.010s
I20260709 13:13:56.591518 31073 tablet_bootstrap.cc:492] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.592667 30777 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:56.594875 31138 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.598948 31074 tablet_bootstrap.cc:654] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.602632 31073 ts_tablet_manager.cc:1403] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.001s
I20260709 13:13:56.595052 30954 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:56.606567 30778 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:56.632015 31072 raft_consensus.cc:359] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.632951 31072 raft_consensus.cc:385] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.633291 31072 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.635027 31072 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.637392 31073 raft_consensus.cc:359] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.637909 31072 ts_tablet_manager.cc:1434] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260709 13:13:56.638387 31073 raft_consensus.cc:385] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.638697 31073 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.639626 31073 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.639977 31072 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.647153 31073 ts_tablet_manager.cc:1434] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:13:56.650830 31073 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.652515 31138 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.653225 31138 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.655215 31138 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.656392 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.657968 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:56.658294 30924 leader_election.cc:343] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:56.659333 30923 leader_election.cc:343] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.659714 30923 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:56.661125 31138 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:56.667047 31074 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.667088 31073 tablet_bootstrap.cc:654] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.667580 31074 ts_tablet_manager.cc:1403] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.035s
I20260709 13:13:56.670221 31074 raft_consensus.cc:359] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.670912 31074 raft_consensus.cc:385] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.671166 31074 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.671922 31074 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.674007 31074 ts_tablet_manager.cc:1434] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:13:56.674990 31074 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:56.676461 31072 tablet_bootstrap.cc:654] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.678550 31073 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.679008 31073 ts_tablet_manager.cc:1403] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:13:56.681674 31074 tablet_bootstrap.cc:654] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.681689 31073 raft_consensus.cc:359] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.682562 31073 raft_consensus.cc:385] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.682823 31073 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.683552 31073 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.685935 31073 ts_tablet_manager.cc:1434] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:56.688199 31072 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.688827 31072 ts_tablet_manager.cc:1403] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.004s
I20260709 13:13:56.692042 31135 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.692413 31072 raft_consensus.cc:359] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.693368 31072 raft_consensus.cc:385] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.693714 31072 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.694684 31072 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.697503 31072 ts_tablet_manager.cc:1434] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:56.698705 31072 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.703200 31074 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.707096 31074 ts_tablet_manager.cc:1403] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.012s
I20260709 13:13:56.713565 31073 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:56.714298 31074 raft_consensus.cc:359] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.714972 31074 raft_consensus.cc:385] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.715221 31074 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.715896 31074 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.718083 31072 tablet_bootstrap.cc:654] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.720010 31073 tablet_bootstrap.cc:654] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.720956 31255 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.721405 31255 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.715742 31252 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:13:56.722946 31138 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:56.723279 31255 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:56.724687 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.724996 31074 ts_tablet_manager.cc:1434] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:13:56.726011 31074 tablet_bootstrap.cc:492] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:56.725894 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:56.726692 30954 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:56.729995 31135 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.730755 31135 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.732882 31135 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:56.736747 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.737502 30997 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:56.740123 31074 tablet_bootstrap.cc:654] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.742573 31385 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.750545 31385 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:56.741858 30924 leader_election.cc:343] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.763552 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:56.772099 31028 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:56.773870 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:56.774982 31291 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:56.775421 31291 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.775842 31291 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.787504 31252 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:56.792750 31291 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.795976 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:56.796550 31031 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:56.796872 30848 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.800246 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:56.803196 31031 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:56.805347 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:56.807498 31135 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.807991 31135 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:56.808780 31135 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.827064 31291 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:13:56.828696 30924 leader_election.cc:343] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:56.838531 31271 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.844132 31291 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.836300 31130 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:13:56.855728 31072 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:56.856253 31072 ts_tablet_manager.cc:1403] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.044s
I20260709 13:13:56.861896 31074 tablet_bootstrap.cc:492] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:56.852658 31271 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.862380 31074 ts_tablet_manager.cc:1403] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.137s	user 0.030s	sys 0.016s
I20260709 13:13:56.862908 31072 raft_consensus.cc:359] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.863583 31072 raft_consensus.cc:385] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.864720 31072 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.869786 31073 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:56.870225 31073 ts_tablet_manager.cc:1403] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.157s	user 0.043s	sys 0.065s
I20260709 13:13:56.867606 31072 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:56.874265 31058 tablet.cc:2406] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:56.882413 31072 ts_tablet_manager.cc:1434] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:13:56.855702 31291 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.881170 31181 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:13:56.933831 31072 tablet_bootstrap.cc:492] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:56.961279 31074 raft_consensus.cc:359] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.962283 31074 raft_consensus.cc:385] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.962620 31074 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
W20260709 13:13:56.968497 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 84394.9us
I20260709 13:13:56.971480 31073 raft_consensus.cc:359] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.972534 31073 raft_consensus.cc:385] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.972867 31073 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.977154 31074 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:56.981762 31073 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:56.988863 31414 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:13:56.994072 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:56.994841 30881 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:56.996984 31074 ts_tablet_manager.cc:1434] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.134s	user 0.006s	sys 0.003s
I20260709 13:13:57.001447 31252 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.010674 31074 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.011060 31073 ts_tablet_manager.cc:1434] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.141s	user 0.012s	sys 0.002s
I20260709 13:13:57.012318 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:57.014457 31073 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.008443 31252 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.021545 31271 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.022044 31252 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.015798 31291 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.052074 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.055295 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.058111 30883 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:57.053644 31384 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:57.065788 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:57.070180 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:57.070976 31427 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:57.077073 30848 leader_election.cc:343] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.068298 31384 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.075891 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:57.088507 31027 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:57.088865 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.090528 30881 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:57.090974 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:57.091502 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:57.092285 31428 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.092351 31417 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.092660 31428 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.092778 31417 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.093043 31428 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.093146 31417 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.095562 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:57.087067 30779 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.111248 31427 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.111836 31427 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.113850 31424 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.121119 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:57.122638 31421 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.123126 31425 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.123543 31425 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.127650 31291 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.128371 31291 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.124410 31425 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.128770 31291 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:57.128302 30923 leader_election.cc:343] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.131678 31427 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:13:57.132694 30923 leader_election.cc:343] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.132776 31384 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.127521 31072 tablet_bootstrap.cc:654] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.134027 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:57.138370 30848 leader_election.cc:343] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.145928 31074 tablet_bootstrap.cc:654] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.146003 31425 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.153726 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:57.156602 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.161777 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.162397 30952 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:57.154677 31425 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.166350 31428 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.167438 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:57.171141 31385 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.172371 31031 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:57.177457 31073 tablet_bootstrap.cc:654] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.143676 31291 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.183058 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:57.179519 31417 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.185359 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:57.186098 30882 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:57.180912 31291 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.189077 31428 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.191107 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:57.191953 31426 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.192287 31426 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.193030 31426 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:57.198057 30923 leader_election.cc:343] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.200168 31426 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:57.216615 30848 leader_election.cc:343] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.217311 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:57.219353 31424 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.222740 31426 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.224318 31074 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.224823 31074 ts_tablet_manager.cc:1403] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.220s	user 0.018s	sys 0.013s
I20260709 13:13:57.227944 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:57.233680 31072 tablet_bootstrap.cc:492] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:57.234134 31072 ts_tablet_manager.cc:1403] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.312s	user 0.013s	sys 0.004s
W20260709 13:13:57.234779 30848 leader_election.cc:343] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.236876 31072 raft_consensus.cc:359] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.237222 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:57.237582 31072 raft_consensus.cc:385] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.237824 30883 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:57.237891 30997 leader_election.cc:343] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.241870 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:57.243080 31074 raft_consensus.cc:359] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.243708 31074 raft_consensus.cc:385] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.243984 31074 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.237905 31072 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.245564 31072 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.246569 31074 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:57.247072 30923 leader_election.cc:343] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.249188 31072 ts_tablet_manager.cc:1434] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:13:57.250118 31072 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:57.250679 30883 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:57.255576 31417 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.256625 31074 ts_tablet_manager.cc:1434] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:13:57.257555 31074 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.262960 31074 tablet_bootstrap.cc:654] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.255617 31072 tablet_bootstrap.cc:654] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.267359 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:57.271231 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:57.271793 30952 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.281781 30952 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:57.283670 31072 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:57.284184 31073 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.284226 31072 ts_tablet_manager.cc:1403] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.006s
I20260709 13:13:57.284783 31073 ts_tablet_manager.cc:1403] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.271s	user 0.033s	sys 0.025s
I20260709 13:13:57.287389 31073 raft_consensus.cc:359] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:57.289822 30997 leader_election.cc:343] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:57.290036 31073 raft_consensus.cc:385] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.289976 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:57.290459 31073 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.290663 30883 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.290877 31424 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.291186 31073 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.292237 30997 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:57.293280 31073 ts_tablet_manager.cc:1434] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:57.293668 31385 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.294654 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:57.295739 31415 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.296216 31415 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:57.296977 31415 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.301244 31073 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.302393 31291 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:57.312321 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:57.313097 31073 tablet_bootstrap.cc:654] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.289027 31072 raft_consensus.cc:359] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.287724 31074 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.314823 31074 ts_tablet_manager.cc:1403] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.010s
I20260709 13:13:57.317690 31074 raft_consensus.cc:359] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.318342 31074 raft_consensus.cc:385] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.318599 31074 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.319186 31074 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.320777 31074 ts_tablet_manager.cc:1434] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:57.321679 31074 tablet_bootstrap.cc:492] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.324772 30883 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:57.325538 31072 raft_consensus.cc:385] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.325829 31072 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.326462 31072 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.327270 31425 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.333298 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:57.338689 31425 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:57.339290 31417 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.339561 31425 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.338658 31073 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.344950 31073 ts_tablet_manager.cc:1403] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.015s
I20260709 13:13:57.346158 31417 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:57.347010 31417 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.338166 31074 tablet_bootstrap.cc:654] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.347512 31073 raft_consensus.cc:359] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.354079 31073 raft_consensus.cc:385] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.354365 31073 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.354943 31073 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.356673 30883 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.357241 31073 ts_tablet_manager.cc:1434] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:57.358377 31073 tablet_bootstrap.cc:492] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.361490 31074 tablet_bootstrap.cc:492] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.362108 31072 ts_tablet_manager.cc:1434] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.001s
I20260709 13:13:57.362630 31074 ts_tablet_manager.cc:1403] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 13:13:57.363412 31072 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:57.367100 31073 tablet_bootstrap.cc:654] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.366009 31074 raft_consensus.cc:359] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.371723 31074 raft_consensus.cc:385] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.372680 31074 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.374022 31074 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.378509 31074 ts_tablet_manager.cc:1434] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:13:57.381068 31074 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.380787 30777 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.390009 31422 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:57.396332 31072 tablet_bootstrap.cc:654] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.396324 31073 tablet_bootstrap.cc:492] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.396636 31074 tablet_bootstrap.cc:654] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.397022 31073 ts_tablet_manager.cc:1403] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.007s
I20260709 13:13:57.403453 31073 raft_consensus.cc:359] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.405787 31073 raft_consensus.cc:385] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.406164 31073 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.406926 31073 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.409358 31073 ts_tablet_manager.cc:1434] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:57.416285 31428 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.416848 31428 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.418274 31073 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.418817 31428 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.424046 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.424625 31073 tablet_bootstrap.cc:654] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.424466 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.425251 30880 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:57.426457 30998 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:57.427150 31428 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.427456 31074 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.427947 31074 ts_tablet_manager.cc:1403] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.006s
I20260709 13:13:57.429656 30778 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.430611 31074 raft_consensus.cc:359] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.431269 31074 raft_consensus.cc:385] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.431540 31074 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.432221 31074 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.432652 30777 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.434315 31074 ts_tablet_manager.cc:1434] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:57.435705 31074 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.436527 31072 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:57.437793 31072 ts_tablet_manager.cc:1403] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.002s
I20260709 13:13:57.440661 31072 raft_consensus.cc:359] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.437232 31428 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.441406 31074 tablet_bootstrap.cc:654] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.441844 31072 raft_consensus.cc:385] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.442206 31072 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.443513 31072 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.450419 31073 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.451100 31073 ts_tablet_manager.cc:1403] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.008s
I20260709 13:13:57.449575 31072 ts_tablet_manager.cc:1434] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:57.455327 31072 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:57.463327 31072 tablet_bootstrap.cc:654] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.466054 31073 raft_consensus.cc:359] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.473348 31073 raft_consensus.cc:385] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.473690 31073 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.475366 31074 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.474757 31073 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.476140 31074 ts_tablet_manager.cc:1403] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.013s
I20260709 13:13:57.477545 31073 ts_tablet_manager.cc:1434] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:13:57.478653 31073 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.478991 31074 raft_consensus.cc:359] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.479650 31074 raft_consensus.cc:385] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.479934 31074 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.480629 31074 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.482730 31074 ts_tablet_manager.cc:1434] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:57.486227 31074 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.495519 31074 tablet_bootstrap.cc:654] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.499053 31073 tablet_bootstrap.cc:654] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.500491 31072 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:57.500972 31072 ts_tablet_manager.cc:1403] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.003s
I20260709 13:13:57.502974 31072 raft_consensus.cc:359] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.503569 31072 raft_consensus.cc:385] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.503877 31072 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.504518 31072 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.506121 31073 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.506438 31074 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.506565 31072 ts_tablet_manager.cc:1434] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:57.506559 31073 ts_tablet_manager.cc:1403] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:13:57.506822 31074 ts_tablet_manager.cc:1403] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.007s
I20260709 13:13:57.507951 31072 tablet_bootstrap.cc:492] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:57.509944 31073 raft_consensus.cc:359] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.510540 31073 raft_consensus.cc:385] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.510748 31073 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.511305 31073 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.513339 31073 ts_tablet_manager.cc:1434] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:57.513684 31072 tablet_bootstrap.cc:654] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.514267 31073 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.516472 31074 raft_consensus.cc:359] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.516985 31074 raft_consensus.cc:385] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.517200 31074 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.517594 31074 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.519264 31074 ts_tablet_manager.cc:1434] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.000s
I20260709 13:13:57.523612 31073 tablet_bootstrap.cc:654] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.524279 31072 tablet_bootstrap.cc:492] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:57.524717 31072 ts_tablet_manager.cc:1403] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:13:57.526239 31074 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.532004 31074 tablet_bootstrap.cc:654] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.532648 31072 raft_consensus.cc:359] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.533308 31072 raft_consensus.cc:385] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.533546 31072 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.534111 31072 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.536159 31072 ts_tablet_manager.cc:1434] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:57.537086 31072 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:57.543507 31426 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.543948 31426 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.545837 31426 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.547852 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.548477 30952 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:57.549595 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:57.550320 31426 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.550676 31426 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.551015 31426 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.548477 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:57.552552 31031 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:57.558334 31426 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.559270 31074 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.559681 31074 ts_tablet_manager.cc:1403] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.008s
I20260709 13:13:57.560189 31426 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.560811 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:57.561362 30952 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.562247 31072 tablet_bootstrap.cc:654] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.562331 31074 raft_consensus.cc:359] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.563000 31074 raft_consensus.cc:385] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.563259 31074 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.565510 31074 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.567646 31074 ts_tablet_manager.cc:1434] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 13:13:57.567586 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:57.568142 31031 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.568605 31074 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.571799 31385 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.572294 31385 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.573051 30952 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:57.575457 31073 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.575909 31073 ts_tablet_manager.cc:1403] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.005s
I20260709 13:13:57.576771 31074 tablet_bootstrap.cc:654] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.578505 31073 raft_consensus.cc:359] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.579156 31073 raft_consensus.cc:385] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.579473 31073 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.581271 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:57.581631 31031 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:57.593978 31426 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.594204 31385 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.595387 31426 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:57.581825 31073 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.596294 31426 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.598333 31073 ts_tablet_manager.cc:1434] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:57.598851 31385 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.592211 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.599390 31385 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.599346 31073 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:57.590003 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.602897 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.603541 30882 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:57.582142 31072 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:57.605118 31072 ts_tablet_manager.cc:1403] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 13:13:57.605688 31385 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.606858 31073 tablet_bootstrap.cc:654] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.608573 31072 raft_consensus.cc:359] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.609333 31072 raft_consensus.cc:385] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.591084 31074 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:57.610186 31072 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.610621 31074 ts_tablet_manager.cc:1403] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.006s
I20260709 13:13:57.611007 30997 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:57.612716 31072 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.614832 31385 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.616472 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.620942 31072 ts_tablet_manager.cc:1434] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:13:57.624854 30997 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:57.629268 31074 raft_consensus.cc:359] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.629846 31074 raft_consensus.cc:385] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.630088 31074 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.629428 31384 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.630707 31074 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.637773 31074 ts_tablet_manager.cc:1434] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:13:57.640012 31072 tablet_bootstrap.cc:492] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:57.636272 31423 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.661059 31074 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:57.662168 31423 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.678076 31423 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.730504 31425 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:13:57.724134 31385 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.801434 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:57.803066 31031 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:57.795198 31417 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.822651 31073 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:57.823144 31073 ts_tablet_manager.cc:1403] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.224s	user 0.034s	sys 0.015s
I20260709 13:13:57.732679 31425 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.810429 31385 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.823287 31417 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.839843 31384 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.862771 31385 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.864033 31073 raft_consensus.cc:359] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.864782 31073 raft_consensus.cc:385] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.865038 31417 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.866254 31072 tablet_bootstrap.cc:654] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.867846 31073 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.868489 31073 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.872344 31424 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.874205 31424 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.876235 31074 tablet_bootstrap.cc:654] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.875658 30779 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.861096 31425 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:13:57.928135 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51930.4us
I20260709 13:13:57.930358 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.931054 30881 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:57.938094 31073 ts_tablet_manager.cc:1434] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.115s	user 0.005s	sys 0.001s
I20260709 13:13:57.940703 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:57.942309 30956 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:57.950459 31428 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.950933 31428 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:57.952479 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:57.979537 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.941311 31472 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.943287 31424 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:57.953009 31428 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:57.939342 31426 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.953090 31030 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:13:57.978595 31291 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.977882 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:57.991986 31073 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:58.000331 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.001858 30881 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:58.003638 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:58.005244 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:13:58.022336 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 84931.4us
I20260709 13:13:58.004946 31027 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.005716 31424 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.011683 31471 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.986070 31472 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.002993 31291 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.019874 31473 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.041886 31291 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.044248 31385 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:58.044811 31385 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.045217 31385 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:57.992877 31426 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.027158 31471 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.067193 30882 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:58.052585 31473 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.027508 31424 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.060814 31465 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.064896 31471 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.101635 31130 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.121582 31130 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:58.145514 31460 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.319s	user 0.000s	sys 0.005s
I20260709 13:13:58.077181 31465 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.197063 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.197944 31031 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:58.251933 31415 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.252645 31415 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.258730 31485 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.259306 31485 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.261801 31485 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.263705 31472 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:58.264868 31424 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.268792 31072 tablet_bootstrap.cc:492] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:58.269302 31072 ts_tablet_manager.cc:1403] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.631s	user 0.039s	sys 0.046s
I20260709 13:13:58.270412 31473 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.271577 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.272274 31130 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.277159 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.278079 31072 raft_consensus.cc:359] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.278788 31072 raft_consensus.cc:385] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.279949 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:58.279052 31072 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.280819 31485 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.281435 31485 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.281965 31485 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.281524 31072 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:58.283305 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 68527.3us
I20260709 13:13:58.268356 31385 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.284763 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:58.289323 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:58.287000 31426 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.287634 31415 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.287647 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.297606 31072 ts_tablet_manager.cc:1434] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:13:58.292013 31424 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:58.300840 31424 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:13:58.301375 31424 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.301910 31475 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.302309 31475 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.302623 31475 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.305562 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.306392 31030 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:58.310176 31424 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:13:58.323294 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 319420us
W20260709 13:13:58.323997 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:58.325811 31073 tablet_bootstrap.cc:654] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.326476 31465 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:58.324373 31463 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:58.325325 31385 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:58.322095 31462 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:13:58.349815 31485 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.354254 31030 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.364981 31074 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:58.365486 31074 ts_tablet_manager.cc:1403] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.710s	user 0.017s	sys 0.016s
I20260709 13:13:58.369428 31072 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Bootstrap starting.
I20260709 13:13:58.370450 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:58.371107 30874 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.366346 31467 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:58.374526 30923 leader_election.cc:343] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.379787 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.381685 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.382671 30881 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:58.391111 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.381163 31467 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.393162 30880 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:58.384488 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.394143 31424 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.394321 30956 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:58.394441 31467 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.352965 31475 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.396067 31485 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.416299 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:58.426179 31074 raft_consensus.cc:359] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.427167 31074 raft_consensus.cc:385] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.430975 31073 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:58.431078 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.437116 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.437479 30877 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:58.437830 30953 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:13:58.427525 31074 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.404206 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.439857 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:58.439465 31073 ts_tablet_manager.cc:1403] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.493s	user 0.023s	sys 0.005s
I20260709 13:13:58.439888 31074 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.440658 30954 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:58.443593 30956 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:58.444048 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.444766 30952 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 0.
I20260709 13:13:58.427385 31023 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.450438 30954 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:13:58.442010 30874 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:13:58.451236 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.452373 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:58.453047 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.453706 30954 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:58.455721 31478 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:58.457525 31074 ts_tablet_manager.cc:1434] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.007s
I20260709 13:13:58.461529 31478 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:58.455981 31475 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.452870 30876 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:58.462352 31478 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.465943 31074 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:58.456593 31471 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.469413 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.470144 31025 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:58.496592 31073 raft_consensus.cc:359] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.528074 31073 raft_consensus.cc:385] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.528582 31073 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.529458 31073 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.505137 31029 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:58.498121 31023 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:58.542179 31032 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:58.543045 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:58.585134 31073 ts_tablet_manager.cc:1434] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.003s
I20260709 13:13:58.498118 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.589088 31462 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.612571 31073 tablet_bootstrap.cc:492] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Bootstrap starting.
I20260709 13:13:58.612978 31462 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:58.617730 31462 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.647053 31074 tablet_bootstrap.cc:654] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.649818 31072 tablet_bootstrap.cc:654] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.650416 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:13:58.651657 30924 leader_election.cc:343] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.652410 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.652734 30924 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:58.651677 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:58.653676 30954 raft_consensus.cc:2368] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3.
I20260709 13:13:58.652988 30958 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:58.653519 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.657140 30949 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:58.660082 31422 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.660544 31422 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.660917 31422 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.664115 31481 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.667930 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:58.668313 31471 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:58.669268 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:58.670516 30883 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.671586 31485 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.671674 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:58.677601 30883 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:13:58.678051 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.680728 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:13:58.736706 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 55963.3us
W20260709 13:13:58.736809 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52642us
I20260709 13:13:58.744015 30924 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:58.769295 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.770546 31485 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.770469 30878 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:58.743443 31417 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.772603 31417 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.772665 31252 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.764621 31478 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.773685 31478 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:13:58.773039 31417 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.770462 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:58.774799 30882 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.778144 31478 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.778599 31475 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:58.777390 31463 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:13:58.799256 30848 leader_election.cc:343] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.737078 31422 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.800393 30848 leader_election.cc:400] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3.
I20260709 13:13:58.804612 31422 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.818770 30882 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
W20260709 13:13:58.821178 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 54020.4us
I20260709 13:13:58.821378 30848 leader_election.cc:403] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:13:58.774436 31462 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.823625 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:58.829520 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:58.808723 31417 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.823154 31462 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.830793 31252 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3.
I20260709 13:13:58.842638 31484 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.843134 31484 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.845113 31484 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.832684 31475 raft_consensus.cc:2764] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:58.847607 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:58.834555 31424 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.855369 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:58.859823 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:58.841114 31462 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.866451 31073 tablet_bootstrap.cc:654] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.878332 31072 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: No bootstrap required, opened a new log
I20260709 13:13:58.878937 31072 ts_tablet_manager.cc:1403] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Time spent bootstrapping tablet: real 0.518s	user 0.047s	sys 0.066s
I20260709 13:13:58.878360 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:58.879489 30957 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.880479 30882 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:13:58.882891 31072 raft_consensus.cc:359] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.885272 30951 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:58.886006 30957 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:58.854846 31424 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.886777 31424 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.883554 31072 raft_consensus.cc:385] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.887841 31072 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.888485 31072 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.889798 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.890722 31074 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:58.891263 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:58.892059 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:58.892875 31074 ts_tablet_manager.cc:1403] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.426s	user 0.012s	sys 0.013s
I20260709 13:13:58.897329 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:58.893419 31463 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:13:58.900704 31463 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.903162 31463 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.903934 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:58.904485 31025 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.913416 31072 ts_tablet_manager.cc:1434] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:13:58.919381 31130 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.923861 31074 raft_consensus.cc:359] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.925220 31074 raft_consensus.cc:385] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.925550 31074 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.920013 31130 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.934973 31130 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.936241 31417 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:58.937717 30879 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:58.915346 31475 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:13:58.939311 31385 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.950255 31025 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:58.965324 30780 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:58.970860 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 133726us
I20260709 13:13:58.972376 30997 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:58.926260 31074 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:58.969372 30777 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:58.976617 30924 leader_election.cc:343] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:58.992794 31504 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:13:58.999292 31073 tablet_bootstrap.cc:492] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: No bootstrap required, opened a new log
I20260709 13:13:59.001402 31073 ts_tablet_manager.cc:1403] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent bootstrapping tablet: real 0.391s	user 0.027s	sys 0.039s
I20260709 13:13:59.004940 30997 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:13:58.973464 31475 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:13:59.012583 31074 ts_tablet_manager.cc:1434] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:13:59.008211 31472 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.018844 31500 raft_consensus.cc:2764] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:59.020473 31074 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
I20260709 13:13:59.022805 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:13:59.025837 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47148.4us
W20260709 13:13:59.026779 30848 leader_election.cc:343] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.031929 31462 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.033150 30950 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:59.033514 31424 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.033867 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.035637 30883 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:13:59.034051 31462 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.046579 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:59.048237 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:59.050078 31023 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:59.050267 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:13:59.056565 30848 leader_election.cc:343] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.056977 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.058390 31073 raft_consensus.cc:359] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.064329 31073 raft_consensus.cc:385] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.062872 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:59.065341 30956 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:59.066020 31073 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.066931 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:59.071926 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:59.072693 30883 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.073994 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:59.075991 31130 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:59.076349 31130 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.076678 31130 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:59.080801 31508 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.082520 31073 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.094339 31499 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.094985 31499 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.098469 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:59.076103 31475 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.113413 31424 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.127718 30883 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:59.129585 31130 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.133116 31130 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.121363 31475 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:59.123689 31463 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.150303 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56529.1us
I20260709 13:13:59.167279 30924 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:59.131872 31499 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:13:59.174045 31074 tablet_bootstrap.cc:654] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.177899 31073 ts_tablet_manager.cc:1434] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent starting tablet: real 0.175s	user 0.005s	sys 0.010s
I20260709 13:13:59.176383 31415 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.194473 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.191327 31475 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.193214 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:59.172243 31463 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.204615 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.200066 31415 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:59.205183 31032 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.205669 31415 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.199568 31473 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.202997 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.214519 31023 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.219223 30923 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.259589 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.262435 31271 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:13:59.266811 30923 leader_election.cc:343] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.267213 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.269173 31271 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.276008 31032 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:59.231695 31485 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:59.288617 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 88808.9us
I20260709 13:13:59.289309 31134 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:59.290625 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:59.291374 30957 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 1: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:13:59.292493 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:59.294464 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.297160 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.297744 31029 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:59.296574 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:13:59.298280 30882 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:59.301702 30952 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:59.304363 30923 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.311748 31074 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:59.312538 31074 ts_tablet_manager.cc:1403] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.297s	user 0.025s	sys 0.008s
I20260709 13:13:59.313053 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:13:59.287117 31463 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.309201 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:59.318681 31465 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:59.308175 31252 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.320333 31252 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.323939 30957 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:59.308418 31481 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:59.331061 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.323671 31474 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:59.322970 31252 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.362797 31252 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:59.356410 31474 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.377480 31474 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.414615 30997 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:13:59.415644 31023 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:59.423465 30957 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:13:59.428669 31074 raft_consensus.cc:359] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.429786 31074 raft_consensus.cc:385] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.430191 31074 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.431051 31074 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.420714 31500 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:59.438707 31517 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.195s	user 0.000s	sys 0.004s
I20260709 13:13:59.427549 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:13:59.447048 30958 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 0.
I20260709 13:13:59.448360 31029 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:13:59.449083 31500 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:59.453024 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:59.455235 31473 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:59.455847 31473 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:59.445899 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:13:59.483369 30848 leader_election.cc:343] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:59.484455 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 60544.7us
I20260709 13:13:59.487555 31465 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:59.488590 30923 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:13:59.490773 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 66596.2us
I20260709 13:13:59.456888 31473 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.500453 31074 ts_tablet_manager.cc:1434] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.188s	user 0.009s	sys 0.014s
I20260709 13:13:59.497797 31415 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.497215 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:13:59.503592 31415 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:59.505151 31028 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 0.
I20260709 13:13:59.505703 31415 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.550791 31134 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:59.558605 31474 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.565478 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.538887 30779 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.575214 31506 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:59.575803 31506 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.576256 31506 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.585878 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.586874 31030 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.593748 31474 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.643940 31506 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.653843 31074 tablet_bootstrap.cc:492] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Bootstrap starting.
W20260709 13:13:59.640959 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45042.5us
I20260709 13:13:59.703541 31506 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:13:59.705665 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:13:59.706329 30954 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.715131 30954 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:13:59.716964 30780 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 0 to 1, leader changed from <none> to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:59.710669 31030 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:59.728404 30923 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:13:59.729517 31474 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.730014 31474 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:13:59.730777 31474 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.741734 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:13:59.749516 31074 tablet_bootstrap.cc:654] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:59.751642 30848 leader_election.cc:343] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:59.772367 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:13:59.772985 30877 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.781944 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:13:59.789568 31519 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.790042 31519 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:13:59.790911 31519 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.797111 30877 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:13:59.786779 30777 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.803821 31074 tablet_bootstrap.cc:492] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: No bootstrap required, opened a new log
I20260709 13:13:59.802678 31506 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:59.817130 31074 ts_tablet_manager.cc:1403] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Time spent bootstrapping tablet: real 0.164s	user 0.020s	sys 0.003s
I20260709 13:13:59.820336 31074 raft_consensus.cc:359] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.821215 31074 raft_consensus.cc:385] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.821583 31074 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.822482 31074 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:13:59.824785 31074 ts_tablet_manager.cc:1434] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:13:59.832772 31483 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:59.839674 31506 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:59.843076 30779 catalog_manager.cc:5697] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 2, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.894183 31468 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:59.908492 30829 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:59.920136 30780 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.922376 30780 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.943341 30779 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.046310 31485 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.047377 31532 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.047916 31532 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:00.049679 31029 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:00.050290 31532 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:00.050454 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:00.051751 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:00.052538 30954 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 1: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:00.051651 31424 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.053552 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:00.054255 31500 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.063916 31468 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.073220 30954 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:00.064234 31500 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.079458 31424 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.134729 31468 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.148947 31463 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.295148 31424 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.307885 31506 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.845108 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:01.877905 31562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:01.878055 31559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:01.878502 31560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:01.881779 29718 server_base.cc:1061] running on GCE node
I20260709 13:14:01.883725 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:01.883996 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:01.884209 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783602841884178 us; error 0 us; skew 500 ppm
I20260709 13:14:01.884748 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:01.897641 29718 webserver.cc:533] Webserver started at http://127.29.5.132:41861/ using document root <none> and password file <none>
I20260709 13:14:01.898315 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:01.898561 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:01.898947 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:01.900614 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-3-root/instance:
uuid: "74f5a5b7556240508983221981af4ab4"
format_stamp: "Formatted at 2026-07-09 13:14:01 on dist-test-slave-kgkf"
I20260709 13:14:01.908808 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:14:01.912583 31567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:01.913396 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.004s
I20260709 13:14:01.913712 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-3-root
uuid: "74f5a5b7556240508983221981af4ab4"
format_stamp: "Formatted at 2026-07-09 13:14:01 on dist-test-slave-kgkf"
I20260709 13:14:01.913991 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:01.931030 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:01.932447 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:01.934057 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:01.936468 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:01.936688 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:01.936952 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:01.937144 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:02.017089 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.132:42425
I20260709 13:14:02.017143 31629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.132:42425 every 8 connection(s)
I20260709 13:14:02.050557 29718 auto_leader_rebalancer-test.cc:384] add a tserver: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:02.060551 31630 heartbeater.cc:344] Connected to a master server at 127.29.5.190:37151
I20260709 13:14:02.060992 31630 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:02.061683 31630 heartbeater.cc:507] Master 127.29.5.190:37151 requested a full tablet report, sending...
I20260709 13:14:02.063916 30777 ts_manager.cc:194] Registered new tserver with Master: 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:02.065721 30777 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37940
I20260709 13:14:03.068311 31630 heartbeater.cc:499] Master 127.29.5.190:37151 was elected leader, sending a full tablet report...
I20260709 13:14:03.124854 30878 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.132499 31029 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.134986 30954 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.136837 31557 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:03.138041 31638 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:03.169902 31424 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.175575 31028 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:03.182077 30847 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db4763729fc346458245f7d6bca89a8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.176821 30955 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.199620 30777 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.286533 30954 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.314625 31029 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.316092 31648 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.320346 30877 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:03.325656 30922 consensus_peers.cc:597] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 154fc3698684427dab2fe05492989f2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.327023 31643 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.329275 31643 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.334383 31029 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.337101 30877 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.351081 30780 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.367144 31029 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.374457 30954 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.376351 31500 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:03.380628 30877 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.382175 31500 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.390089 31652 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.391600 30954 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.395504 30878 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:03.400465 30996 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7378a710ae3644c686285da393d03ae1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.411633 30878 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.410612 30780 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:03.423547 30847 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26cbe63a7a21474a881ca2ae72df9719. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:03.438931 31029 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.439041 30955 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:03.440694 31557 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.443660 31662 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.458464 31638 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.463481 30954 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.465968 31029 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:03.476460 30780 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.576916 31665 ts_tablet_manager.cc:933] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:03.579489 31665 tablet_copy_client.cc:323] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:03.593783 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet db4763729fc346458245f7d6bca89a8c from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:03.594301 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet db4763729fc346458245f7d6bca89a8c from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-db4763729fc346458245f7d6bca89a8c
I20260709 13:14:03.602850 30893 tablet_copy_source_session.cc:215] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:03.607348 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4763729fc346458245f7d6bca89a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:03.623291 31665 tablet_copy_client.cc:806] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:03.623981 31665 tablet_copy_client.cc:670] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:03.628087 31665 tablet_copy_client.cc:538] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:03.636438 31665 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:03.659673 31665 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:03.660729 31665 tablet_bootstrap.cc:492] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:03.661402 31665 ts_tablet_manager.cc:1403] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.005s
I20260709 13:14:03.664372 31665 raft_consensus.cc:359] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.665208 31665 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:03.665885 31665 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.669559 31665 ts_tablet_manager.cc:1434] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:14:03.672024 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-db4763729fc346458245f7d6bca89a8c received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:03.672480 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-db4763729fc346458245f7d6bca89a8c on tablet db4763729fc346458245f7d6bca89a8c with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:03.740339 31665 ts_tablet_manager.cc:933] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:03.742348 31665 tablet_copy_client.cc:323] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:03.752132 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 154fc3698684427dab2fe05492989f2e from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:03.752679 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 154fc3698684427dab2fe05492989f2e from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-154fc3698684427dab2fe05492989f2e
I20260709 13:14:03.758496 30968 tablet_copy_source_session.cc:215] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:03.762120 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154fc3698684427dab2fe05492989f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:03.776292 31665 tablet_copy_client.cc:806] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:03.776893 31665 tablet_copy_client.cc:670] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:03.780927 31665 tablet_copy_client.cc:538] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:03.789285 31665 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:03.810338 31665 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:03.811280 31665 tablet_bootstrap.cc:492] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:03.812058 31665 ts_tablet_manager.cc:1403] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:14:03.815285 31665 raft_consensus.cc:359] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.816309 31665 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:03.816917 31665 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.819365 31665 ts_tablet_manager.cc:1434] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:03.823207 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-154fc3698684427dab2fe05492989f2e received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:03.823635 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-154fc3698684427dab2fe05492989f2e on tablet 154fc3698684427dab2fe05492989f2e with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:03.912776 31665 ts_tablet_manager.cc:933] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:03.914347 31665 tablet_copy_client.cc:323] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:03.924371 31042 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 7378a710ae3644c686285da393d03ae1 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:03.924926 31042 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 7378a710ae3644c686285da393d03ae1 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-7378a710ae3644c686285da393d03ae1
I20260709 13:14:03.932253 31042 tablet_copy_source_session.cc:215] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:03.935179 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7378a710ae3644c686285da393d03ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:03.952170 31665 tablet_copy_client.cc:806] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:03.952721 31665 tablet_copy_client.cc:670] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:03.956287 31665 tablet_copy_client.cc:538] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:03.961455 31665 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:03.978399 31665 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:03.979312 31665 tablet_bootstrap.cc:492] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:03.980003 31665 ts_tablet_manager.cc:1403] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 13:14:03.983094 31665 raft_consensus.cc:359] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.984015 31665 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:03.984706 31665 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:03.989502 31665 ts_tablet_manager.cc:1434] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:14:03.993299 31042 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-7378a710ae3644c686285da393d03ae1 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:03.993712 31042 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-7378a710ae3644c686285da393d03ae1 on tablet 7378a710ae3644c686285da393d03ae1 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:04.017656 31665 ts_tablet_manager.cc:933] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:04.019402 31665 tablet_copy_client.cc:323] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:04.021837 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 26cbe63a7a21474a881ca2ae72df9719 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:04.022310 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 26cbe63a7a21474a881ca2ae72df9719 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-26cbe63a7a21474a881ca2ae72df9719
I20260709 13:14:04.027560 30893 tablet_copy_source_session.cc:215] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:04.030337 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26cbe63a7a21474a881ca2ae72df9719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.042680 31665 tablet_copy_client.cc:806] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:04.043229 31665 tablet_copy_client.cc:670] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:04.046721 31665 tablet_copy_client.cc:538] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:04.051689 31665 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:04.074113 31665 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:04.075039 31665 tablet_bootstrap.cc:492] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:04.075615 31665 ts_tablet_manager.cc:1403] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:14:04.078143 31665 raft_consensus.cc:359] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:04.078874 31665 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:04.079420 31665 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:04.081344 31665 ts_tablet_manager.cc:1434] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:04.083494 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-26cbe63a7a21474a881ca2ae72df9719 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:04.083954 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-26cbe63a7a21474a881ca2ae72df9719 on tablet 26cbe63a7a21474a881ca2ae72df9719 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:04.147461 31605 raft_consensus.cc:1217] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:04.271883 31605 raft_consensus.cc:1217] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:04.461766 31605 raft_consensus.cc:1217] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:14:04.482424 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 67011us
I20260709 13:14:04.539297 31605 raft_consensus.cc:1217] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:04.712114 31681 raft_consensus.cc:1064] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:04.715659 31681 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:04.717444 31686 raft_consensus.cc:1064] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:04.720319 31686 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:04.724349 31605 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:04.725281 31026 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:04.726256 31643 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:04.726773 30876 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:04.728304 31680 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:04.729765 31648 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:04.750228 31643 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.758347 31605 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:04.765682 31638 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:04.779175 30949 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:04.780654 30877 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.787112 31682 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:04.782956 31029 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:04.792039 31638 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:04.815873 31026 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.800787 31605 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.824693 31682 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.826246 31029 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.832592 30777 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:04.847863 31604 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.872483 30780 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.878749 30949 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.917029 30877 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:04.923342 31605 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:04.924695 31682 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:04.924980 30949 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:04.930513 31682 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:04.934577 31687 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.943343 30949 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.946213 30956 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:04.947256 31605 raft_consensus.cc:2955] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.952265 31604 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:04.954854 31681 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:04.961881 31026 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:04.962939 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db4763729fc346458245f7d6bca89a8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:04.962919 31681 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.964962 31604 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.984944 30779 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:04.999451 31680 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.003613 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet db4763729fc346458245f7d6bca89a8c with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:05.017194 31685 raft_consensus.cc:1064] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:05.029295 31685 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:05.030320 31026 raft_consensus.cc:2955] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.046473 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 154fc3698684427dab2fe05492989f2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:05.065949 30778 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.072576 31701 tablet_replica.cc:333] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:05.073798 31701 raft_consensus.cc:2243] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.074569 31701 raft_consensus.cc:2272] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.084268 31604 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:05.086530 31703 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:05.101341 31687 raft_consensus.cc:1064] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:05.105659 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 154fc3698684427dab2fe05492989f2e with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:05.116904 31687 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:05.124863 31701 ts_tablet_manager.cc:1916] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:05.152860 30877 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:05.154567 31703 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.155876 30956 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:05.168386 31708 tablet_replica.cc:333] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:05.174819 31705 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:05.181033 31026 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:05.183051 31686 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.192883 31701 ts_tablet_manager.cc:1929] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:05.193590 31701 log.cc:1199] T db4763729fc346458245f7d6bca89a8c P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/db4763729fc346458245f7d6bca89a8c
I20260709 13:14:05.195621 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet db4763729fc346458245f7d6bca89a8c (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:05.196806 31604 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:05.198570 31687 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:05.199147 30951 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:05.203013 31678 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:05.229992 31687 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.242494 31683 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.249940 30877 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.253047 31604 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.305747 30956 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.307847 30780 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.317579 31604 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.326594 31028 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.340875 30780 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.345453 31708 raft_consensus.cc:2243] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.346212 31708 raft_consensus.cc:2272] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.349917 31708 ts_tablet_manager.cc:1916] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:05.358600 31028 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:05.358450 30952 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.375715 30877 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:05.380793 31604 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:05.381644 31029 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:05.382449 31638 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.384047 31686 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.389417 31604 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:05.393069 30878 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:05.396029 31682 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.396884 31704 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:05.398756 31704 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:05.400096 31604 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.402756 31029 raft_consensus.cc:2955] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.408123 31706 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.425267 30780 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.427426 31605 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.431818 30878 raft_consensus.cc:2955] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.438962 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26cbe63a7a21474a881ca2ae72df9719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:05.404280 31708 ts_tablet_manager.cc:1929] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:05.441478 31708 log.cc:1199] T 154fc3698684427dab2fe05492989f2e P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/154fc3698684427dab2fe05492989f2e
I20260709 13:14:05.448284 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 26cbe63a7a21474a881ca2ae72df9719 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:05.460462 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 154fc3698684427dab2fe05492989f2e (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:05.478178 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7378a710ae3644c686285da393d03ae1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:05.479194 30778 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:05.494015 31715 tablet_replica.cc:333] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:05.495155 31715 raft_consensus.cc:2243] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.495954 31715 raft_consensus.cc:2272] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.506718 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 7378a710ae3644c686285da393d03ae1 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:05.509724 31715 ts_tablet_manager.cc:1916] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:05.524647 31715 ts_tablet_manager.cc:1929] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:05.524993 31715 log.cc:1199] T 26cbe63a7a21474a881ca2ae72df9719 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/26cbe63a7a21474a881ca2ae72df9719
I20260709 13:14:05.526438 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 26cbe63a7a21474a881ca2ae72df9719 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:05.526580 31715 tablet_replica.cc:333] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:05.527498 31715 raft_consensus.cc:2243] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:05.528050 31715 raft_consensus.cc:2272] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:05.530609 31715 ts_tablet_manager.cc:1916] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:05.541280 31715 ts_tablet_manager.cc:1929] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:05.541647 31715 log.cc:1199] T 7378a710ae3644c686285da393d03ae1 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/7378a710ae3644c686285da393d03ae1
I20260709 13:14:05.543232 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 7378a710ae3644c686285da393d03ae1 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:06.579018 30878 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:06.585290 31026 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:06.586212 30847 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c01eed2523a3452fbe85af4db99a20bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.586701 30952 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.586608 31638 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.588004 31686 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.594297 31638 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.595908 31026 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.610077 30777 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.611243 31026 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:06.619853 30996 consensus_peers.cc:597] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57205f89b2ab4d2c8a699a5178d20da0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.620380 30877 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.620499 30951 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.621816 31683 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.601337 30952 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.622624 31716 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.657002 31716 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.660408 30877 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.676194 30954 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.677539 30951 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:06.698860 30877 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.699445 31026 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.700941 31729 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.702131 31681 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:06.704846 30922 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7959c8f3c783472ab0e42eac55ff018a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.710973 31643 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.712615 31026 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.725548 30780 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.730149 31026 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:06.732892 30878 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:06.739444 30996 consensus_peers.cc:597] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a98a12e85a64722a1c7f956eb64734e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:06.740962 30951 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.743008 31716 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.743299 30878 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:06.744601 31683 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.753155 30778 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.764799 31683 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.766532 30877 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.772444 30951 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:06.781633 30780 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:07.053020 31738 ts_tablet_manager.cc:933] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:07.055135 31738 tablet_copy_client.cc:323] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:07.057752 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet c01eed2523a3452fbe85af4db99a20bf from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:07.058311 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet c01eed2523a3452fbe85af4db99a20bf from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-c01eed2523a3452fbe85af4db99a20bf
I20260709 13:14:07.067034 30893 tablet_copy_source_session.cc:215] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.070365 31738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01eed2523a3452fbe85af4db99a20bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.083333 31738 tablet_copy_client.cc:806] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:07.084362 31738 tablet_copy_client.cc:670] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:07.088793 31738 tablet_copy_client.cc:538] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:07.096894 31738 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:07.115729 31738 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:07.117076 31738 tablet_bootstrap.cc:492] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:07.117723 31738 ts_tablet_manager.cc:1403] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:14:07.120065 31738 raft_consensus.cc:359] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.120683 31738 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:07.121208 31738 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.124125 31738 ts_tablet_manager.cc:1434] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:14:07.126107 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-c01eed2523a3452fbe85af4db99a20bf received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:07.126590 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-c01eed2523a3452fbe85af4db99a20bf on tablet c01eed2523a3452fbe85af4db99a20bf with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:07.134538 31738 ts_tablet_manager.cc:933] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:07.136654 31738 tablet_copy_client.cc:323] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:07.138398 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 7959c8f3c783472ab0e42eac55ff018a from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:07.138875 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 7959c8f3c783472ab0e42eac55ff018a from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-7959c8f3c783472ab0e42eac55ff018a
I20260709 13:14:07.145452 30968 tablet_copy_source_session.cc:215] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.148403 31738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7959c8f3c783472ab0e42eac55ff018a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.163655 31738 tablet_copy_client.cc:806] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:07.164366 31738 tablet_copy_client.cc:670] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:07.169087 31738 tablet_copy_client.cc:538] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:07.176518 31738 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:07.219470 31743 ts_tablet_manager.cc:933] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:07.225297 31738 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:07.226858 31738 tablet_bootstrap.cc:492] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:07.227869 31738 ts_tablet_manager.cc:1403] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.012s
I20260709 13:14:07.258641 31746 ts_tablet_manager.cc:933] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:07.258772 31738 raft_consensus.cc:359] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.260004 31738 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:07.260878 31738 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.263085 31743 tablet_copy_client.cc:323] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:07.267324 31746 tablet_copy_client.cc:323] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:07.267494 31042 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 57205f89b2ab4d2c8a699a5178d20da0 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:07.268065 31042 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 57205f89b2ab4d2c8a699a5178d20da0 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-57205f89b2ab4d2c8a699a5178d20da0
I20260709 13:14:07.268980 31738 ts_tablet_manager.cc:1434] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260709 13:14:07.270792 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-7959c8f3c783472ab0e42eac55ff018a received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:07.270824 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 9a98a12e85a64722a1c7f956eb64734e from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:07.271286 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-7959c8f3c783472ab0e42eac55ff018a on tablet 7959c8f3c783472ab0e42eac55ff018a with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:07.271441 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 9a98a12e85a64722a1c7f956eb64734e from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-9a98a12e85a64722a1c7f956eb64734e
I20260709 13:14:07.281916 31042 tablet_copy_source_session.cc:215] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.282866 31041 tablet_copy_source_session.cc:215] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:07.285156 31743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57205f89b2ab4d2c8a699a5178d20da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.287549 31746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a98a12e85a64722a1c7f956eb64734e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:07.305495 31743 tablet_copy_client.cc:806] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:07.306115 31743 tablet_copy_client.cc:670] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:07.308597 31746 tablet_copy_client.cc:806] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:07.309170 31746 tablet_copy_client.cc:670] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:07.318187 31746 tablet_copy_client.cc:538] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:07.325521 31743 tablet_copy_client.cc:538] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:07.327553 31746 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:07.335719 31743 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:07.351740 31746 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:07.352716 31746 tablet_bootstrap.cc:492] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:07.353384 31746 ts_tablet_manager.cc:1403] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 13:14:07.356417 31746 raft_consensus.cc:359] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.357232 31746 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:07.357862 31746 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.360481 31746 ts_tablet_manager.cc:1434] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:07.362036 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-9a98a12e85a64722a1c7f956eb64734e received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:07.362542 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-9a98a12e85a64722a1c7f956eb64734e on tablet 9a98a12e85a64722a1c7f956eb64734e with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:07.379851 31743 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:07.380713 31743 tablet_bootstrap.cc:492] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:07.381512 31743 ts_tablet_manager.cc:1403] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.001s
I20260709 13:14:07.385737 31743 raft_consensus.cc:359] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.386602 31743 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:07.387228 31743 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:07.389837 31743 ts_tablet_manager.cc:1434] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:14:07.391332 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-57205f89b2ab4d2c8a699a5178d20da0 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:07.391698 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-57205f89b2ab4d2c8a699a5178d20da0 on tablet 57205f89b2ab4d2c8a699a5178d20da0 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:07.615638 31604 raft_consensus.cc:1217] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:07.663630 31604 raft_consensus.cc:1217] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:07.672654 31604 raft_consensus.cc:1217] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:07.751416 31604 raft_consensus.cc:1217] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:08.015473 31716 raft_consensus.cc:1064] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:08.017874 31716 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.025003 31604 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.025731 30954 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.026808 30877 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.027079 31716 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.028476 31706 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.029397 31683 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.056336 31706 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.057308 30877 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.074549 30778 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.075515 30951 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.073825 31604 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.105963 31638 raft_consensus.cc:1064] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:08.105963 31683 raft_consensus.cc:1064] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:08.108362 31683 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.108392 31638 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.130405 31604 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.131943 31706 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.134891 31604 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.136351 31723 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.145843 30951 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.147970 30878 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.153563 31706 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:08.160403 31706 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:08.178143 31028 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.180418 30952 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.186707 31686 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.191881 31706 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.200788 31638 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:08.200557 30951 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.221673 31605 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.224330 31638 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.227982 31028 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.233069 31029 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.236871 31603 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.240146 30954 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.246907 30779 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.249963 30878 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.259474 30954 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:08.259558 31605 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:08.261749 31706 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.269742 31683 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.268265 30777 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.279950 31716 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.285821 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57205f89b2ab4d2c8a699a5178d20da0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:08.278033 31605 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.294754 30878 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.296013 31750 raft_consensus.cc:1064] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:08.299103 31028 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.309134 31604 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:08.312368 31706 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.313059 30777 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.318648 31750 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:08.321760 31604 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:08.321583 31756 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.330482 31723 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.331254 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 57205f89b2ab4d2c8a699a5178d20da0 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:08.333710 30952 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:08.339200 30949 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:08.340840 31764 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.343808 31638 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.347263 30952 raft_consensus.cc:2955] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.349655 31605 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.349957 31604 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.355964 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c01eed2523a3452fbe85af4db99a20bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:08.358095 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a98a12e85a64722a1c7f956eb64734e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:08.363694 31771 tablet_replica.cc:333] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:08.366065 31683 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:08.374574 31771 raft_consensus.cc:2243] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.375577 31771 raft_consensus.cc:2272] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.380018 31771 ts_tablet_manager.cc:1916] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:08.378963 30952 raft_consensus.cc:2955] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.392088 30778 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.400256 30777 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:08.404971 31028 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.407267 31605 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.407171 31750 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.408970 31769 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:08.413633 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet c01eed2523a3452fbe85af4db99a20bf with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:08.414423 31771 ts_tablet_manager.cc:1929] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:08.422724 31771 log.cc:1199] T 57205f89b2ab4d2c8a699a5178d20da0 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/57205f89b2ab4d2c8a699a5178d20da0
I20260709 13:14:08.424460 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 57205f89b2ab4d2c8a699a5178d20da0 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:08.436863 31774 tablet_replica.cc:333] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:08.438236 31774 raft_consensus.cc:2243] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.439078 31774 raft_consensus.cc:2272] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.450582 31774 ts_tablet_manager.cc:1916] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:08.457157 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a98a12e85a64722a1c7f956eb64734e with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:08.458264 31771 tablet_replica.cc:333] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:08.459352 31771 raft_consensus.cc:2243] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:08.460027 31771 raft_consensus.cc:2272] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:08.460773 31769 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.465709 31771 ts_tablet_manager.cc:1916] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:08.471194 31605 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:08.461946 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72395.9us
I20260709 13:14:08.480396 31771 ts_tablet_manager.cc:1929] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:08.480856 31771 log.cc:1199] T 9a98a12e85a64722a1c7f956eb64734e P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/9a98a12e85a64722a1c7f956eb64734e
I20260709 13:14:08.482290 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 9a98a12e85a64722a1c7f956eb64734e (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:08.483136 31774 ts_tablet_manager.cc:1929] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:08.483546 31774 log.cc:1199] T c01eed2523a3452fbe85af4db99a20bf P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/c01eed2523a3452fbe85af4db99a20bf
I20260709 13:14:08.482973 31028 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.485486 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet c01eed2523a3452fbe85af4db99a20bf (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:08.490479 30878 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:08.495083 30952 raft_consensus.cc:2955] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.507941 30777 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:08.517769 31769 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:08.530107 30876 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:09.040426 30951 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:09.044924 31605 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.045883 30878 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:09.046417 31750 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:09.047242 31769 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:09.054261 31769 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:09.057835 30878 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:09.057971 31605 raft_consensus.cc:2955] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:09.064451 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7959c8f3c783472ab0e42eac55ff018a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:09.071919 30777 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.086619 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 7959c8f3c783472ab0e42eac55ff018a with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:09.089020 31782 tablet_replica.cc:333] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:09.090118 31782 raft_consensus.cc:2243] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:09.090898 31782 raft_consensus.cc:2272] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:09.094749 31782 ts_tablet_manager.cc:1916] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:09.108273 31782 ts_tablet_manager.cc:1929] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:09.108573 31782 log.cc:1199] T 7959c8f3c783472ab0e42eac55ff018a P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/7959c8f3c783472ab0e42eac55ff018a
I20260709 13:14:09.109925 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 7959c8f3c783472ab0e42eac55ff018a (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:10.158360 31028 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.164310 30952 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.164901 30876 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.165645 31756 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:10.166788 30996 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bc558c3b0eb4c249f836374861bb23c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.167268 31785 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:10.173970 31756 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.175818 30951 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.178009 30876 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.193840 30781 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.225113 30951 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:10.237182 30922 consensus_peers.cc:597] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43a26907cc3847ef873d80998378ce0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.237905 30876 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.237897 31028 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.239703 31783 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.240756 31769 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.253500 31773 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.254887 31028 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.256614 30876 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.273337 30779 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.295665 31028 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:10.303498 30996 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d72ea41cd9114780855924982fc9b2a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.304243 30951 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.304818 30876 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.305884 31785 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.306843 31756 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.316265 31716 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.318025 30878 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.329576 30951 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.336829 30777 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.341150 30878 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:10.363035 30847 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f167b704a74542d08476d7ce70c368d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.366103 30951 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.366931 31026 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:10.368646 31638 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.369469 31800 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.379616 31638 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.390151 30952 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.394156 31028 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.409577 30779 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:10.646414 31805 ts_tablet_manager.cc:933] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:10.650861 31805 tablet_copy_client.cc:323] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:10.652629 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 6bc558c3b0eb4c249f836374861bb23c from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:10.653156 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 6bc558c3b0eb4c249f836374861bb23c from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-6bc558c3b0eb4c249f836374861bb23c
I20260709 13:14:10.660171 31041 tablet_copy_source_session.cc:215] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:10.663105 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bc558c3b0eb4c249f836374861bb23c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.678007 31805 tablet_copy_client.cc:806] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:10.678560 31805 tablet_copy_client.cc:670] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:10.681762 31805 tablet_copy_client.cc:538] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:10.692313 31805 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:10.699682 31807 ts_tablet_manager.cc:933] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:10.701752 31807 tablet_copy_client.cc:323] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:10.703504 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet d72ea41cd9114780855924982fc9b2a8 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:10.704059 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet d72ea41cd9114780855924982fc9b2a8 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-d72ea41cd9114780855924982fc9b2a8
I20260709 13:14:10.711050 31805 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.712132 31805 tablet_bootstrap.cc:492] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:10.712875 31805 ts_tablet_manager.cc:1403] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:14:10.713405 31041 tablet_copy_source_session.cc:215] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:10.716641 31807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72ea41cd9114780855924982fc9b2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.716719 31805 raft_consensus.cc:359] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.717548 31805 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:10.734305 31805 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.735555 31807 tablet_copy_client.cc:806] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:10.736152 31807 tablet_copy_client.cc:670] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:10.749424 31807 tablet_copy_client.cc:538] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:10.759317 31807 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:10.762499 31805 ts_tablet_manager.cc:1434] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.007s
I20260709 13:14:10.764300 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-6bc558c3b0eb4c249f836374861bb23c received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:10.764724 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-6bc558c3b0eb4c249f836374861bb23c on tablet 6bc558c3b0eb4c249f836374861bb23c with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:10.785864 31805 ts_tablet_manager.cc:933] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:10.787900 31807 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.790558 31807 tablet_bootstrap.cc:492] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:10.791217 31807 ts_tablet_manager.cc:1403] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.005s
I20260709 13:14:10.794771 31807 raft_consensus.cc:359] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.795573 31807 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:10.796214 31807 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.797456 31805 tablet_copy_client.cc:323] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:10.799248 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet f167b704a74542d08476d7ce70c368d0 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:10.799568 31807 ts_tablet_manager.cc:1434] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:10.799747 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet f167b704a74542d08476d7ce70c368d0 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-f167b704a74542d08476d7ce70c368d0
I20260709 13:14:10.801342 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-d72ea41cd9114780855924982fc9b2a8 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:10.801731 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-d72ea41cd9114780855924982fc9b2a8 on tablet d72ea41cd9114780855924982fc9b2a8 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:10.809368 30893 tablet_copy_source_session.cc:215] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:10.812458 31805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f167b704a74542d08476d7ce70c368d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.821640 31807 ts_tablet_manager.cc:933] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:10.833861 31805 tablet_copy_client.cc:806] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:10.834544 31805 tablet_copy_client.cc:670] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:10.835901 31807 tablet_copy_client.cc:323] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:10.838104 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 43a26907cc3847ef873d80998378ce0a from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:10.838253 31805 tablet_copy_client.cc:538] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:10.838637 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 43a26907cc3847ef873d80998378ce0a from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-43a26907cc3847ef873d80998378ce0a
I20260709 13:14:10.846890 30968 tablet_copy_source_session.cc:215] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:10.847980 31805 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:10.849977 31807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a26907cc3847ef873d80998378ce0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:10.866932 31807 tablet_copy_client.cc:806] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:10.867544 31807 tablet_copy_client.cc:670] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:10.871982 31807 tablet_copy_client.cc:538] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:10.879151 31807 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:10.882515 31805 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.883500 31805 tablet_bootstrap.cc:492] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:10.884202 31805 ts_tablet_manager.cc:1403] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.011s
I20260709 13:14:10.887563 31805 raft_consensus.cc:359] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.888432 31805 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:10.889074 31805 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.891490 31805 ts_tablet_manager.cc:1434] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:10.893415 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-f167b704a74542d08476d7ce70c368d0 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:10.893800 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-f167b704a74542d08476d7ce70c368d0 on tablet f167b704a74542d08476d7ce70c368d0 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:10.908486 31807 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:10.909397 31807 tablet_bootstrap.cc:492] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:10.910231 31807 ts_tablet_manager.cc:1403] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.009s
I20260709 13:14:10.912480 31807 raft_consensus.cc:359] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.913057 31807 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:10.913580 31807 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:10.915880 31807 ts_tablet_manager.cc:1434] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:10.917899 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-43a26907cc3847ef873d80998378ce0a received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:10.918375 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-43a26907cc3847ef873d80998378ce0a on tablet 43a26907cc3847ef873d80998378ce0a with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:11.046046 31604 raft_consensus.cc:1217] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:11.108392 31604 raft_consensus.cc:1217] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:11.180687 31604 raft_consensus.cc:1217] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:11.396202 31604 raft_consensus.cc:1217] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:11.489949 31716 raft_consensus.cc:1064] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:11.492559 31716 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.493338 31816 raft_consensus.cc:1064] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:11.495848 31816 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.498622 31604 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.500133 30951 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.500280 31756 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:11.501080 30878 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.501665 31819 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.506032 31756 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.532349 31756 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.536192 31604 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.536358 30951 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.540163 31819 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.551062 30878 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.552443 30952 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.554076 31716 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.562177 31819 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.575310 31605 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.584642 31803 raft_consensus.cc:1064] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:11.586043 30777 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.587304 31803 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.602365 30878 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.625728 31819 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.627247 31604 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.640223 31028 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.641892 30951 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.641812 30876 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.643442 31804 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.645874 31804 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.646847 31604 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.653316 31804 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.652591 30951 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.672415 31800 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.674016 30952 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.677760 31028 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.689185 31604 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.708555 30779 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.712464 30779 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.740864 31029 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.745288 30876 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.748690 31604 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:11.750141 30878 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:11.750231 31756 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.751659 31827 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.741679 31028 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.755263 30952 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:11.755371 31603 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:11.756729 31804 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.757930 31800 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.760864 31827 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.764917 31602 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:11.766770 30883 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:11.766700 30878 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.766692 31756 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:14:11.769851 31800 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.775556 31716 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:11.770972 31605 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.784672 30951 raft_consensus.cc:2955] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.793732 31816 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.797931 31817 raft_consensus.cc:1064] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:11.800311 31817 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:11.804342 30876 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.809451 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f167b704a74542d08476d7ce70c368d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:11.773841 31603 raft_consensus.cc:2955] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.829504 30781 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:11.831082 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bc558c3b0eb4c249f836374861bb23c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:11.838546 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d72ea41cd9114780855924982fc9b2a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:11.837240 30777 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.822154 31604 raft_consensus.cc:2955] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:11.893963 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 83114.4us
I20260709 13:14:11.930625 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet f167b704a74542d08476d7ce70c368d0 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:11.936338 31842 tablet_replica.cc:333] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:11.937564 31842 raft_consensus.cc:2243] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.938402 31842 raft_consensus.cc:2272] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.942916 31842 ts_tablet_manager.cc:1916] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:11.942957 31028 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.946834 30878 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.944614 31817 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:14:11.949515 31603 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:11.950994 31773 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:11.955703 31817 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:11.967199 31842 ts_tablet_manager.cc:1929] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:11.967828 31842 log.cc:1199] T f167b704a74542d08476d7ce70c368d0 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/f167b704a74542d08476d7ce70c368d0
I20260709 13:14:11.969200 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bc558c3b0eb4c249f836374861bb23c with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:11.981830 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet f167b704a74542d08476d7ce70c368d0 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:11.986997 31846 tablet_replica.cc:333] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:11.988312 31846 raft_consensus.cc:2243] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.989079 31846 raft_consensus.cc:2272] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.993500 30780 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.994906 31846 ts_tablet_manager.cc:1916] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:12.008376 31818 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.015249 31604 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.017705 31029 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.020028 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet d72ea41cd9114780855924982fc9b2a8 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:12.029392 30780 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.034919 31846 ts_tablet_manager.cc:1929] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:12.035467 31846 log.cc:1199] T 6bc558c3b0eb4c249f836374861bb23c P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/6bc558c3b0eb4c249f836374861bb23c
I20260709 13:14:12.037214 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 6bc558c3b0eb4c249f836374861bb23c (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:12.038265 31846 tablet_replica.cc:333] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:12.039499 31846 raft_consensus.cc:2243] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:12.040194 31846 raft_consensus.cc:2272] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:12.043346 31846 ts_tablet_manager.cc:1916] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:12.044353 30876 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.062942 30952 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:12.063831 31846 ts_tablet_manager.cc:1929] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:12.064370 31846 log.cc:1199] T d72ea41cd9114780855924982fc9b2a8 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/d72ea41cd9114780855924982fc9b2a8
I20260709 13:14:12.066085 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet d72ea41cd9114780855924982fc9b2a8 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:12.070322 31604 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:12.072008 31773 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:12.074168 31029 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:12.075716 31773 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:12.080545 31847 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.083616 31604 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.085702 31029 raft_consensus.cc:2955] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.096068 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43a26907cc3847ef873d80998378ce0a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:12.099216 30780 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:12.112869 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 43a26907cc3847ef873d80998378ce0a with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:12.116572 31848 tablet_replica.cc:333] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:12.117576 31848 raft_consensus.cc:2243] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:12.118309 31848 raft_consensus.cc:2272] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:12.121410 31848 ts_tablet_manager.cc:1916] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:12.136092 31848 ts_tablet_manager.cc:1929] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:12.136394 31848 log.cc:1199] T 43a26907cc3847ef873d80998378ce0a P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/43a26907cc3847ef873d80998378ce0a
I20260709 13:14:12.137778 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 43a26907cc3847ef873d80998378ce0a (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:13.183930 31029 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.191210 30878 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:13.192010 30996 consensus_peers.cc:597] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe74086270b4498abc8ede59e5e23f3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.192612 31816 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.192906 30949 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:13.195179 31851 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.201232 31851 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.202831 30878 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.208345 30949 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.226418 30780 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.232780 30949 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:13.242640 30922 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93599b7a5b2c4798aaa9425aa5ecc686. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.248703 30878 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:13.248796 31029 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:13.250437 31818 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.251434 31849 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.265043 31773 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.267978 31028 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.271420 30878 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.277364 31029 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.286180 30779 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.291978 30949 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:13.292551 30996 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 305d528ec3044fc288a8d49789c8d2ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.293181 30878 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:13.294600 31816 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.295591 31716 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.306676 31716 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.309051 30878 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.316128 30949 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.335554 30780 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.337813 30878 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:13.346726 30847 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa9513cbd3af40a4a69f7a596298664c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:13.349224 31029 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:13.350615 31840 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.351090 30949 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:13.352897 31840 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:13.361302 31869 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.366524 31029 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.372354 30949 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.387702 30779 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:13.611980 31871 ts_tablet_manager.cc:933] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:13.614759 31871 tablet_copy_client.cc:323] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:13.616461 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet fe74086270b4498abc8ede59e5e23f3a from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:13.617029 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet fe74086270b4498abc8ede59e5e23f3a from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-fe74086270b4498abc8ede59e5e23f3a
I20260709 13:14:13.622749 31041 tablet_copy_source_session.cc:215] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.626045 31871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe74086270b4498abc8ede59e5e23f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.643108 31871 tablet_copy_client.cc:806] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.643708 31871 tablet_copy_client.cc:670] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.647181 31871 tablet_copy_client.cc:538] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.656129 31871 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:13.676608 31871 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:13.677464 31871 tablet_bootstrap.cc:492] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:13.678054 31871 ts_tablet_manager.cc:1403] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 13:14:13.680920 31871 raft_consensus.cc:359] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.682909 31871 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:13.683566 31871 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.686762 31871 ts_tablet_manager.cc:1434] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:14:13.691370 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-fe74086270b4498abc8ede59e5e23f3a received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:13.691838 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-fe74086270b4498abc8ede59e5e23f3a on tablet fe74086270b4498abc8ede59e5e23f3a with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:13.696695 31871 ts_tablet_manager.cc:933] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:13.703528 31871 tablet_copy_client.cc:323] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:13.705267 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 93599b7a5b2c4798aaa9425aa5ecc686 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:13.705873 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 93599b7a5b2c4798aaa9425aa5ecc686 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-93599b7a5b2c4798aaa9425aa5ecc686
I20260709 13:14:13.720252 30968 tablet_copy_source_session.cc:215] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.723393 31871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93599b7a5b2c4798aaa9425aa5ecc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.740021 31871 tablet_copy_client.cc:806] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.740674 31871 tablet_copy_client.cc:670] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.744613 31871 tablet_copy_client.cc:538] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.754873 31871 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:13.774045 31871 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:13.775027 31871 tablet_bootstrap.cc:492] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:13.776024 31871 ts_tablet_manager.cc:1403] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.001s
I20260709 13:14:13.779131 31871 raft_consensus.cc:359] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.780057 31871 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:13.780936 31871 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.783685 31871 ts_tablet_manager.cc:1434] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:13.785471 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-93599b7a5b2c4798aaa9425aa5ecc686 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:13.785902 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-93599b7a5b2c4798aaa9425aa5ecc686 on tablet 93599b7a5b2c4798aaa9425aa5ecc686 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:13.789229 31871 ts_tablet_manager.cc:933] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:13.796785 31871 tablet_copy_client.cc:323] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:13.798648 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 305d528ec3044fc288a8d49789c8d2ab from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:13.799225 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 305d528ec3044fc288a8d49789c8d2ab from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-305d528ec3044fc288a8d49789c8d2ab
I20260709 13:14:13.807049 31041 tablet_copy_source_session.cc:215] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.811239 31871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305d528ec3044fc288a8d49789c8d2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.815160 31878 ts_tablet_manager.cc:933] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:13.824303 31878 tablet_copy_client.cc:323] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:13.826164 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet fa9513cbd3af40a4a69f7a596298664c from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:13.826762 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet fa9513cbd3af40a4a69f7a596298664c from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-fa9513cbd3af40a4a69f7a596298664c
I20260709 13:14:13.829829 31871 tablet_copy_client.cc:806] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.830454 31871 tablet_copy_client.cc:670] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.834733 30893 tablet_copy_source_session.cc:215] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.839541 31871 tablet_copy_client.cc:538] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.842265 31878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa9513cbd3af40a4a69f7a596298664c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:13.849521 31871 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:13.862273 31878 tablet_copy_client.cc:806] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:13.863039 31878 tablet_copy_client.cc:670] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:13.868170 31878 tablet_copy_client.cc:538] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:13.872078 31871 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:13.873020 31871 tablet_bootstrap.cc:492] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:13.873705 31871 ts_tablet_manager.cc:1403] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.006s
I20260709 13:14:13.876368 31871 raft_consensus.cc:359] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.877182 31871 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:13.877812 31871 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.879900 31871 ts_tablet_manager.cc:1434] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:14:13.883925 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-305d528ec3044fc288a8d49789c8d2ab received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:13.884344 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-305d528ec3044fc288a8d49789c8d2ab on tablet 305d528ec3044fc288a8d49789c8d2ab with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:13.891594 31878 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:13.912336 31878 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:13.913231 31878 tablet_bootstrap.cc:492] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:13.913920 31878 ts_tablet_manager.cc:1403] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.023s	user 0.023s	sys 0.000s
I20260709 13:14:13.932665 31878 raft_consensus.cc:359] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.933553 31878 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:13.934281 31878 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:13.938555 31878 ts_tablet_manager.cc:1434] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 13:14:13.940358 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-fa9513cbd3af40a4a69f7a596298664c received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:13.940797 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-fa9513cbd3af40a4a69f7a596298664c on tablet fa9513cbd3af40a4a69f7a596298664c with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:14.123821 31604 raft_consensus.cc:1217] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:14.230073 31603 raft_consensus.cc:1217] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:14.259577 31603 raft_consensus.cc:1217] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:14.321699 31603 raft_consensus.cc:1217] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:14.613175 31882 raft_consensus.cc:1064] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:14.617652 31882 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:14.625029 31603 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.628405 31716 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:14.629009 30878 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.630040 30954 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.630543 31716 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:14.635005 31882 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:14.655624 31865 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.672556 30954 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.683548 30878 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.705642 30777 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.709213 31869 raft_consensus.cc:1064] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:14.713718 31869 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:14.712646 31603 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.744257 31716 raft_consensus.cc:1064] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:14.752696 31716 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:14.763916 31604 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.785842 31885 raft_consensus.cc:1064] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:14.790627 31028 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.790905 30951 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.791874 31898 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:14:14.801226 31885 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:14.807838 31898 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:14:14.810102 31840 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:14.831239 31603 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.833230 31892 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:14.855252 31030 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.858682 30876 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.855154 31603 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.861146 31882 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:14.878631 30878 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.876905 30952 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:14.880924 31886 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:14:14.900182 31773 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:14.904613 31818 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:14.910030 31901 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.914805 31893 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:14.922238 31604 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.926265 30952 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:14.940827 31030 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.005941 31913 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.011231 31892 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.008023 31603 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.024165 30952 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.044091 30876 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.054239 30883 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.060894 31605 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.076700 31023 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.108331 31023 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:15.117584 30780 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.118381 30954 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.120123 31882 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:15.118381 31604 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.125168 31882 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:15.128518 31882 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.129884 30954 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.136211 31604 raft_consensus.cc:2955] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.119261 30780 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.140728 30780 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.151233 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe74086270b4498abc8ede59e5e23f3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:15.166785 30883 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:15.173792 31030 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.174427 31604 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.176124 31901 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:15.177968 31901 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:15.192937 30779 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.194723 31900 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.204962 31023 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.208784 31603 raft_consensus.cc:2955] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.211393 30952 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:15.217805 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet fe74086270b4498abc8ede59e5e23f3a with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:15.221083 31920 tablet_replica.cc:333] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:15.222870 31920 raft_consensus.cc:2243] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:15.226730 31920 raft_consensus.cc:2272] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:15.227167 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa9513cbd3af40a4a69f7a596298664c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:15.230988 31920 ts_tablet_manager.cc:1916] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:15.234571 31030 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:15.240464 31605 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.243173 31893 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:15.246307 30876 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.248939 31604 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.250895 31883 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:15.253129 31882 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:15.255492 30878 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:15.258116 31909 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:15.261183 31909 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.268046 31602 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.263554 31716 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.272871 31604 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.273631 31920 ts_tablet_manager.cc:1929] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:15.274328 31920 log.cc:1199] T fe74086270b4498abc8ede59e5e23f3a P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/fe74086270b4498abc8ede59e5e23f3a
I20260709 13:14:15.276186 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet fe74086270b4498abc8ede59e5e23f3a (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:15.277423 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 93599b7a5b2c4798aaa9425aa5ecc686 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:15.280041 30878 raft_consensus.cc:2955] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.286952 30780 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.289909 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 305d528ec3044fc288a8d49789c8d2ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:15.300544 30883 raft_consensus.cc:2955] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.306470 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet fa9513cbd3af40a4a69f7a596298664c with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:15.308595 30777 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:15.319504 31921 tablet_replica.cc:333] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:15.323820 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 93599b7a5b2c4798aaa9425aa5ecc686 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:15.324304 31921 raft_consensus.cc:2243] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:15.325111 31921 raft_consensus.cc:2272] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:15.325768 30778 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:15.334537 31921 ts_tablet_manager.cc:1916] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:15.337217 31922 tablet_replica.cc:333] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:15.338553 31922 raft_consensus.cc:2243] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:15.339424 31922 raft_consensus.cc:2272] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:15.342931 31922 ts_tablet_manager.cc:1916] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:15.354116 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 305d528ec3044fc288a8d49789c8d2ab with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:15.354414 31921 ts_tablet_manager.cc:1929] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:15.355212 31921 log.cc:1199] T fa9513cbd3af40a4a69f7a596298664c P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/fa9513cbd3af40a4a69f7a596298664c
I20260709 13:14:15.359925 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet fa9513cbd3af40a4a69f7a596298664c (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:15.360337 31921 tablet_replica.cc:333] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:15.361414 31922 ts_tablet_manager.cc:1929] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:15.361548 31921 raft_consensus.cc:2243] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:15.362061 31922 log.cc:1199] T 93599b7a5b2c4798aaa9425aa5ecc686 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/93599b7a5b2c4798aaa9425aa5ecc686
I20260709 13:14:15.362636 31921 raft_consensus.cc:2272] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:15.364346 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 93599b7a5b2c4798aaa9425aa5ecc686 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:15.366621 31921 ts_tablet_manager.cc:1916] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:15.380682 31921 ts_tablet_manager.cc:1929] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:15.381125 31921 log.cc:1199] T 305d528ec3044fc288a8d49789c8d2ab P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/305d528ec3044fc288a8d49789c8d2ab
I20260709 13:14:15.382568 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 305d528ec3044fc288a8d49789c8d2ab (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:16.443216 30883 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:16.448886 30952 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.449275 31028 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:16.449460 30847 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23d60dde9ca04c6d8ed4b863efa56b5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.450269 31900 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.451092 31894 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.458513 31896 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.460451 31028 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.460436 30952 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.477183 30952 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:16.478405 30781 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:16.487579 30922 consensus_peers.cc:597] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a248ff3a5e13493783eef6f7b80fb0ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.490262 31028 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.492112 31883 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.493036 30883 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.496166 31883 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.508342 31911 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.511232 31028 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.525360 30883 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.530025 30876 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:16.531468 30779 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:16.571259 30847 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03793cde81754b27ba1c03bc763faac4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.571326 30954 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.573875 31900 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.576704 31028 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.578357 31900 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:16.582094 31894 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.583817 30954 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.596519 31028 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.602210 30952 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:16.605368 30778 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:16.620710 30922 consensus_peers.cc:597] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d310a2b2db8c4c22a71ff675ed506d7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:16.620797 31023 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.621620 30876 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:16.623731 31909 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.625547 31909 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.639492 31911 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.641654 31023 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.648104 30876 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.663496 30781 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:16.863277 31941 ts_tablet_manager.cc:933] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:16.865576 31941 tablet_copy_client.cc:323] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:16.867755 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet a248ff3a5e13493783eef6f7b80fb0ea from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:16.868407 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet a248ff3a5e13493783eef6f7b80fb0ea from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-a248ff3a5e13493783eef6f7b80fb0ea
I20260709 13:14:16.874948 30968 tablet_copy_source_session.cc:215] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:16.878021 31941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a248ff3a5e13493783eef6f7b80fb0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.892625 31941 tablet_copy_client.cc:806] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:16.893270 31941 tablet_copy_client.cc:670] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:16.897240 31941 tablet_copy_client.cc:538] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:16.905674 31941 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:16.923246 31941 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:16.924083 31941 tablet_bootstrap.cc:492] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:16.924728 31941 ts_tablet_manager.cc:1403] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.001s
I20260709 13:14:16.927289 31941 raft_consensus.cc:359] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:16.928012 31941 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:16.928680 31941 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:16.936148 31941 ts_tablet_manager.cc:1434] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:14:16.938010 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-a248ff3a5e13493783eef6f7b80fb0ea received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:16.938510 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-a248ff3a5e13493783eef6f7b80fb0ea on tablet a248ff3a5e13493783eef6f7b80fb0ea with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:16.985232 31941 ts_tablet_manager.cc:933] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:16.989171 31941 tablet_copy_client.cc:323] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:16.991194 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 23d60dde9ca04c6d8ed4b863efa56b5c from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:16.991851 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 23d60dde9ca04c6d8ed4b863efa56b5c from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-23d60dde9ca04c6d8ed4b863efa56b5c
I20260709 13:14:16.998046 30893 tablet_copy_source_session.cc:215] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:17.001528 31941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d60dde9ca04c6d8ed4b863efa56b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.015376 31941 tablet_copy_client.cc:806] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:17.016286 31941 tablet_copy_client.cc:670] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:17.020251 31941 tablet_copy_client.cc:538] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:17.027704 31941 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:17.047758 31941 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:17.048864 31941 tablet_bootstrap.cc:492] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:17.049429 31941 ts_tablet_manager.cc:1403] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.003s
I20260709 13:14:17.051628 31941 raft_consensus.cc:359] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:17.052328 31941 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:17.052917 31941 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:17.054984 31941 ts_tablet_manager.cc:1434] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:17.057318 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-23d60dde9ca04c6d8ed4b863efa56b5c received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:17.057749 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-23d60dde9ca04c6d8ed4b863efa56b5c on tablet 23d60dde9ca04c6d8ed4b863efa56b5c with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:17.165261 31941 ts_tablet_manager.cc:933] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:17.166934 31941 tablet_copy_client.cc:323] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:17.168526 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 03793cde81754b27ba1c03bc763faac4 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:17.168977 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 03793cde81754b27ba1c03bc763faac4 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-03793cde81754b27ba1c03bc763faac4
I20260709 13:14:17.174351 30893 tablet_copy_source_session.cc:215] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:17.177430 31941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03793cde81754b27ba1c03bc763faac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.196249 31941 tablet_copy_client.cc:806] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:17.197144 31941 tablet_copy_client.cc:670] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:17.203486 31941 tablet_copy_client.cc:538] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:17.231832 31941 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:17.235103 31948 ts_tablet_manager.cc:933] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:17.237164 31948 tablet_copy_client.cc:323] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:17.244902 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet d310a2b2db8c4c22a71ff675ed506d7e from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:17.245503 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet d310a2b2db8c4c22a71ff675ed506d7e from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-d310a2b2db8c4c22a71ff675ed506d7e
I20260709 13:14:17.255064 30968 tablet_copy_source_session.cc:215] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:17.259968 31948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d310a2b2db8c4c22a71ff675ed506d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:17.292696 31948 tablet_copy_client.cc:806] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:17.293392 31948 tablet_copy_client.cc:670] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:17.294273 31941 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:17.295296 31941 tablet_bootstrap.cc:492] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:17.296126 31941 ts_tablet_manager.cc:1403] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.019s
I20260709 13:14:17.297822 31948 tablet_copy_client.cc:538] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:17.299201 31941 raft_consensus.cc:359] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:17.300160 31941 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:17.307627 31948 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:17.300953 31941 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:17.313858 31941 ts_tablet_manager.cc:1434] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:14:17.317638 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-03793cde81754b27ba1c03bc763faac4 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:17.318069 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-03793cde81754b27ba1c03bc763faac4 on tablet 03793cde81754b27ba1c03bc763faac4 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:17.329602 31948 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:17.330375 31948 tablet_bootstrap.cc:492] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:17.330921 31948 ts_tablet_manager.cc:1403] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.001s
I20260709 13:14:17.333331 31948 raft_consensus.cc:359] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:17.334138 31948 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:17.334771 31948 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:17.337445 31948 ts_tablet_manager.cc:1434] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:14:17.339054 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-d310a2b2db8c4c22a71ff675ed506d7e received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:17.339480 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-d310a2b2db8c4c22a71ff675ed506d7e on tablet d310a2b2db8c4c22a71ff675ed506d7e with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:17.384707 31602 raft_consensus.cc:1217] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:17.502315 31602 raft_consensus.cc:1217] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:17.656484 31602 raft_consensus.cc:1217] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:17.787053 31602 raft_consensus.cc:1217] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:17.829419 31886 raft_consensus.cc:1064] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:17.831890 31886 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:17.844521 31602 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.845081 31028 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.848062 31911 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.851799 30876 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.857769 31883 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.860464 31886 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:17.894088 31911 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:17.895862 30878 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:17.906062 31900 raft_consensus.cc:1064] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:17.908003 31900 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:17.916044 31028 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:17.913506 30781 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:17.929566 31604 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.929971 31023 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:17.932241 31896 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:17.933209 31894 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:14:17.943653 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 97329.8us
I20260709 13:14:17.977646 31894 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:17.997355 31023 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.007567 31602 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.042366 30952 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.044270 31961 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.044900 31604 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.061691 30952 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.071561 30781 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.077277 30951 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:18.082782 31604 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.083052 31023 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.084324 31911 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.085872 31900 raft_consensus.cc:1064] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:18.088289 31883 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.088688 31900 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:18.091046 31911 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.092836 31602 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.097679 31028 raft_consensus.cc:2955] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.100466 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a248ff3a5e13493783eef6f7b80fb0ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.113217 30779 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.126682 31602 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.126776 31028 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.129558 31963 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.130829 31900 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.132508 30951 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.142575 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet a248ff3a5e13493783eef6f7b80fb0ea with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:18.142735 31896 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.145196 31975 tablet_replica.cc:333] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:18.146227 31975 raft_consensus.cc:2243] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.146935 31975 raft_consensus.cc:2272] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.153545 31975 ts_tablet_manager.cc:1916] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.158255 31896 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.169243 31604 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.173606 31030 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.178746 31975 ts_tablet_manager.cc:1929] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:18.179494 31975 log.cc:1199] T a248ff3a5e13493783eef6f7b80fb0ea P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/a248ff3a5e13493783eef6f7b80fb0ea
I20260709 13:14:18.181267 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet a248ff3a5e13493783eef6f7b80fb0ea (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:18.170343 30951 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.190089 30779 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.210647 30883 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:18.221800 30951 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.223891 31900 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.229756 31604 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.231413 31962 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.231173 31894 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.240043 31604 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.244527 30954 raft_consensus.cc:2955] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.247390 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03793cde81754b27ba1c03bc763faac4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.260919 30779 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.280536 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 03793cde81754b27ba1c03bc763faac4 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:18.283296 31978 tablet_replica.cc:333] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:18.284464 31978 raft_consensus.cc:2243] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.285878 31978 raft_consensus.cc:2272] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.289112 31978 ts_tablet_manager.cc:1916] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.307054 31978 ts_tablet_manager.cc:1929] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:18.307538 31978 log.cc:1199] T 03793cde81754b27ba1c03bc763faac4 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/03793cde81754b27ba1c03bc763faac4
I20260709 13:14:18.309983 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 03793cde81754b27ba1c03bc763faac4 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:18.355520 31883 raft_consensus.cc:1064] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:18.357488 31883 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:18.363312 31604 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.365209 31030 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.365562 30883 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:18.365466 31911 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.367113 31911 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.368062 31883 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:18.379236 31954 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.381314 31604 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.386329 30883 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.392434 31030 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.395452 30781 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.420127 30954 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:18.426864 31030 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.428158 31604 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.428385 31886 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.430130 31954 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.436822 31911 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.438277 31604 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.451789 31028 raft_consensus.cc:2955] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.458181 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d310a2b2db8c4c22a71ff675ed506d7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.457852 30779 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.460342 30883 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:18.468972 31602 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.470430 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet d310a2b2db8c4c22a71ff675ed506d7e with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:18.470518 31896 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.472503 31975 tablet_replica.cc:333] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:18.473569 31975 raft_consensus.cc:2243] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.474328 31975 raft_consensus.cc:2272] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.480994 31975 ts_tablet_manager.cc:1916] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.481526 31896 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.482970 31602 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.484570 30954 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:18.491350 31961 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:18.495596 30954 raft_consensus.cc:2955] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:18.500597 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23d60dde9ca04c6d8ed4b863efa56b5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:18.504906 31975 ts_tablet_manager.cc:1929] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:18.505405 31975 log.cc:1199] T d310a2b2db8c4c22a71ff675ed506d7e P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/d310a2b2db8c4c22a71ff675ed506d7e
I20260709 13:14:18.507393 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet d310a2b2db8c4c22a71ff675ed506d7e (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:18.509316 30779 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.527408 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 23d60dde9ca04c6d8ed4b863efa56b5c with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:18.528391 31978 tablet_replica.cc:333] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:18.541324 31978 raft_consensus.cc:2243] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:18.542068 31978 raft_consensus.cc:2272] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:18.545974 31978 ts_tablet_manager.cc:1916] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:18.561548 31978 ts_tablet_manager.cc:1929] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:18.562031 31978 log.cc:1199] T 23d60dde9ca04c6d8ed4b863efa56b5c P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/23d60dde9ca04c6d8ed4b863efa56b5c
I20260709 13:14:18.563613 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 23d60dde9ca04c6d8ed4b863efa56b5c (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:19.598354 30876 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:19.605741 31028 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.607954 31896 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:14:19.610764 30847 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ada02d2b3964383bd24a8a7b03c7ceb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.618115 31961 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.621732 30954 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.619714 31028 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.623723 31896 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.635928 31030 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:19.643460 30779 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.652406 30954 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:19.656795 30996 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e61719587d824d0680b05c15592027a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.659631 30876 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:19.661120 31967 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.662839 30951 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:19.668006 31967 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:19.673908 31716 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.677838 30876 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.689709 30954 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:19.691026 30951 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.695183 30781 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.709213 31030 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:19.710924 30922 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1c88e7048de4bf6844c6d2a437a128f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.711927 30883 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.714960 31886 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.717000 31883 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.726909 31886 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.730048 31030 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.732971 30876 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.744658 30954 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:19.746057 30779 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:19.759415 31030 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:19.759716 30883 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:19.765378 30922 consensus_peers.cc:597] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b53c19478dc740149d296778042dd3a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:19.766083 31999 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:19.769394 31886 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:19.777472 31028 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.775962 31999 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.780081 30883 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:19.792114 30781 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:20.009775 32003 ts_tablet_manager.cc:933] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:20.012351 32003 tablet_copy_client.cc:323] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:20.013978 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 0ada02d2b3964383bd24a8a7b03c7ceb from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:20.014441 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 0ada02d2b3964383bd24a8a7b03c7ceb from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-0ada02d2b3964383bd24a8a7b03c7ceb
I20260709 13:14:20.020315 30893 tablet_copy_source_session.cc:215] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.023409 32003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ada02d2b3964383bd24a8a7b03c7ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.036209 32003 tablet_copy_client.cc:806] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.036803 32003 tablet_copy_client.cc:670] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.042433 32003 tablet_copy_client.cc:538] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.049644 32003 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:20.076413 32003 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.077312 32003 tablet_bootstrap.cc:492] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:20.077987 32003 ts_tablet_manager.cc:1403] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 13:14:20.080802 32003 raft_consensus.cc:359] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.081518 32003 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:20.082087 32003 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.084947 32003 ts_tablet_manager.cc:1434] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:20.086941 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-0ada02d2b3964383bd24a8a7b03c7ceb received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:20.087349 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-0ada02d2b3964383bd24a8a7b03c7ceb on tablet 0ada02d2b3964383bd24a8a7b03c7ceb with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:20.223225 32003 ts_tablet_manager.cc:933] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:20.226482 32003 tablet_copy_client.cc:323] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:20.228700 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet e61719587d824d0680b05c15592027a3 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:20.229225 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet e61719587d824d0680b05c15592027a3 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-e61719587d824d0680b05c15592027a3
I20260709 13:14:20.235848 31041 tablet_copy_source_session.cc:215] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.245090 32003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61719587d824d0680b05c15592027a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.267449 32009 ts_tablet_manager.cc:933] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:20.270661 32003 tablet_copy_client.cc:806] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.271382 32003 tablet_copy_client.cc:670] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.273546 32011 ts_tablet_manager.cc:933] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:20.276225 32003 tablet_copy_client.cc:538] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.277305 32009 tablet_copy_client.cc:323] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:20.278908 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet b1c88e7048de4bf6844c6d2a437a128f from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:20.279415 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet b1c88e7048de4bf6844c6d2a437a128f from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-b1c88e7048de4bf6844c6d2a437a128f
I20260709 13:14:20.287014 30968 tablet_copy_source_session.cc:215] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.287252 32003 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:20.292590 32011 tablet_copy_client.cc:323] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:20.294485 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet b53c19478dc740149d296778042dd3a8 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:20.294746 32009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c88e7048de4bf6844c6d2a437a128f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.315549 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet b53c19478dc740149d296778042dd3a8 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-b53c19478dc740149d296778042dd3a8
I20260709 13:14:20.325163 30968 tablet_copy_source_session.cc:215] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:20.326354 32003 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.333595 32003 tablet_bootstrap.cc:492] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:20.334465 32003 ts_tablet_manager.cc:1403] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.007s
I20260709 13:14:20.328579 32011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53c19478dc740149d296778042dd3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:20.337522 32003 raft_consensus.cc:359] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.338320 32003 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:20.338929 32003 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.347685 32009 tablet_copy_client.cc:806] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.348320 32009 tablet_copy_client.cc:670] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.349584 32011 tablet_copy_client.cc:806] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:20.350173 32011 tablet_copy_client.cc:670] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:20.352816 32003 ts_tablet_manager.cc:1434] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:14:20.356380 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-e61719587d824d0680b05c15592027a3 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:20.356817 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-e61719587d824d0680b05c15592027a3 on tablet e61719587d824d0680b05c15592027a3 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:20.358718 32009 tablet_copy_client.cc:538] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.360034 32011 tablet_copy_client.cc:538] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:20.370045 32011 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:20.370152 32009 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:20.392016 32009 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.392587 32011 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:20.392751 32009 tablet_bootstrap.cc:492] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:20.393429 32009 ts_tablet_manager.cc:1403] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.007s
I20260709 13:14:20.393448 32011 tablet_bootstrap.cc:492] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:20.394258 32011 ts_tablet_manager.cc:1403] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.004s
I20260709 13:14:20.396272 32009 raft_consensus.cc:359] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.397302 32009 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:20.397198 32011 raft_consensus.cc:359] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.398089 32011 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:20.398059 32009 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.398903 32011 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:20.402036 32011 ts_tablet_manager.cc:1434] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:20.403993 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-b53c19478dc740149d296778042dd3a8 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:20.404263 32009 ts_tablet_manager.cc:1434] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:14:20.404412 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-b53c19478dc740149d296778042dd3a8 on tablet b53c19478dc740149d296778042dd3a8 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:20.407980 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-b1c88e7048de4bf6844c6d2a437a128f received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:20.408414 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-b1c88e7048de4bf6844c6d2a437a128f on tablet b1c88e7048de4bf6844c6d2a437a128f with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:20.540446 31602 raft_consensus.cc:1217] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.626186 31602 raft_consensus.cc:1217] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.689353 31602 raft_consensus.cc:1217] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:20.769527 31602 raft_consensus.cc:1217] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:14:21.085882 32002 raft_consensus.cc:1064] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:21.088400 32002 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.099042 31030 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.099177 31602 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.100430 32002 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.101701 30876 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.101644 31886 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.104504 31886 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.116729 31986 raft_consensus.cc:1064] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:21.120419 31986 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.148180 32002 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.165552 31028 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.169693 31602 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.171481 32017 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.176307 30876 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.178130 31602 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.183373 30954 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.185099 31986 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.189841 32023 raft_consensus.cc:1064] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:21.192909 32023 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.182799 30779 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.205240 31028 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.208581 31896 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:21.262368 32008 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.282999 31023 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:21.294739 32029 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:14:21.307190 31029 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.307693 30876 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.309264 31602 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:21.314129 31999 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.309136 30954 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.315582 32031 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:21.320988 31999 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:21.327392 31603 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.341924 32031 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.348017 31029 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.347843 31603 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.356482 30876 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.365520 30954 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.381669 30780 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.385551 32016 raft_consensus.cc:1064] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:21.385380 30780 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.392571 32016 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.401252 31602 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.403183 32023 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.407049 30876 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.408641 32023 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:21.415539 31603 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:21.414846 31999 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.416626 30954 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:21.418304 30883 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:21.418625 32016 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.418789 30876 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.419900 32018 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.421802 31602 raft_consensus.cc:2955] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.423301 32018 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.441830 30878 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.449014 30951 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.457940 31029 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.458961 31604 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.460897 31604 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.461099 31029 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:21.462278 32008 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.462906 30776 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.464339 32002 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.467994 32002 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:21.470619 32008 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:21.475219 31886 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.478036 31030 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.490082 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet b1c88e7048de4bf6844c6d2a437a128f with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:21.490281 31896 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.502724 31602 raft_consensus.cc:2955] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.504304 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b53c19478dc740149d296778042dd3a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.508154 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ada02d2b3964383bd24a8a7b03c7ceb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.516101 31601 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.506418 31023 raft_consensus.cc:2955] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.522907 30781 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.519258 30776 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.546783 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet b53c19478dc740149d296778042dd3a8 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:21.559994 31994 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.564049 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ada02d2b3964383bd24a8a7b03c7ceb with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:21.564486 31601 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.576522 32042 tablet_replica.cc:333] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:21.577672 32042 raft_consensus.cc:2243] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.578486 32042 raft_consensus.cc:2272] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.578691 30876 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.583268 32042 ts_tablet_manager.cc:1916] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.588374 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1c88e7048de4bf6844c6d2a437a128f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.602458 32043 tablet_replica.cc:333] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:21.613124 32042 ts_tablet_manager.cc:1929] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:21.613669 32042 log.cc:1199] T b1c88e7048de4bf6844c6d2a437a128f P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/b1c88e7048de4bf6844c6d2a437a128f
I20260709 13:14:21.616849 30954 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.622905 32043 raft_consensus.cc:2243] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.623741 32043 raft_consensus.cc:2272] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.611090 32044 tablet_replica.cc:333] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:21.620951 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet b1c88e7048de4bf6844c6d2a437a128f (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:21.626616 30780 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.628630 32043 ts_tablet_manager.cc:1916] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.643088 32044 raft_consensus.cc:2243] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.644040 32044 raft_consensus.cc:2272] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.647861 32044 ts_tablet_manager.cc:1916] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.658144 31028 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:21.658625 32043 ts_tablet_manager.cc:1929] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:21.659344 32043 log.cc:1199] T b53c19478dc740149d296778042dd3a8 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/b53c19478dc740149d296778042dd3a8
I20260709 13:14:21.661886 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet b53c19478dc740149d296778042dd3a8 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:21.666576 30876 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:21.666576 31601 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:21.668156 32018 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.669867 31994 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:21.676329 32044 ts_tablet_manager.cc:1929] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:21.676838 32044 log.cc:1199] T 0ada02d2b3964383bd24a8a7b03c7ceb P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/0ada02d2b3964383bd24a8a7b03c7ceb
I20260709 13:14:21.678473 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 0ada02d2b3964383bd24a8a7b03c7ceb (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:21.675834 31994 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.680284 31603 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.689934 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e61719587d824d0680b05c15592027a3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:21.695288 30876 raft_consensus.cc:2955] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:21.699388 30779 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.712002 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet e61719587d824d0680b05c15592027a3 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:21.712875 32044 tablet_replica.cc:333] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:21.713792 32044 raft_consensus.cc:2243] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:21.714469 32044 raft_consensus.cc:2272] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:21.718495 32044 ts_tablet_manager.cc:1916] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:21.734341 32044 ts_tablet_manager.cc:1929] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:14:21.734632 32044 log.cc:1199] T e61719587d824d0680b05c15592027a3 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/e61719587d824d0680b05c15592027a3
I20260709 13:14:21.735966 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet e61719587d824d0680b05c15592027a3 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:22.051846 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:22.107312 30883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:22.107996 30883 raft_consensus.cc:606] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:22.110154 30883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:22.110651 30883 raft_consensus.cc:606] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:22.113364 30876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:22.113742 30876 raft_consensus.cc:606] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:22.124922 30952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:22.125425 30952 raft_consensus.cc:606] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:22.127904 30876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:22.128383 30876 raft_consensus.cc:606] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:22.129392 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:22.130786 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:22.157377 31896 raft_consensus.cc:993] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:22.157951 31896 raft_consensus.cc:1081] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:22.159461 31030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:22.160030 31030 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.160295 31030 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.164855 31030 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.166944 31030 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:22.168016 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:22.168685 30952 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.169422 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:22.170018 30876 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:22.170332 30876 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:22.171205 30876 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.172533 30876 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.174790 30952 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:22.175984 30997 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:22.176648 31994 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:22.177156 31994 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:22.178030 31994 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.178601 30876 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:22.187539 30780 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.355304 31986 raft_consensus.cc:993] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:22.355752 31896 raft_consensus.cc:1081] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:22.357219 31601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:22.357632 31601 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.357884 31601 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.363623 31601 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:22.365645 31601 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:22.366289 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:22.366552 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:22.366881 30876 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:22.367188 31030 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.367239 30876 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:22.368088 30876 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:22.368992 30876 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.372052 31030 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:22.373239 31570 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:22.374145 30876 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:22.374794 32049 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:22.375985 32049 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:22.376945 32049 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:22.385362 30780 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.415581 31986 raft_consensus.cc:993] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:22.416132 31896 raft_consensus.cc:1081] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:22.417732 31030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:22.418278 31030 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.418615 31030 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.425050 31030 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.426605 31030 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:22.427291 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:22.427889 30883 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:22.427832 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:22.428306 30883 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:22.428490 30952 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.429028 30883 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.429915 30883 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.434316 30883 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:22.435791 30998 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:22.434650 30952 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:22.438761 32016 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:22.439248 32016 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:22.440104 32016 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.446942 32031 raft_consensus.cc:993] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:22.447496 31886 raft_consensus.cc:1081] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:22.449422 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:22.449910 30883 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.450232 30883 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.451251 30780 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.456077 30883 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.458258 30883 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:22.459172 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:22.459801 30952 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:22.460108 30952 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:22.460819 30952 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.462060 30952 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.461993 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:22.463132 31030 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.468847 30952 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:22.469995 31030 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:22.470305 30848 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:22.471333 31986 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:22.472482 31986 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:22.473316 31986 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.482638 30780 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.537995 31896 raft_consensus.cc:993] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:22.538429 31986 raft_consensus.cc:1081] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:22.539711 31030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:22.540192 31030 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:22.540426 31030 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.544548 31030 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.546635 31030 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:22.546809 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:22.546916 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:22.547449 30952 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.547410 30876 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:22.547950 30876 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:22.548696 30876 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.549772 30876 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:22.553169 30952 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:22.554394 30997 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:22.555104 32016 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:22.555205 30876 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:22.555544 32016 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:22.556483 32016 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:22.565609 30780 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.672159 30883 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.673588 31994 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.684126 30952 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.690531 32059 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:22.780511 30954 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:22.786401 31030 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:22.786506 30922 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bced1836a1cd4749bcd4db4d53decc9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.787063 30883 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:22.787654 32055 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.788658 32031 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:22.796105 31886 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.798138 31028 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.804325 30883 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.815454 30780 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.820873 31028 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:22.828537 30954 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:22.829393 30996 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdbb6fa9a0f3410e860b9d01eb25293d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.829876 30883 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:22.831128 31994 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.835294 32059 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.837970 31994 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.839605 30876 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.846393 30954 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:22.851327 31028 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:22.852756 32049 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:22.857333 30776 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:22.858722 30952 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:22.941305 30922 consensus_peers.cc:597] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6167067c2f0e477d90c7f8d4171022d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.974108 30876 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:22.977303 32049 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:22.980178 31030 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:22.984447 32031 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:14:22.987545 30876 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:22.993364 30952 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:22.993258 31886 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.003293 32061 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.008728 30878 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:23.008157 30876 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.013660 32060 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.015053 31994 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.021524 30952 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:23.024045 32070 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.029403 30952 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:23.057241 30922 consensus_peers.cc:597] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f5fc12a76fb487399ec1bbd35b7a4ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.062407 30874 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.063539 31028 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:23.064375 31023 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:23.066040 32070 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.075107 32061 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.082732 31030 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.092468 32061 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.097373 30779 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.116675 32061 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.120280 31030 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.129285 30878 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:23.131804 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:23.136852 32059 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:23.170739 30952 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:23.205050 30779 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.228509 31994 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:23.230484 30883 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:23.258489 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:23.330029 32088 ts_tablet_manager.cc:933] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:23.337400 32088 tablet_copy_client.cc:323] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:23.337225 30951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076984be4730440fba459e1d130954f5"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:23.338197 30951 raft_consensus.cc:606] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:23.343200 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 6167067c2f0e477d90c7f8d4171022d3 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:23.343741 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 6167067c2f0e477d90c7f8d4171022d3 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-6167067c2f0e477d90c7f8d4171022d3
I20260709 13:14:23.358232 30968 tablet_copy_source_session.cc:215] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.367369 32088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6167067c2f0e477d90c7f8d4171022d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.377157 32092 ts_tablet_manager.cc:933] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:23.381388 32090 ts_tablet_manager.cc:933] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:23.397495 32092 tablet_copy_client.cc:323] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:23.402818 32090 tablet_copy_client.cc:323] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:23.404645 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet fdbb6fa9a0f3410e860b9d01eb25293d from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:23.404721 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet bced1836a1cd4749bcd4db4d53decc9a from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:23.405236 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet fdbb6fa9a0f3410e860b9d01eb25293d from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-fdbb6fa9a0f3410e860b9d01eb25293d
I20260709 13:14:23.405316 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet bced1836a1cd4749bcd4db4d53decc9a from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-bced1836a1cd4749bcd4db4d53decc9a
I20260709 13:14:23.414072 32088 tablet_copy_client.cc:806] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.414718 32088 tablet_copy_client.cc:670] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.427291 32088 tablet_copy_client.cc:538] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.429956 31041 tablet_copy_source_session.cc:215] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.439759 30968 tablet_copy_source_session.cc:215] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.440181 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:23.440750 31028 raft_consensus.cc:606] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.437157 32088 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:23.444123 30951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:23.444690 30951 raft_consensus.cc:606] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:23.450088 30951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92cbaf1d3603474f977498657c46f628"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:23.450649 30951 raft_consensus.cc:606] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:23.452068 32092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bced1836a1cd4749bcd4db4d53decc9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.454216 30951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:23.454828 30951 raft_consensus.cc:606] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.458249 32090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdbb6fa9a0f3410e860b9d01eb25293d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.461346 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:23.461948 30874 raft_consensus.cc:606] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.463874 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:23.465467 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:23.484360 32092 tablet_copy_client.cc:806] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.485119 32092 tablet_copy_client.cc:670] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.487360 32088 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.488317 32088 tablet_bootstrap.cc:492] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:23.488963 32088 ts_tablet_manager.cc:1403] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.052s	user 0.033s	sys 0.000s
I20260709 13:14:23.491902 32088 raft_consensus.cc:359] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.492749 32088 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:23.493673 32092 tablet_copy_client.cc:538] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.493387 32088 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.495934 32088 ts_tablet_manager.cc:1434] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:23.499871 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-6167067c2f0e477d90c7f8d4171022d3 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:23.500294 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-6167067c2f0e477d90c7f8d4171022d3 on tablet 6167067c2f0e477d90c7f8d4171022d3 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.504827 32092 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:23.519347 32055 raft_consensus.cc:993] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:23.519989 32055 raft_consensus.cc:1081] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:23.523871 32090 tablet_copy_client.cc:806] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.524464 32090 tablet_copy_client.cc:670] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.532986 30874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "076984be4730440fba459e1d130954f5"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:23.536572 30874 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.534049 32092 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.536989 30874 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.537954 32092 tablet_bootstrap.cc:492] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:23.538617 32092 ts_tablet_manager.cc:1403] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.014s
I20260709 13:14:23.543023 32092 raft_consensus.cc:359] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.543877 32092 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:23.544040 30874 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:23.544569 32092 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.547555 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:23.547654 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:23.548120 31030 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.548246 30951 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:23.548633 30951 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:23.549360 30951 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:23.550359 30951 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.551172 32092 ts_tablet_manager.cc:1434] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:23.554337 32031 raft_consensus.cc:993] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:23.554720 30874 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:23.554836 32031 raft_consensus.cc:1081] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:23.557070 32090 tablet_copy_client.cc:538] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:23.557005 30878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92cbaf1d3603474f977498657c46f628"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:23.557631 30878 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.557972 30878 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.558518 30951 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:23.560530 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:23.572307 31896 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:23.574880 31896 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:23.575699 31896 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:23.578640 30878 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:23.580667 30878 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:23.566596 32090 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:23.570112 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-bced1836a1cd4749bcd4db4d53decc9a received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:23.581482 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-bced1836a1cd4749bcd4db4d53decc9a on tablet bced1836a1cd4749bcd4db4d53decc9a with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.581947 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:23.582508 31028 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.588841 31030 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:23.589931 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:23.590600 30951 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:23.590878 30951 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:23.592505 30951 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:23.593040 31028 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:23.593592 31886 raft_consensus.cc:993] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:23.593647 30951 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.594129 31886 raft_consensus.cc:1081] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:23.594295 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:23.595105 32070 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:23.595845 32070 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:23.596715 32070 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:23.599741 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:23.600342 30883 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.600678 30883 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.606352 30951 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:23.622866 30776 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.639393 30883 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.641956 30883 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:23.653239 32092 ts_tablet_manager.cc:933] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:23.654659 31896 raft_consensus.cc:993] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:23.655164 31896 raft_consensus.cc:1081] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:23.643534 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:23.642916 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:23.656404 30951 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:23.656453 31028 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.656793 30951 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:23.657564 30951 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.658830 30951 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.670188 30951 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:23.672207 30848 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:23.672904 31601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:23.673177 32101 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:23.673512 31601 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.673730 32101 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:23.673907 31601 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.674693 32101 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.679505 30776 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.684346 32090 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.685436 32090 tablet_bootstrap.cc:492] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:23.684789 31601 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:23.688915 32090 ts_tablet_manager.cc:1403] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.123s	user 0.027s	sys 0.012s
I20260709 13:14:23.690853 31601 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:23.694450 31028 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:23.695863 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:23.695876 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:23.696764 30951 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.699158 32090 raft_consensus.cc:359] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.699954 32090 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:23.700709 32090 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.703737 32090 ts_tablet_manager.cc:1434] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:14:23.696637 30874 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:23.704777 30874 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:23.704885 32092 tablet_copy_client.cc:323] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:23.705828 30874 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:23.707072 30951 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:23.707207 30874 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.700664 30776 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:23.708461 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:23.709237 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:23.709741 32082 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:23.710295 32082 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:23.711109 32082 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:23.713357 31041 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-fdbb6fa9a0f3410e860b9d01eb25293d received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:23.713830 31041 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-fdbb6fa9a0f3410e860b9d01eb25293d on tablet fdbb6fa9a0f3410e860b9d01eb25293d with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.709774 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 9f5fc12a76fb487399ec1bbd35b7a4ca from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-9f5fc12a76fb487399ec1bbd35b7a4ca
I20260709 13:14:23.715158 30874 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:23.723182 30968 tablet_copy_source_session.cc:215] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:23.724846 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:23.726612 32092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:23.725556 30874 raft_consensus.cc:606] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership
I20260709 13:14:23.732249 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:23.732795 30874 raft_consensus.cc:606] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership
I20260709 13:14:23.733033 30776 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:23.733912 30768 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 6167067c2f0e477d90c7f8d4171022d3 already in progress [suppressed 3 similar messages]
I20260709 13:14:23.741753 32092 tablet_copy_client.cc:806] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:23.742342 32092 tablet_copy_client.cc:670] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:23.742221 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:23.742836 30874 raft_consensus.cc:606] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership
I20260709 13:14:23.745920 32092 tablet_copy_client.cc:538] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:23.747035 30829 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:14:23.747476 30829 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6167067c2f0e477d90c7f8d4171022d3 already in progress
W20260709 13:14:23.747730 30829 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6167067c2f0e477d90c7f8d4171022d3 already in progress
I20260709 13:14:23.757193 32092 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:23.776023 32092 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:23.776935 32092 tablet_bootstrap.cc:492] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:23.777537 32092 ts_tablet_manager.cc:1403] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:14:23.779891 32092 raft_consensus.cc:359] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.780527 32092 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:23.781036 32092 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:23.841794 32092 ts_tablet_manager.cc:1434] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.064s	user 0.015s	sys 0.016s
I20260709 13:14:23.846613 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-9f5fc12a76fb487399ec1bbd35b7a4ca received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:23.847064 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-9f5fc12a76fb487399ec1bbd35b7a4ca on tablet 9f5fc12a76fb487399ec1bbd35b7a4ca with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:23.899230 32061 raft_consensus.cc:993] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:23.901003 32061 raft_consensus.cc:1081] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:23.903172 31603 raft_consensus.cc:1217] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:23.904523 31604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:14:23.905226 31604 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.905589 31604 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.923826 31604 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:23.926740 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:23.927377 30951 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:23.927671 30951 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:23.928396 30951 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:23.929273 30951 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:23.929836 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 43904.5us
I20260709 13:14:23.932870 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:23.933525 30874 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:23.953138 30874 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:23.953799 30883 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:23.926234 31604 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:23.961639 30951 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:23.962116 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:23.962986 32082 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:23.963466 32082 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:23.964285 32082 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:23.971630 31604 raft_consensus.cc:1217] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:23.978303 30779 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:23.990775 32016 raft_consensus.cc:993] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:23.991677 31994 raft_consensus.cc:1081] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:23.994379 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:14:23.994899 31603 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:23.995239 31603 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.003566 30955 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.007345 32070 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.013089 31028 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.014765 32070 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.017007 31603 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.028040 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:24.028654 30883 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.031168 31603 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:24.044284 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:24.044902 31030 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:24.045179 31030 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:24.045924 31030 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.047082 31030 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:24.041690 30883 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:24.053830 31030 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:24.054793 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:24.056068 32082 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:24.056592 32082 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:24.059315 32082 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.061496 31604 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Advancing to term 2
I20260709 13:14:24.077942 31604 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:24.087198 31896 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:24.088104 31030 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:24.089751 32070 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.106830 30776 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.162104 30955 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:24.162251 32113 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:14:24.163630 32070 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:24.173086 30951 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:24.180476 32117 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:24.189256 31029 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:24.192669 32117 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.202486 32102 raft_consensus.cc:1064] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
W20260709 13:14:24.202927 32102 raft_consensus.cc:1068] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Unable to promote non-voter 74f5a5b7556240508983221981af4ab4: Service unavailable: leader transfer in progress
I20260709 13:14:24.208877 31604 raft_consensus.cc:1217] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:24.217527 32117 raft_consensus.cc:993] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:24.218945 32070 raft_consensus.cc:1081] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:24.226848 30955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:14:24.232858 30955 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.233258 30955 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:24.238205 32101 raft_consensus.cc:1064] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
W20260709 13:14:24.238838 32101 raft_consensus.cc:1068] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Unable to promote non-voter 74f5a5b7556240508983221981af4ab4: Service unavailable: leader transfer in progress
I20260709 13:14:24.240170 30955 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:24.242628 30955 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:24.242847 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:24.243444 30883 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:24.243788 30883 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:24.244508 30883 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:24.245164 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:24.245677 31028 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:24.245916 30883 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:24.252972 30883 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:24.253726 31028 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:24.254118 30924 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:24.255327 32108 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:24.255860 32108 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:24.256696 32108 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:24.289470 30874 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.291105 32082 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.293300 30780 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:24.303025 30955 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.305706 32076 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:24.327819 32055 raft_consensus.cc:1064] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:24.330454 32055 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.346443 31604 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.347862 32108 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.348591 31028 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.350272 32109 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:24.351541 30874 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.352890 32055 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.390079 32109 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.392572 30874 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.394320 31028 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.408041 31604 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.420990 30780 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:24.425163 30874 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.429348 32076 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.439826 30949 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.449705 30955 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.450830 32076 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.456380 30883 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:24.459205 31603 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:24.461362 32109 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:24.464748 32031 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:24.466972 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:24.477897 32060 raft_consensus.cc:1064] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:24.483168 32031 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.486014 32060 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.489910 31603 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.524753 31028 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.531471 32076 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:24.564004 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bced1836a1cd4749bcd4db4d53decc9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:24.564586 30874 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:24.569244 32076 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:14:24.641953 32136 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:14:24.662027 31603 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:24.666477 30876 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:24.668469 32060 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:24.666514 30878 raft_consensus.cc:2955] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.679124 31603 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Advancing to term 3
I20260709 13:14:24.683458 30780 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:24.716234 32135 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
W20260709 13:14:24.701958 32134 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.133s	user 0.003s	sys 0.004s
I20260709 13:14:24.723397 32107 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:14:24.740689 31603 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:24.741605 32031 raft_consensus.cc:1064] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:24.742444 32108 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:24.764918 31886 raft_consensus.cc:1064] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
W20260709 13:14:24.765401 31886 raft_consensus.cc:1068] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Unable to promote non-voter 74f5a5b7556240508983221981af4ab4: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:14:24.779282 30955 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:14:24.790546 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 70852.1us
I20260709 13:14:24.801487 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet bced1836a1cd4749bcd4db4d53decc9a with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:24.829348 32107 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:24.838856 32031 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:24.891016 32142 tablet_replica.cc:333] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:24.906953 31994 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.929940 32142 raft_consensus.cc:2243] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:24.930207 31028 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.930434 31604 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:24.931298 32142 raft_consensus.cc:2272] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:24.916797 30874 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.931980 31886 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:24.932890 32055 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:24.944533 32142 ts_tablet_manager.cc:1916] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:24.962579 32142 ts_tablet_manager.cc:1929] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:24.963003 32142 log.cc:1199] T bced1836a1cd4749bcd4db4d53decc9a P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/bced1836a1cd4749bcd4db4d53decc9a
I20260709 13:14:24.965123 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet bced1836a1cd4749bcd4db4d53decc9a (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:24.968982 31886 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.971232 31603 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.983103 31028 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:24.998735 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:25.001701 30878 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:25.008320 30780 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.010746 31603 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.036222 31028 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:25.039376 32031 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:14:25.065404 30874 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:25.071062 30776 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.080700 32055 raft_consensus.cc:1064] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:25.082798 32108 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:25.084203 32138 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:25.102085 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076984be4730440fba459e1d130954f5"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:25.102823 30874 raft_consensus.cc:606] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:25.107003 32055 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.116865 30956 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.125403 30949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:25.126011 30949 raft_consensus.cc:606] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:25.127115 31603 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:25.129869 31604 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:25.132359 30874 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:25.135378 32138 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:25.138962 31886 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.139950 31023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:25.140323 31029 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:25.140538 31023 raft_consensus.cc:606] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:25.141950 31026 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:25.147001 31886 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:25.147241 32144 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:25.148626 30949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:25.149207 30949 raft_consensus.cc:606] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:25.152217 32031 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:14:25.151671 31028 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.158620 30879 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.193770 32031 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.195690 31603 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:25.198137 30876 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:25.201164 31994 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:25.164063 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:25.205510 30878 raft_consensus.cc:606] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:25.164755 30956 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.165915 31886 raft_consensus.cc:993] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:25.208664 31886 raft_consensus.cc:1081] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:25.171926 32144 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.215337 32060 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:25.217468 30951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:25.218024 30951 raft_consensus.cc:606] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:25.218124 32107 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.220214 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:25.220781 31602 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.221782 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:25.180859 31023 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.229071 31028 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.236961 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:25.238029 30878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:25.175069 31604 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.241057 30877 raft_consensus.cc:2955] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.249248 30878 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.249699 30878 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.255323 31603 raft_consensus.cc:2955] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.276686 30878 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:14:25.279237 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fdbb6fa9a0f3410e860b9d01eb25293d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:25.285144 30879 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.289811 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:25.290478 30951 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.290760 30951 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:25.291486 30951 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:14:25.292593 30951 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.294697 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:25.295290 31023 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.298666 30878 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:25.300074 30780 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.301924 31023 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:25.303040 30951 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:25.303238 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:25.304293 31986 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.304804 31986 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:25.305714 31986 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } }
I20260709 13:14:25.319188 30781 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.320950 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f5fc12a76fb487399ec1bbd35b7a4ca with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:25.324317 31994 raft_consensus.cc:993] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:25.324952 32016 raft_consensus.cc:1081] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:25.326599 30877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48714
I20260709 13:14:25.327100 30877 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.327421 30877 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.338059 30779 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.342551 32153 tablet_replica.cc:333] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:25.344018 32153 raft_consensus.cc:2243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.344758 32153 raft_consensus.cc:2272] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.350920 32153 ts_tablet_manager.cc:1916] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.353929 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet fdbb6fa9a0f3410e860b9d01eb25293d with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:25.360513 30877 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:25.362977 30877 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:25.365196 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:25.365809 30956 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.367589 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:25.368162 31028 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.368420 31028 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:25.369302 31028 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:25.370694 31028 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.378439 32154 tablet_replica.cc:333] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:25.379645 32154 raft_consensus.cc:2243] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.380713 32154 raft_consensus.cc:2272] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.379019 30949 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.384613 32154 ts_tablet_manager.cc:1916] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.384882 30779 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.387742 32147 raft_consensus.cc:993] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:25.388286 32147 raft_consensus.cc:1081] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:25.389442 31028 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:25.390074 31602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:25.390609 31602 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.390928 31602 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.395855 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:25.397085 31896 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.397509 31896 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:25.398236 31896 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:25.401080 32153 ts_tablet_manager.cc:1929] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:25.401604 32153 log.cc:1199] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/9f5fc12a76fb487399ec1bbd35b7a4ca
I20260709 13:14:25.402544 31604 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:25.403565 31028 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:25.403717 32154 ts_tablet_manager.cc:1929] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:25.403875 32031 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:25.404170 32154 log.cc:1199] T fdbb6fa9a0f3410e860b9d01eb25293d P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/fdbb6fa9a0f3410e860b9d01eb25293d
I20260709 13:14:25.405221 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 9f5fc12a76fb487399ec1bbd35b7a4ca (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:25.406442 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet fdbb6fa9a0f3410e860b9d01eb25293d (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:25.406354 32031 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:25.410689 30956 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:25.410928 31886 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.412231 31602 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.417614 31601 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.426590 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6167067c2f0e477d90c7f8d4171022d3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:25.418884 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:25.428380 30877 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.428686 30877 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:25.429487 30877 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.430568 30877 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.415899 31028 raft_consensus.cc:2955] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.435200 32117 raft_consensus.cc:993] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:25.435662 31896 raft_consensus.cc:1081] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:25.437186 31026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "076984be4730440fba459e1d130954f5"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:25.437606 31026 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.437955 31026 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:25.420855 31602 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:25.446506 30779 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:25.437845 30877 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:25.453064 31571 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:25.454177 32132 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.454672 32132 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:25.454818 30780 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:25.455603 32132 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.472278 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:25.473166 30956 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.480527 30956 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:25.482452 32150 raft_consensus.cc:993] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:25.483003 32150 raft_consensus.cc:1081] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:25.485059 31026 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:25.485508 31601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:14:25.486110 31601 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.488209 31601 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.487190 31026 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:25.493176 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:25.493798 30951 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:25.496747 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 6167067c2f0e477d90c7f8d4171022d3 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:25.497746 32153 tablet_replica.cc:333] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:25.498759 32153 raft_consensus.cc:2243] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:25.499260 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:25.499478 32153 raft_consensus.cc:2272] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:25.500487 30951 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:25.502599 30779 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.499902 30879 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:25.505817 30879 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:25.506153 32153 ts_tablet_manager.cc:1916] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:25.506659 30879 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:25.507119 31601 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.508069 30879 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:25.512110 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:25.512897 30951 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.513270 31601 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:25.513664 30951 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:25.514261 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:25.514971 30951 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.516506 30951 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.516882 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:25.517426 30878 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.521165 31994 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:25.521654 31994 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:25.522738 30951 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:25.522449 31994 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:25.524326 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:25.525210 32132 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.525660 32132 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:25.526546 32132 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.530977 30879 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:25.535315 30878 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:25.537567 32153 ts_tablet_manager.cc:1929] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:14:25.538000 32153 log.cc:1199] T 6167067c2f0e477d90c7f8d4171022d3 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/6167067c2f0e477d90c7f8d4171022d3
I20260709 13:14:25.539474 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 6167067c2f0e477d90c7f8d4171022d3 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:25.544766 30776 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.553768 30779 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.575136 32144 raft_consensus.cc:993] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:25.575613 32138 raft_consensus.cc:1081] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:25.577059 31601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:14:25.577558 31601 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.577874 31601 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.583268 31601 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.585191 31601 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:25.585624 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:25.586061 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:25.586243 30951 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:25.586546 30951 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:25.586596 31026 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.587445 30951 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.588634 30951 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:25.593547 31026 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:25.594579 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:25.595444 32132 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:25.595813 30951 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:25.596163 32132 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:25.597059 32132 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:25.605096 30779 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:25.846485 31028 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.847736 31986 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.864063 30951 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.866386 32101 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:25.874830 31028 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.877461 31896 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.888962 30951 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:25.891625 31896 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:25.980348 30878 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:25.981572 31994 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:25.985491 30951 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:25.986717 32132 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.014739 30879 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.018388 30951 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:26.019711 32016 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:26.021024 32082 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:26.148216 30949 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.149716 32171 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.154106 30879 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.156450 30956 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.160687 32171 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:26.161731 32132 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.181036 31026 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.183579 32132 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.224351 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:26.284075 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:26.322710 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "076984be4730440fba459e1d130954f5"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:26.323315 31028 raft_consensus.cc:606] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:26.328547 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:26.329195 30879 raft_consensus.cc:606] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:26.331591 30949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1293e489425441668ab2722e4649ca3f"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:26.332296 30949 raft_consensus.cc:606] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:26.334731 30949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:26.335186 30949 raft_consensus.cc:606] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:26.337533 30952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:26.337966 30952 raft_consensus.cc:606] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:26.340469 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:26.341048 30878 raft_consensus.cc:606] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:26.342197 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:26.343675 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:26.415562 31986 raft_consensus.cc:993] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:26.416188 31986 raft_consensus.cc:1081] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:26.417695 31604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:26.418215 31604 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.418598 31604 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.425067 31604 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:26.429199 31604 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:26.429384 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:26.429740 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:26.430064 30878 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:26.430457 30878 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:26.430538 31028 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.431202 30878 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:26.432438 30878 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.437126 31028 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:26.438542 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:26.439380 32171 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.439916 32171 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:26.440824 32171 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:26.441955 30878 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:26.446055 30879 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:26.457207 31026 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:26.458554 30847 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50513ab15e104c00b0e439d104e5e2a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.458595 31896 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:26.459427 30952 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.460894 31986 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.469009 32175 raft_consensus.cc:993] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:26.469452 32175 raft_consensus.cc:1081] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:26.471037 31604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:14:26.471542 31604 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.473639 31604 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.482792 30781 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.484007 31896 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.488451 31026 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.489658 30949 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.497804 32177 raft_consensus.cc:993] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:26.498291 32177 raft_consensus.cc:1081] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:26.483211 31604 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:26.505602 30879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1293e489425441668ab2722e4649ca3f"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:26.506265 30879 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.506718 30879 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.507156 31604 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:26.508487 32174 raft_consensus.cc:993] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:26.508984 32174 raft_consensus.cc:1081] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:26.513612 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:26.513804 30952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "076984be4730440fba459e1d130954f5"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51636
I20260709 13:14:26.514132 30878 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:26.529943 30879 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.531589 31028 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:26.531740 30879 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:26.532404 30847 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8e3faee40af435fab9e73535ef9df52. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.533413 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:26.533685 30951 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:26.514348 30952 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.534386 30952 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:26.534615 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:26.516587 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:26.535142 31023 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.535486 31026 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.533979 30955 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:26.539466 30955 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:26.540326 30955 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.541003 30952 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.541519 30955 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.517179 30779 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.543390 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:26.543943 30878 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:26.544281 32101 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:26.545341 31026 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:26.545943 31986 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:26.546326 30952 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:26.548565 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:26.549180 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:26.549516 32171 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.549759 31028 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:26.550091 32171 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:26.550477 30878 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:26.550987 32171 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:26.514182 30949 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:26.552284 30949 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:26.552434 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:26.552968 30949 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:26.554003 32144 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:26.554101 30949 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.554560 32144 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:26.555418 32144 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.557178 31023 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:26.560468 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:26.561229 32101 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.550107 31028 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:26.561800 32101 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:26.563211 32101 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.569679 30949 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:26.563233 31023 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.562336 30955 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:26.567113 30952 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.568728 31028 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.561120 31986 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.593006 31028 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:26.600478 31028 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:26.611129 30779 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.618279 30878 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:26.620162 30780 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.629117 31023 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:26.629848 30847 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d317b7eabb7461fb2fd34c7ccc257b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.629348 30780 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.630848 30952 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.630649 31986 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.632066 32101 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.643911 30781 catalog_manager.cc:5697] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.648511 32101 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.656488 30952 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.662961 30955 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:26.672217 30922 consensus_peers.cc:597] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecebd472a2fc4b768869e3daa594c692. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:26.673004 30879 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.673473 31023 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:26.670023 30781 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.675112 32138 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.676002 32144 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:26.681970 31028 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.686740 32144 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.695576 31028 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.702993 30878 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:26.713647 30781 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.726986 31986 raft_consensus.cc:993] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:26.727427 31986 raft_consensus.cc:1081] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:26.730523 31028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:26.731451 31028 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.731913 31028 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.742888 31028 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.746529 31028 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:26.747422 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:26.748030 30878 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:26.748189 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:26.748366 30878 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:26.748781 30955 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.749162 30878 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.750814 30878 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.754581 30955 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:26.755750 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:26.756592 32167 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.757050 32167 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:26.757881 32167 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.759373 30878 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:26.775300 30780 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:26.837282 30878 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.838510 32082 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.843717 32144 raft_consensus.cc:993] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:26.844213 32144 raft_consensus.cc:1081] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:26.845959 30879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:26.846475 30879 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:26.846799 30879 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.853483 30879 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.857285 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:26.857828 30949 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:26.858145 30949 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:26.858850 30949 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.859848 30949 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.860394 30879 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:26.861482 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:26.862066 31028 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:26.866405 30949 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:26.870455 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:26.871331 32188 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:26.871798 32188 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:26.872627 32188 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:26.877683 31023 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:26.880254 32082 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:26.880806 31028 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:26.894491 30780 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:26.959988 31023 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:26.961253 32138 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:26.973877 30879 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:26.977289 32138 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:27.029414 32208 ts_tablet_manager.cc:933] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:27.031141 32208 tablet_copy_client.cc:323] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:27.032994 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet b8e3faee40af435fab9e73535ef9df52 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:27.033504 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet b8e3faee40af435fab9e73535ef9df52 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-b8e3faee40af435fab9e73535ef9df52
I20260709 13:14:27.040985 30893 tablet_copy_source_session.cc:215] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.043432 30949 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:27.044646 32208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e3faee40af435fab9e73535ef9df52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:27.045090 32171 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:27.066031 31028 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:27.072847 32082 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:27.077564 32208 tablet_copy_client.cc:806] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.078222 32208 tablet_copy_client.cc:670] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.079530 32211 ts_tablet_manager.cc:933] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:27.101270 32208 tablet_copy_client.cc:538] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.111326 32208 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:27.114224 31023 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.115052 32211 tablet_copy_client.cc:323] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:27.117183 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 50513ab15e104c00b0e439d104e5e2a8 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:27.117183 32188 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:27.117762 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 50513ab15e104c00b0e439d104e5e2a8 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-50513ab15e104c00b0e439d104e5e2a8
I20260709 13:14:27.125612 30893 tablet_copy_source_session.cc:215] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.130067 32211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50513ab15e104c00b0e439d104e5e2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:27.158351 32211 tablet_copy_client.cc:806] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.159422 32211 tablet_copy_client.cc:670] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.171286 32211 tablet_copy_client.cc:538] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.171833 32208 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.172822 32208 tablet_bootstrap.cc:492] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:27.173564 32208 ts_tablet_manager.cc:1403] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.013s
I20260709 13:14:27.174592 30949 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.176964 32208 raft_consensus.cc:359] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.177896 32208 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:27.178610 32208 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.178941 31986 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:27.180720 32216 ts_tablet_manager.cc:933] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:27.183128 32208 ts_tablet_manager.cc:1434] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:14:27.191205 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-b8e3faee40af435fab9e73535ef9df52 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:27.191704 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-b8e3faee40af435fab9e73535ef9df52 on tablet b8e3faee40af435fab9e73535ef9df52 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:27.202924 32211 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:27.203193 32208 ts_tablet_manager.cc:933] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:27.345361 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:27.382783 30879 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.418530 32167 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:14:27.443812 32216 tablet_copy_client.cc:323] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:27.443817 32208 tablet_copy_client.cc:323] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
W20260709 13:14:27.434770 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 81736us
I20260709 13:14:27.457306 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 7d317b7eabb7461fb2fd34c7ccc257b2 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:27.457873 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 7d317b7eabb7461fb2fd34c7ccc257b2 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-7d317b7eabb7461fb2fd34c7ccc257b2
I20260709 13:14:27.474586 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet ecebd472a2fc4b768869e3daa594c692 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:27.475207 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet ecebd472a2fc4b768869e3daa594c692 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-ecebd472a2fc4b768869e3daa594c692
W20260709 13:14:27.454879 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 91509.3us
I20260709 13:14:27.487872 31028 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.498515 32226 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:27.509019 30949 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.513222 30893 tablet_copy_source_session.cc:215] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.521023 32208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d317b7eabb7461fb2fd34c7ccc257b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:27.527136 30968 tablet_copy_source_session.cc:215] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:27.530952 32216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecebd472a2fc4b768869e3daa594c692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:27.542639 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:27.544811 30949 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:27.550760 31604 raft_consensus.cc:1217] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:27.563722 31986 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:27.574005 32216 tablet_copy_client.cc:806] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.574659 32216 tablet_copy_client.cc:670] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.580405 32216 tablet_copy_client.cc:538] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:27.629969 32211 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.631002 32211 tablet_bootstrap.cc:492] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:27.597322 32174 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:14:27.642005 32211 ts_tablet_manager.cc:1403] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.439s	user 0.027s	sys 0.011s
I20260709 13:14:27.644793 32208 tablet_copy_client.cc:806] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:27.645541 32208 tablet_copy_client.cc:670] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:27.659186 32211 raft_consensus.cc:359] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.660422 32211 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:27.661224 32211 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.662752 32208 tablet_copy_client.cc:538] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:14:27.670567 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 78331.2us
W20260709 13:14:27.676172 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49812.1us
I20260709 13:14:27.678464 32216 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:27.694701 32211 ts_tablet_manager.cc:1434] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:14:27.700951 32208 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:27.818689 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-50513ab15e104c00b0e439d104e5e2a8 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:27.819161 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-50513ab15e104c00b0e439d104e5e2a8 on tablet 50513ab15e104c00b0e439d104e5e2a8 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:27.822283 32216 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.823426 32216 tablet_bootstrap.cc:492] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:27.824127 32216 ts_tablet_manager.cc:1403] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.146s	user 0.031s	sys 0.036s
I20260709 13:14:27.828002 32216 raft_consensus.cc:359] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.828814 32216 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:27.829419 32216 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.832065 32216 ts_tablet_manager.cc:1434] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:14:27.834434 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-ecebd472a2fc4b768869e3daa594c692 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:27.834843 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-ecebd472a2fc4b768869e3daa594c692 on tablet ecebd472a2fc4b768869e3daa594c692 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:27.875954 32208 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:27.888763 32208 tablet_bootstrap.cc:492] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:27.889588 32208 ts_tablet_manager.cc:1403] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.009s
I20260709 13:14:27.892922 32208 raft_consensus.cc:359] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.893905 32208 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:27.894663 32208 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:27.897317 32208 ts_tablet_manager.cc:1434] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:27.901093 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:27.901739 30878 raft_consensus.cc:606] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:27.902765 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-7d317b7eabb7461fb2fd34c7ccc257b2 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:27.903229 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-7d317b7eabb7461fb2fd34c7ccc257b2 on tablet 7d317b7eabb7461fb2fd34c7ccc257b2 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:27.914722 30955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:27.915335 30955 raft_consensus.cc:606] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:27.922705 31604 raft_consensus.cc:1217] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:27.927654 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:27.928288 31028 raft_consensus.cc:606] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:27.932214 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:27.932751 30878 raft_consensus.cc:606] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:27.936980 30949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53c19478dc740149d296778042dd3a8"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:27.937734 30949 raft_consensus.cc:606] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:27.942584 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:27.944376 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:28.501881 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 392880us
I20260709 13:14:28.528748 32250 raft_consensus.cc:993] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:28.529452 32250 raft_consensus.cc:1081] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:28.538664 31026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53c19478dc740149d296778042dd3a8"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36670
I20260709 13:14:28.539527 31026 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.540140 31026 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.546096 32224 raft_consensus.cc:993] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:28.546591 32224 raft_consensus.cc:1081] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:28.557554 31026 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:28.600565 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 57541.7us
I20260709 13:14:28.601831 31026 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:28.604615 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:28.605199 31604 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.616123 31601 raft_consensus.cc:1217] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:28.618521 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:28.619122 30956 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:28.619405 30956 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:28.620265 30956 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.629346 30879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48714
I20260709 13:14:28.629949 30879 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.631525 30956 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.630304 30879 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.631134 31986 raft_consensus.cc:993] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:28.636189 31986 raft_consensus.cc:1081] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
W20260709 13:14:28.640852 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 74615.5us
I20260709 13:14:28.641713 30956 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:28.649263 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:28.656244 31604 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:28.658070 32241 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:28.658313 31024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:28.658617 32241 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:28.658948 31024 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.659138 31601 raft_consensus.cc:1217] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:28.659355 31024 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.659535 32241 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.661299 31605 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:28.677058 31986 raft_consensus.cc:993] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:28.678054 32245 raft_consensus.cc:1064] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:28.677858 31024 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:28.680068 31024 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:28.680976 31986 raft_consensus.cc:1081] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:28.681619 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:28.682111 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:28.682658 30874 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:28.682981 30874 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:28.683429 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:28.683972 31603 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.684315 31603 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.686465 30951 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.687954 30874 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:28.689005 30874 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:28.691236 32245 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.696727 32254 raft_consensus.cc:1064] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:28.709102 32250 raft_consensus.cc:993] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:28.709806 32250 raft_consensus.cc:1081] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:28.710064 30874 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:28.699282 32254 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.711179 30951 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:28.725464 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:28.726346 32241 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:28.726846 32241 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:28.727792 32241 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:28.736991 30874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:28.736641 30781 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.740587 30879 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.741209 31603 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.744994 30878 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:28.746697 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:28.747290 31024 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:28.747634 31024 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:28.748554 31024 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.749096 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:28.749650 31024 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.750661 30874 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:28.751102 30874 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.749661 30878 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:28.752126 30878 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:28.753232 31603 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:28.752868 30878 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.754084 30878 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.756145 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:28.756783 30951 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.764631 30878 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:28.765923 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:28.766804 32222 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:28.767453 32222 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:28.767724 30879 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:28.767972 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:28.769280 31603 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.769259 31024 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:28.770613 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:28.771386 31986 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:28.768702 32222 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.771842 31986 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:28.772651 31986 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:28.775321 31604 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:28.775998 31603 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:28.777602 32247 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:28.778656 31026 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:28.780983 32226 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:28.786084 30956 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:28.792727 32226 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:14:28.804214 32247 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:28.806787 31026 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:28.816530 30956 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:28.822719 31604 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:28.852385 31030 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:28.853943 30951 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:28.854606 31603 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:28.864140 32188 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:28.868880 30874 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:28.879899 32227 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:28.904881 30951 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:28.910244 32247 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:28.914808 30874 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:28.915704 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:28.916829 31030 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.918519 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:28.919313 30956 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:28.919692 30956 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:28.923537 30956 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:28.929971 30776 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:28.936002 30780 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:28.945437 30956 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:28.946462 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:28.947649 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:28.951853 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:28.954732 32254 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:28.959905 30956 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:28.965814 32229 raft_consensus.cc:1064] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:28.957281 32254 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:28.968974 32254 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:28.971403 30779 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:29.024972 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5ba0 after lost signal to thread 29721
W20260709 13:14:29.026093 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800034980 after lost signal to thread 30815
I20260709 13:14:29.025591 32229 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:29.027791 30812 debug-util.cc:398] Leaking SignalData structure 0x7b080034aa00 after lost signal to thread 30907
W20260709 13:14:29.028884 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8ac0 after lost signal to thread 30982
W20260709 13:14:29.029994 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800322400 after lost signal to thread 31056
W20260709 13:14:29.031111 30812 debug-util.cc:398] Leaking SignalData structure 0x7b080035bca0 after lost signal to thread 31629
I20260709 13:14:29.051954 32254 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.059856 32239 raft_consensus.cc:1064] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:29.063685 31604 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.068305 32239 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:29.068925 32227 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.066648 30955 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.076241 31026 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.079412 30951 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.074152 31024 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.087710 31603 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:29.089995 32255 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.092152 32254 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:29.094779 32226 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:29.097762 31605 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.127262 30879 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.129767 32255 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:29.190618 30952 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.183364 30781 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.198559 30781 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.201638 31026 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:29.204013 31986 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:29.226619 30955 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:29.229837 31026 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.232421 31603 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.229713 32223 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:14:29.207321 32226 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.234776 32144 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:14:29.257512 31026 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.260823 31603 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:29.253648 32230 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:14:29.281239 31986 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:29.284999 30952 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:29.287985 30952 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:29.290923 30879 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:29.294735 32138 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:14:29.312347 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:29.296085 32256 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:14:29.297106 32231 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:14:29.334414 30874 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:29.336180 32171 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:14:29.400593 32138 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.403793 31604 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:29.608986 32289 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.226s	user 0.004s	sys 0.000s
I20260709 13:14:29.607558 30781 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.618449 31029 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:29.670692 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 215113us
I20260709 13:14:29.666421 32229 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 13:14:29.809410 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 65401.8us
W20260709 13:14:29.811506 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52017.3us
I20260709 13:14:29.821877 30951 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:14:29.827165 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 137244us
I20260709 13:14:29.860838 31603 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.895972 31030 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.906069 30781 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:29.909770 30779 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.917691 32254 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:29.950598 30876 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:29.958839 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:29.959579 31029 raft_consensus.cc:606] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:29.972348 30878 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:29.973377 30877 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:29.975095 30874 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:29.980091 31603 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.996897 31026 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:29.998739 31026 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.000751 32295 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:30.003103 30955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:30.003827 30955 raft_consensus.cc:606] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:30.009502 30876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:30.015106 31603 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.018074 32305 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:14:30.029314 32295 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:30.038705 30876 raft_consensus.cc:606] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:30.063211 31603 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:30.072082 31602 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:30.089008 32254 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:14:30.180080 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 81179.2us
W20260709 13:14:30.194541 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 100684us
I20260709 13:14:30.211051 30780 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:30.251745 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 54324.8us
W20260709 13:14:30.276208 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 52115.7us
I20260709 13:14:30.306761 31030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:30.307361 31030 raft_consensus.cc:606] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:30.316843 32249 raft_consensus.cc:993] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:30.317508 32249 raft_consensus.cc:1081] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:30.259492 32294 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:14:30.329741 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 50513ab15e104c00b0e439d104e5e2a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.333072 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:30.335248 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:30.336117 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 82266.4us
W20260709 13:14:30.348606 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48590.5us
I20260709 13:14:30.296430 32247 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:14:30.366254 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 276151us
I20260709 13:14:30.372164 30958 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:30.384147 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 102795us
W20260709 13:14:30.465559 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 75190.1us
W20260709 13:14:30.555698 32320 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:14:30.565039 32321 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:14:30.580835 30876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:30.581568 30876 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.581995 30876 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:30.615268 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 92348.9us
I20260709 13:14:30.676920 30876 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:30.678256 32247 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:30.683686 31026 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:30.692103 32245 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:30.708709 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 193811us
I20260709 13:14:30.703727 30955 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:30.722939 30876 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:30.731757 30878 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:30.718446 31029 raft_consensus.cc:2955] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:30.766191 32144 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:30.773494 32144 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:30.773885 32144 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:14:30.764729 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 153395us
I20260709 13:14:30.774588 32144 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:30.797991 32144 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.819410 32255 raft_consensus.cc:993] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:30.833781 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d317b7eabb7461fb2fd34c7ccc257b2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:30.865195 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 114857us
W20260709 13:14:30.869202 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93692.6us
I20260709 13:14:30.869858 32255 raft_consensus.cc:1081] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:30.875059 30952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51636
I20260709 13:14:30.875823 30952 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.876190 32241 raft_consensus.cc:993] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:30.876303 30952 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.876693 32241 raft_consensus.cc:1081] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:30.884873 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:30.884158 32317 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:30.889357 31603 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:30.891923 32304 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:30.893823 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 50513ab15e104c00b0e439d104e5e2a8 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:30.892788 30952 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:30.902496 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:30.903086 30878 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:30.910853 30878 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:30.926865 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:30.927981 30878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48714
I20260709 13:14:30.929504 30878 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:30.929967 30878 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:30.930725 30779 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 1 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.935624 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8e3faee40af435fab9e73535ef9df52 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:30.936025 32304 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:30.959137 32304 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:30.960162 32304 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:30.945704 30952 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:30.948999 31603 raft_consensus.cc:2955] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.000264 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:31.001036 31601 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.002143 30954 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:31.005201 30878 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.010138 31601 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:31.013269 32249 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.018469 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:31.018771 30878 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:31.019083 31025 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.019451 31025 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:31.020294 31025 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.021454 31025 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.028604 30944 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d317b7eabb7461fb2fd34c7ccc257b2 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:31.030895 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:31.032331 32325 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.032791 32325 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.033654 32325 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.046650 31604 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.055707 31029 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:31.056324 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:31.069165 31024 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.069494 31024 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:31.059082 30954 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:31.075927 31024 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.077004 31024 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.078552 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ecebd472a2fc4b768869e3daa594c692 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:31.083413 32349 tablet_replica.cc:333] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:31.040674 31025 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:31.087220 32339 raft_consensus.cc:993] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:31.087705 32339 raft_consensus.cc:1081] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:31.089529 30951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:14:31.090206 30954 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.101996 30951 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.102423 30951 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.109342 30951 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.112815 30951 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:31.117120 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:31.117702 30878 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.118165 30878 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.117833 31601 raft_consensus.cc:2955] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.118945 30878 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.119849 30878 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.117730 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:31.124485 31605 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.127540 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:31.135259 31605 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:31.084878 32349 raft_consensus.cc:2243] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:31.143205 32352 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:14:31.144024 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:31.148792 32332 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:31.149283 32332 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.150175 32332 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:31.144928 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 52588.5us
I20260709 13:14:31.157179 30776 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.160326 32349 raft_consensus.cc:2272] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.166618 32349 ts_tablet_manager.cc:1916] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:31.163223 30878 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:31.173573 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:31.175139 32345 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:31.175961 32345 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:31.179183 32345 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.198386 30781 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.205387 30781 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.211541 31024 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:31.213896 32249 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:31.233165 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet ecebd472a2fc4b768869e3daa594c692 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:31.286907 32355 tablet_replica.cc:333] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:31.288395 32355 raft_consensus.cc:2243] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.289341 32355 raft_consensus.cc:2272] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.297363 31029 raft_consensus.cc:2955] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:31.309610 32355 ts_tablet_manager.cc:1916] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:31.322621 30780 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.336971 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e3faee40af435fab9e73535ef9df52 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:31.359537 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:31.365305 30781 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 3, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 3 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.363543 32349 ts_tablet_manager.cc:1929] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:31.384285 30780 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.381737 32356 tablet_replica.cc:333] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:31.383965 32349 log.cc:1199] T 50513ab15e104c00b0e439d104e5e2a8 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/50513ab15e104c00b0e439d104e5e2a8
I20260709 13:14:31.403271 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 50513ab15e104c00b0e439d104e5e2a8 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:31.403887 32349 tablet_replica.cc:333] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:31.403717 30874 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.406334 32349 raft_consensus.cc:2243] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.407140 32349 raft_consensus.cc:2272] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.410122 32349 ts_tablet_manager.cc:1916] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:31.405066 32355 ts_tablet_manager.cc:1929] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:31.412066 32355 log.cc:1199] T ecebd472a2fc4b768869e3daa594c692 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/ecebd472a2fc4b768869e3daa594c692
I20260709 13:14:31.414695 32356 raft_consensus.cc:2243] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:31.415413 32356 raft_consensus.cc:2272] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:31.421754 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet ecebd472a2fc4b768869e3daa594c692 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:31.423413 32356 ts_tablet_manager.cc:1916] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:31.434160 32249 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.450759 32356 ts_tablet_manager.cc:1929] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:31.451393 32356 log.cc:1199] T b8e3faee40af435fab9e73535ef9df52 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/b8e3faee40af435fab9e73535ef9df52
I20260709 13:14:31.453249 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet b8e3faee40af435fab9e73535ef9df52 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:31.457507 32349 ts_tablet_manager.cc:1929] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:31.457942 32349 log.cc:1199] T 7d317b7eabb7461fb2fd34c7ccc257b2 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/7d317b7eabb7461fb2fd34c7ccc257b2
I20260709 13:14:31.459426 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 7d317b7eabb7461fb2fd34c7ccc257b2 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:31.481369 31025 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:31.483100 32309 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:31.493031 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:31.568352 30878 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:31.569728 32309 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:31.585873 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:31.586661 30878 raft_consensus.cc:606] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:31.588958 31601 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.602012 31601 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:31.606858 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:31.607237 32309 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:31.614871 31601 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:31.618471 31603 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:31.622080 32294 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:31.618490 30951 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:31.627328 32294 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:31.646991 31025 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:31.647589 32294 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:31.648645 32245 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:31.608034 30878 raft_consensus.cc:606] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:31.670259 30953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:31.670943 30953 raft_consensus.cc:606] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:31.678051 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:31.678653 30878 raft_consensus.cc:606] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:31.680495 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:31.682091 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:31.685483 32332 raft_consensus.cc:993] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:31.686008 32332 raft_consensus.cc:1081] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:31.689872 31024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:31.690449 31024 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.690851 31024 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.705819 31024 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.714660 31024 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:31.720039 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:31.720664 30878 raft_consensus.cc:3055] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.727540 30878 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.728466 30878 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.729768 30878 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.743185 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:31.743875 30954 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.757113 30954 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:31.766196 30878 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:31.767515 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:31.768419 32323 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:31.768915 32323 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:31.769742 32323 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.786872 30781 catalog_manager.cc:5697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:31.860795 32245 raft_consensus.cc:993] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:31.861343 32339 raft_consensus.cc:1081] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:31.863013 30956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:14:31.863579 30956 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.863955 30956 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.871085 30956 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.871831 32245 raft_consensus.cc:993] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:31.872334 32339 raft_consensus.cc:1081] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:31.873736 30956 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:31.873782 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:31.874802 30876 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.875130 30876 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.873979 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:31.876101 31024 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.875933 30876 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.879297 30876 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.883693 31024 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:31.885030 30923 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:31.885056 31024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:31.886001 31024 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.886543 32144 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.886762 31024 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.887163 32144 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:31.887814 30876 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:31.888108 32144 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.897358 31024 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.900564 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:31.901360 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:31.901937 31604 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.901227 30876 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:31.903487 30876 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.904456 30876 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.906016 30876 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:31.911633 30781 catalog_manager.cc:5697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.913861 31604 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:31.914595 30876 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:31.915180 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:31.916414 32329 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:31.916867 32329 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:31.917716 32329 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:31.918641 31024 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:31.930163 32144 raft_consensus.cc:993] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:31.930684 32144 raft_consensus.cc:1081] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:31.932209 30878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:31.932840 30878 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.933224 30878 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.939358 30781 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:31.948382 30878 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.951510 30878 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:31.955652 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:31.956259 30956 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:31.956560 30956 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:31.957166 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:31.957280 30956 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.958607 30956 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.958745 31029 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:31.968147 31029 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:31.969481 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:31.970383 32339 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:31.970963 32339 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:31.971978 32339 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:31.986078 30956 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:32.002851 30781 catalog_manager.cc:5697] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.155100 30954 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:32.156224 32329 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.168637 30876 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:32.170240 32167 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.287349 31029 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.288616 32249 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.302862 30876 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.304098 32144 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.381147 30876 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:32.383512 32167 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:32.387984 30878 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:32.399940 31604 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:32.401156 31029 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.402298 32329 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:32.403052 32339 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:32.416113 30847 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fe26980d1594c1eb11b68b8a2a07295. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.427712 30956 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:32.428035 30954 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:32.430927 31029 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:32.437392 32332 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:14:32.437582 32339 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:14:32.480631 32380 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:32.513887 32380 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.544476 30956 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.553625 31026 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.557034 30954 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:32.571167 31025 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:32.571635 30922 consensus_peers.cc:597] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ef66bbb42e064e8da439f811c09eb47c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.573139 32309 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.575979 30878 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:32.584800 32309 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.597505 30781 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:32.599701 32382 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.603724 31026 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.608304 30878 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.620146 30876 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:32.646548 30847 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72bcdd8ce60141b4a8ae93bf6451b437. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.647195 30954 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:32.648277 31025 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:32.648751 32245 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.650643 32245 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:32.669454 30776 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.678013 32380 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.681936 31025 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.687662 30954 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.689450 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:32.701982 30776 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.750797 30956 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:32.767984 30922 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ce19c3ff1834bd091f05b950c3df1e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:32.770445 31025 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:32.771996 32144 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.779247 30876 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:32.784855 32144 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:32.811578 32382 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.814148 31026 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.830610 30876 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.834012 30780 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:32.890316 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:32.957998 30954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:32.958585 30954 raft_consensus.cc:606] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:32.961737 32398 ts_tablet_manager.cc:933] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:32.961591 31025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:32.962330 31025 raft_consensus.cc:606] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:32.964998 30876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:32.965524 30876 raft_consensus.cc:606] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:32.966851 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:32.968514 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:32.969935 32398 tablet_copy_client.cc:323] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:32.971664 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 3fe26980d1594c1eb11b68b8a2a07295 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:32.972223 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 3fe26980d1594c1eb11b68b8a2a07295 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-3fe26980d1594c1eb11b68b8a2a07295
I20260709 13:14:32.979892 30893 tablet_copy_source_session.cc:215] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:32.983139 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe26980d1594c1eb11b68b8a2a07295. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.001282 32398 tablet_copy_client.cc:806] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:33.001968 32398 tablet_copy_client.cc:670] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:33.007908 32398 tablet_copy_client.cc:538] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:33.027710 32398 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:33.064872 32398 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.065886 32398 tablet_bootstrap.cc:492] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:33.066609 32398 ts_tablet_manager.cc:1403] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.039s	user 0.031s	sys 0.004s
I20260709 13:14:33.069504 32398 raft_consensus.cc:359] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.070380 32398 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:33.071070 32398 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.077775 32398 ts_tablet_manager.cc:1434] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:14:33.086512 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-3fe26980d1594c1eb11b68b8a2a07295 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:33.086966 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-3fe26980d1594c1eb11b68b8a2a07295 on tablet 3fe26980d1594c1eb11b68b8a2a07295 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:33.096706 32329 raft_consensus.cc:993] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:33.097328 32329 raft_consensus.cc:1081] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:33.100998 32401 ts_tablet_manager.cc:933] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:33.109272 32401 tablet_copy_client.cc:323] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.129:41351
I20260709 13:14:33.122987 30893 tablet_copy_service.cc:140] P 95b998a6735f4180986a8b8f7d84b8fc: Received BeginTabletCopySession request for tablet 72bcdd8ce60141b4a8ae93bf6451b437 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:39074)
I20260709 13:14:33.123608 30893 tablet_copy_service.cc:161] P 95b998a6735f4180986a8b8f7d84b8fc: Beginning new tablet copy session on tablet 72bcdd8ce60141b4a8ae93bf6451b437 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:39074: session id = 74f5a5b7556240508983221981af4ab4-72bcdd8ce60141b4a8ae93bf6451b437
I20260709 13:14:33.128892 32398 ts_tablet_manager.cc:933] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:33.131894 30893 tablet_copy_source_session.cc:215] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:33.143504 30953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51636
I20260709 13:14:33.144137 30953 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.144500 30953 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.149839 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72bcdd8ce60141b4a8ae93bf6451b437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.154775 32398 tablet_copy_client.cc:323] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:33.154995 30953 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:33.156404 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet ef66bbb42e064e8da439f811c09eb47c from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:33.162106 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet ef66bbb42e064e8da439f811c09eb47c from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-ef66bbb42e064e8da439f811c09eb47c
I20260709 13:14:33.171165 30968 tablet_copy_source_session.cc:215] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:33.174358 30953 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:33.174965 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:33.174868 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66bbb42e064e8da439f811c09eb47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.175587 30876 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.176559 32401 tablet_copy_client.cc:806] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:33.177188 32401 tablet_copy_client.cc:670] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:33.181125 32401 tablet_copy_client.cc:538] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:33.181275 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:33.181922 31026 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.182209 31026 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:33.182937 31026 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:33.188063 31026 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.191174 32401 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:33.198669 32249 raft_consensus.cc:993] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:33.199188 32249 raft_consensus.cc:1081] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:33.200798 30878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:33.201367 30878 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.201749 30878 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.208748 32398 tablet_copy_client.cc:806] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:33.209420 32398 tablet_copy_client.cc:670] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:33.213910 32398 tablet_copy_client.cc:538] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:33.221885 32401 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.222929 32401 tablet_bootstrap.cc:492] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:33.223678 32401 ts_tablet_manager.cc:1403] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.033s	user 0.030s	sys 0.001s
I20260709 13:14:33.227100 30876 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:33.228048 32401 raft_consensus.cc:359] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.229045 32401 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:33.229771 32401 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.230427 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:33.233127 32249 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.233839 32249 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:33.234719 32249 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:33.235913 31026 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:33.232920 30878 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:33.241196 32401 ts_tablet_manager.cc:1434] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:33.246038 30878 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:33.247433 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:33.248049 30953 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:33.248350 30953 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:33.249094 30953 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:33.250159 30953 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.252852 30893 tablet_copy_service.cc:342] P 95b998a6735f4180986a8b8f7d84b8fc: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-72bcdd8ce60141b4a8ae93bf6451b437 received from {username='slave'} at 127.0.0.1:39074
I20260709 13:14:33.253294 30893 tablet_copy_service.cc:434] P 95b998a6735f4180986a8b8f7d84b8fc: ending tablet copy session 74f5a5b7556240508983221981af4ab4-72bcdd8ce60141b4a8ae93bf6451b437 on tablet 72bcdd8ce60141b4a8ae93bf6451b437 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:33.230983 32398 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:33.269440 32381 raft_consensus.cc:993] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:33.269920 32381 raft_consensus.cc:1081] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:33.272202 30953 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:33.273906 32401 ts_tablet_manager.cc:933] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:33.279853 31603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:33.280462 31603 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:33.280784 31603 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:33.289927 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:33.292204 32332 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:33.292704 32332 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:33.293545 32332 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:33.295730 32401 tablet_copy_client.cc:323] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:33.297464 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 6ce19c3ff1834bd091f05b950c3df1e1 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:33.298003 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 6ce19c3ff1834bd091f05b950c3df1e1 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-6ce19c3ff1834bd091f05b950c3df1e1
I20260709 13:14:33.305621 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:33.306370 30968 tablet_copy_source_session.cc:215] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:33.309916 30781 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.319075 31026 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:33.321552 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce19c3ff1834bd091f05b950c3df1e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:33.324062 31603 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:33.328969 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:33.329545 30874 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:33.329892 30874 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:33.330616 30874 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:33.331717 30874 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:33.344178 31026 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:33.351425 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:33.352260 31025 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:33.351423 31603 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:33.369803 30874 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:33.362329 32398 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.371140 31571 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:33.371542 32398 tablet_bootstrap.cc:492] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:33.370884 30781 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:33.372043 32302 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:33.372388 32398 ts_tablet_manager.cc:1403] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.012s
I20260709 13:14:33.372529 32302 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:33.373495 32302 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:33.363118 31025 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:33.379244 32401 tablet_copy_client.cc:806] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:33.379871 32401 tablet_copy_client.cc:670] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:33.383126 32398 raft_consensus.cc:359] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.389549 32398 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:33.390520 32398 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.391899 32401 tablet_copy_client.cc:538] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:33.396525 32398 ts_tablet_manager.cc:1434] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:14:33.410122 32401 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:33.416486 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-ef66bbb42e064e8da439f811c09eb47c received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:33.416999 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-ef66bbb42e064e8da439f811c09eb47c on tablet ef66bbb42e064e8da439f811c09eb47c with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:33.436288 30781 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 3 to 4, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:33.449163 32401 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:33.450438 32401 tablet_bootstrap.cc:492] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:33.451211 32401 ts_tablet_manager.cc:1403] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.016s
I20260709 13:14:33.454205 32401 raft_consensus.cc:359] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.455075 32401 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:33.455852 32401 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:33.458557 32401 ts_tablet_manager.cc:1434] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:14:33.460328 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-6ce19c3ff1834bd091f05b950c3df1e1 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:33.460721 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-6ce19c3ff1834bd091f05b950c3df1e1 on tablet 6ce19c3ff1834bd091f05b950c3df1e1 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:33.460644 31604 raft_consensus.cc:1217] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:33.556396 31604 raft_consensus.cc:1217] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:33.689839 31604 raft_consensus.cc:1217] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:33.714483 31028 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.717296 32249 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.721812 31604 raft_consensus.cc:1217] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:33.726706 30878 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.743410 32144 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.764792 30951 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.767304 32332 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.810621 31026 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:33.814008 32381 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:33.857247 31028 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:33.858820 32302 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:33.955544 30876 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:33.964100 32404 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:33.970260 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:33.982352 32332 raft_consensus.cc:1064] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:33.985105 32332 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.023141 31604 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.026815 32426 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.037467 31026 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.039832 30951 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.046700 32381 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.051846 32381 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:34.075452 32425 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:14:34.082912 32408 raft_consensus.cc:1064] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:34.086018 32408 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.086762 32381 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.088711 30951 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.105497 31601 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.111081 32249 raft_consensus.cc:1064] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:34.117094 31604 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.119254 30876 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.120771 31028 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.120999 32408 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.122526 31026 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.124346 32382 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.114234 32249 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.123993 30781 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.152755 32382 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.158074 32245 raft_consensus.cc:1064] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:34.161640 32245 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.206529 31029 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.208220 32380 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.210044 31604 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.226115 30951 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:34.230079 32408 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.288748 31601 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.292025 30879 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.294471 32382 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.236907 30876 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.242519 32245 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.241838 31025 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.299645 32381 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.305750 31605 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.310321 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:34.311820 31029 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.314695 30953 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.315461 31604 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:34.319389 32380 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:34.324344 32144 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:34.326920 32381 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:34.338240 30879 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.345240 32144 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:34.333004 30781 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.354348 32245 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.357098 32332 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.360487 30951 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.378607 30953 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.388921 30956 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.403666 31603 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:34.404822 32144 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.406078 31028 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:34.411412 31605 raft_consensus.cc:2955] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.413332 32144 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.417613 31603 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.426059 31604 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.431430 32249 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.441663 30781 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 4 to 5, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.449608 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fe26980d1594c1eb11b68b8a2a07295 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:34.453996 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fe26980d1594c1eb11b68b8a2a07295 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:34.455421 31028 raft_consensus.cc:2955] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.455263 30779 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.471628 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ef66bbb42e064e8da439f811c09eb47c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:34.489883 32448 tablet_replica.cc:333] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:34.491168 32448 raft_consensus.cc:2243] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:34.493866 31029 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.517550 30781 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.564534 32448 raft_consensus.cc:2272] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:34.569754 32144 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.582785 32448 ts_tablet_manager.cc:1916] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:34.584649 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:34.585258 30879 raft_consensus.cc:606] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:34.586661 31601 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.600384 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet ef66bbb42e064e8da439f811c09eb47c with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:34.612906 30951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:34.613610 30951 raft_consensus.cc:606] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:34.629266 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:34.630017 31028 raft_consensus.cc:606] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:34.623255 30779 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.633973 30879 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.640569 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:34.642673 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:34.647697 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 170862us
I20260709 13:14:34.651644 32453 tablet_replica.cc:333] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:34.652928 32453 raft_consensus.cc:2243] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:34.654270 32453 raft_consensus.cc:2272] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:34.660688 30953 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.673635 31601 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:34.675468 32441 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:34.688925 32448 ts_tablet_manager.cc:1929] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:34.689596 32448 log.cc:1199] T 3fe26980d1594c1eb11b68b8a2a07295 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/3fe26980d1594c1eb11b68b8a2a07295
I20260709 13:14:34.687731 31604 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.693549 32441 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.670082 31025 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.702689 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 3fe26980d1594c1eb11b68b8a2a07295 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:34.703022 32453 ts_tablet_manager.cc:1916] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:34.710345 30874 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:34.710676 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ce19c3ff1834bd091f05b950c3df1e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:34.713692 32408 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:14:34.722698 30767 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 6ce19c3ff1834bd091f05b950c3df1e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:14:34.730505 30781 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:34.741076 30874 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.750741 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ce19c3ff1834bd091f05b950c3df1e1 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:34.751711 32448 tablet_replica.cc:333] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:34.752704 32448 raft_consensus.cc:2243] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:34.753350 32448 raft_consensus.cc:2272] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:34.757602 31025 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.754613 30879 raft_consensus.cc:2955] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.761866 31604 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:34.763705 32450 raft_consensus.cc:993] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:34.763417 32445 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:34.764245 32245 raft_consensus.cc:1081] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:34.769219 32448 ts_tablet_manager.cc:1916] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:34.775723 32328 raft_consensus.cc:993] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:34.776229 32328 raft_consensus.cc:1081] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:34.776583 32450 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.777967 30876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48714
I20260709 13:14:34.778515 30876 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:34.778860 30876 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:34.781111 31025 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.804472 32453 ts_tablet_manager.cc:1929] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:34.805771 32453 log.cc:1199] T ef66bbb42e064e8da439f811c09eb47c P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/ef66bbb42e064e8da439f811c09eb47c
I20260709 13:14:34.806672 31604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:14:34.809399 31604 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:34.809850 31604 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.800796 30876 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.812985 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:34.816288 31025 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:34.816651 31025 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:34.817410 31025 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.821043 31025 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:34.822728 31604 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.826254 30876 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:34.828022 31025 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:34.829051 32448 ts_tablet_manager.cc:1929] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:34.829569 32448 log.cc:1199] T 6ce19c3ff1834bd091f05b950c3df1e1 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/6ce19c3ff1834bd091f05b950c3df1e1
I20260709 13:14:34.830206 31604 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:34.831928 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:34.832463 31025 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.864145 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 6ce19c3ff1834bd091f05b950c3df1e1 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:34.866734 30768 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72bcdd8ce60141b4a8ae93bf6451b437 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:34.868382 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet ef66bbb42e064e8da439f811c09eb47c (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:34.918097 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:34.898869 32450 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:14:34.924404 32332 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:34.925268 32332 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:34.927009 32332 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.961207 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:34.962203 30876 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:34.962484 30876 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:34.967677 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:34.968483 31601 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:34.963557 30876 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:34.973796 30876 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:34.985761 31601 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:34.971004 31604 raft_consensus.cc:2955] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:34.994786 30779 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:35.015929 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 72bcdd8ce60141b4a8ae93bf6451b437 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51632
W20260709 13:14:35.025974 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 115657us
I20260709 13:14:35.046723 31025 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:35.050387 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:35.051833 32423 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:35.052340 32423 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:35.052784 30876 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:35.054162 32423 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:35.117486 32408 raft_consensus.cc:993] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:35.118157 32408 raft_consensus.cc:1081] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:35.117318 30781 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.120160 31028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36670
I20260709 13:14:35.126464 31028 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:35.127895 31028 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:35.157279 32456 tablet_replica.cc:333] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:35.173801 32456 raft_consensus.cc:2243] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:35.157779 31028 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:35.175372 32456 raft_consensus.cc:2272] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:35.180696 32456 ts_tablet_manager.cc:1916] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:35.181458 30781 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.192363 31028 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:35.192572 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:35.193495 31604 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:35.197026 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:35.197875 30956 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:35.198173 32456 ts_tablet_manager.cc:1929] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:35.198731 32456 log.cc:1199] T 72bcdd8ce60141b4a8ae93bf6451b437 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/72bcdd8ce60141b4a8ae93bf6451b437
I20260709 13:14:35.198169 30956 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:35.200810 30956 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:35.202404 30956 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:35.210497 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 72bcdd8ce60141b4a8ae93bf6451b437 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:35.212738 30956 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:35.215232 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:35.218133 32167 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:35.218593 32167 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:35.219480 32167 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:35.224380 31604 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:35.250145 30781 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 3 to 4, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:35.422343 31028 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:35.424746 32380 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:35.488226 31604 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:35.492264 32380 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:35.644260 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:35.644524 31026 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:35.646013 32302 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:35.658823 30879 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:35.667323 32424 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:35.749686 30956 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:35.751210 32323 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:35.767973 31604 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:35.771526 32323 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:35.969834 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:36.013444 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:36.014140 30879 raft_consensus.cc:606] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:36.019538 31025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:36.020166 31025 raft_consensus.cc:606] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:36.021451 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:36.023917 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:36.137709 30956 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:36.150022 31026 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:36.151682 30879 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:14:36.152472 30922 consensus_peers.cc:597] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd89ff847a344f8a8ef89d9556b85846. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.153410 32455 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.155189 32455 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.174192 32441 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.176100 30879 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.178414 31026 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.192538 31025 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:36.220633 30996 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 668bd932e9e04f40b8ccf829b43b99d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.224488 30956 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:36.228893 30779 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.233263 32469 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.236135 30879 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:36.237910 32469 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:36.290081 32468 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.292598 30879 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.305907 30954 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.315454 30956 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:36.314188 30781 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
W20260709 13:14:36.356458 30922 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c9907b959044453b57011278bbecdff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.362847 31025 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:36.364199 32323 raft_consensus.cc:993] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:36.364682 32469 raft_consensus.cc:1081] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:36.366820 30876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48714
I20260709 13:14:36.367388 30876 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.367808 30876 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.367847 32473 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:36.374571 30876 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:36.374950 30878 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:14:36.376506 30876 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:36.380904 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:36.381467 31025 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:36.381778 31025 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:36.382601 31025 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:36.383719 31025 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.398682 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:36.399290 30954 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:36.409443 30954 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:36.410249 32473 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:36.425930 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:36.428323 32455 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.433933 31025 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:36.439611 31026 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.429550 32450 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:36.442998 32450 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:36.444024 32450 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:36.436692 32485 raft_consensus.cc:993] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:36.447842 32485 raft_consensus.cc:1081] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:36.451993 30954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:14:36.452526 30954 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:36.452850 30954 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.459888 31025 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:36.469903 30954 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:36.472915 30954 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:36.474833 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:36.475482 30879 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:36.475792 30879 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:36.476519 30879 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:36.474233 30779 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.477772 30879 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.480856 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:36.481503 31028 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:36.487131 30781 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.492442 30876 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.508283 31028 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:36.513293 30923 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:36.516983 30996 consensus_peers.cc:597] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f210916a06449d99b2c71170e4d3d68. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:36.516855 30879 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:36.520947 32441 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:36.521781 32441 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:36.522722 32441 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:36.527690 30954 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:36.530151 30879 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:36.532305 32468 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:36.533356 32482 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:36.537371 32490 ts_tablet_manager.cc:933] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:36.547796 32490 tablet_copy_client.cc:323] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:36.553874 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet bd89ff847a344f8a8ef89d9556b85846 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:36.554466 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet bd89ff847a344f8a8ef89d9556b85846 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-bd89ff847a344f8a8ef89d9556b85846
I20260709 13:14:36.562826 30779 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.569787 30968 tablet_copy_source_session.cc:215] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:36.573696 32490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd89ff847a344f8a8ef89d9556b85846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:36.573741 32468 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.580339 30879 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.588814 30954 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:36.606508 30779 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:36.649443 32490 tablet_copy_client.cc:806] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:36.650477 32490 tablet_copy_client.cc:670] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:36.655486 32490 tablet_copy_client.cc:538] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:36.671643 32490 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:36.858695 31026 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:36.861155 32486 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:14:37.013507 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 119108us
I20260709 13:14:37.024850 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:37.038165 32496 ts_tablet_manager.cc:933] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:37.079841 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 92352.7us
I20260709 13:14:37.107374 30954 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:37.111835 31028 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:37.121223 30878 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:37.124974 32496 tablet_copy_client.cc:323] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:37.129081 32502 ts_tablet_manager.cc:933] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:37.165805 32507 ts_tablet_manager.cc:933] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:37.213359 32490 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.145s	sys 0.226s
W20260709 13:14:37.214090 32490 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.146s	sys 0.227s
I20260709 13:14:37.218595 32485 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:37.225773 32490 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:37.230487 32490 tablet_bootstrap.cc:492] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:37.232286 32490 ts_tablet_manager.cc:1403] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.561s	user 0.169s	sys 0.227s
I20260709 13:14:37.275990 32490 raft_consensus.cc:359] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.276937 32490 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:37.277606 32490 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.281908 32490 ts_tablet_manager.cc:1434] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
W20260709 13:14:37.282888 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 76712.9us
I20260709 13:14:37.285084 32455 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:37.286646 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-bd89ff847a344f8a8ef89d9556b85846 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:37.287128 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-bd89ff847a344f8a8ef89d9556b85846 on tablet bd89ff847a344f8a8ef89d9556b85846 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:37.283088 32502 tablet_copy_client.cc:323] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
W20260709 13:14:37.274942 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 87573.5us
I20260709 13:14:37.307128 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 2c9907b959044453b57011278bbecdff from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:37.307746 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 2c9907b959044453b57011278bbecdff from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-2c9907b959044453b57011278bbecdff
I20260709 13:14:37.316133 30968 tablet_copy_source_session.cc:215] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:37.335919 32473 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.343114 32507 tablet_copy_client.cc:323] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
W20260709 13:14:37.350811 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46281.4us
W20260709 13:14:37.434494 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56724.8us
I20260709 13:14:37.452488 32502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c9907b959044453b57011278bbecdff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:37.462070 31041 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 668bd932e9e04f40b8ccf829b43b99d0 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:37.462651 31041 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 668bd932e9e04f40b8ccf829b43b99d0 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-668bd932e9e04f40b8ccf829b43b99d0
I20260709 13:14:37.468135 31042 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 9f210916a06449d99b2c71170e4d3d68 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:37.468726 31042 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 9f210916a06449d99b2c71170e4d3d68 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-9f210916a06449d99b2c71170e4d3d68
I20260709 13:14:37.471200 31041 tablet_copy_source_session.cc:215] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:37.472709 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 109901us
I20260709 13:14:37.510643 31601 raft_consensus.cc:1217] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:37.527262 31042 tablet_copy_source_session.cc:215] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:37.546756 32496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 668bd932e9e04f40b8ccf829b43b99d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:37.571888 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50444.1us
W20260709 13:14:37.645238 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51656us
W20260709 13:14:37.645741 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 125423us
I20260709 13:14:37.651646 32496 tablet_copy_client.cc:806] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:37.657194 32496 tablet_copy_client.cc:670] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:37.671418 32507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f210916a06449d99b2c71170e4d3d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:37.684617 32502 tablet_copy_client.cc:806] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:37.686614 32502 tablet_copy_client.cc:670] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:37.692472 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:37.699324 32496 tablet_copy_client.cc:538] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:37.699640 32507 tablet_copy_client.cc:806] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:37.700265 32507 tablet_copy_client.cc:670] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:37.708647 32496 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:37.726938 32502 tablet_copy_client.cc:538] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:37.736501 32507 tablet_copy_client.cc:538] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:37.745636 32507 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:37.749336 32502 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:37.774101 30955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:37.774714 30955 raft_consensus.cc:606] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:37.783046 30878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:37.783596 30878 raft_consensus.cc:606] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:14:37.786461 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:37.788151 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:37.826864 32502 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:37.827901 32502 tablet_bootstrap.cc:492] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:37.828608 32502 ts_tablet_manager.cc:1403] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.019s
I20260709 13:14:37.838137 32502 raft_consensus.cc:359] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.841171 32502 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:37.841902 32502 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.847038 32507 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:37.848307 32507 tablet_bootstrap.cc:492] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:37.849537 32502 ts_tablet_manager.cc:1434] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:14:37.850390 32507 ts_tablet_manager.cc:1403] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.105s	user 0.029s	sys 0.008s
I20260709 13:14:37.855746 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-2c9907b959044453b57011278bbecdff received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:37.856173 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-2c9907b959044453b57011278bbecdff on tablet 2c9907b959044453b57011278bbecdff with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:37.858256 32507 raft_consensus.cc:359] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.860692 32496 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:37.872682 32496 tablet_bootstrap.cc:492] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:37.866143 32507 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:37.873638 32496 ts_tablet_manager.cc:1403] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.165s	user 0.008s	sys 0.016s
I20260709 13:14:37.876930 32496 raft_consensus.cc:359] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.877816 32496 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:37.878482 32496 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.880723 32522 raft_consensus.cc:1064] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:37.880880 32507 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:37.891836 32522 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:37.892752 32507 ts_tablet_manager.cc:1434] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.001s
I20260709 13:14:37.896080 31042 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-9f210916a06449d99b2c71170e4d3d68 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:37.887729 32496 ts_tablet_manager.cc:1434] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:14:37.896541 31042 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-9f210916a06449d99b2c71170e4d3d68 on tablet 9f210916a06449d99b2c71170e4d3d68 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:37.900358 31042 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-668bd932e9e04f40b8ccf829b43b99d0 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:37.900873 31042 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-668bd932e9e04f40b8ccf829b43b99d0 on tablet 668bd932e9e04f40b8ccf829b43b99d0 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:37.914894 31604 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:37.918373 32522 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.919265 30883 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:37.922464 31027 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:37.924183 32441 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.936002 32455 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:37.944864 32441 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:37.950932 31605 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:37.956907 31027 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:37.969074 30779 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.970237 30883 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.010818 30954 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.018630 31025 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:38.019942 32441 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.020609 31605 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:38.022063 32441 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.032191 32455 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.035238 31604 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.035239 31025 raft_consensus.cc:2955] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.053696 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd89ff847a344f8a8ef89d9556b85846 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:38.061929 30776 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 3 to 4, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.081776 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet bd89ff847a344f8a8ef89d9556b85846 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:38.083904 32538 tablet_replica.cc:333] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:38.085150 32538 raft_consensus.cc:2243] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:38.086180 32538 raft_consensus.cc:2272] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:38.093299 32538 ts_tablet_manager.cc:1916] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:38.100656 31604 raft_consensus.cc:1217] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:38.103425 31604 raft_consensus.cc:1217] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:14:38.112305 32538 ts_tablet_manager.cc:1929] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:38.112929 32538 log.cc:1199] T bd89ff847a344f8a8ef89d9556b85846 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/bd89ff847a344f8a8ef89d9556b85846
I20260709 13:14:38.116123 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet bd89ff847a344f8a8ef89d9556b85846 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:38.119300 31604 raft_consensus.cc:1217] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:14:38.137771 32517 raft_consensus.cc:993] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:38.138309 32511 raft_consensus.cc:1081] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 95b998a6735f4180986a8b8f7d84b8fc to start an election
I20260709 13:14:38.139995 30883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:48716
I20260709 13:14:38.140540 30883 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.140884 30883 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.146864 30883 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.148617 30883 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:38.149320 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:38.149897 30954 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.150031 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:38.150260 30954 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:38.150678 31604 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.151053 30954 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.152354 30954 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.156648 31604 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:38.158175 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:38.158953 32519 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.159435 32519 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:38.160313 32519 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.163885 30954 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:38.185504 30781 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 2 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.233707 32519 raft_consensus.cc:993] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:38.234336 32450 raft_consensus.cc:1081] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:14:38.235916 31025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:14:38.236534 31025 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:38.236938 31025 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.243398 31025 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:38.246052 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:38.246248 31025 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:38.246734 30883 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:38.247043 30883 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:38.246052 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:38.247749 30883 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:38.248847 30954 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.249213 30883 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:38.254500 30883 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:38.255505 30998 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:38.256198 32482 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:38.256649 32482 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:38.257045 30954 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:38.257588 32482 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:38.270514 30781 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.502401 32503 raft_consensus.cc:1064] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:38.504746 32503 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.511529 31604 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:38.512475 30954 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:38.513623 30883 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:38.514707 32503 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.516381 32504 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.518163 32504 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.527189 32482 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.530349 31605 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.543145 30954 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.546763 30781 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.550182 32517 raft_consensus.cc:1064] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
W20260709 13:14:38.561563 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.569450 30955 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:38.571349 32519 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:38.585050 30878 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.572268 32517 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.617892 31027 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:38.621070 32546 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:38.622309 30877 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:38.627455 31605 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:14:38.629161 32511 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:38.622172 31025 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.631520 32517 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:38.646139 31604 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:38.648847 32485 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:38.652087 30883 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:38.653584 32504 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:38.653855 31604 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:38.655534 32504 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:38.668529 32517 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.672646 32482 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.681802 30883 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.683583 31605 raft_consensus.cc:2955] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.690145 30877 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.690774 30879 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.691524 32504 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.687213 31604 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.714804 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 668bd932e9e04f40b8ccf829b43b99d0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:38.727249 30781 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 4 to 5, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.731359 32504 raft_consensus.cc:1064] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:38.734097 32504 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.737910 31027 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.766366 30780 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 2 to 3, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.771030 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 668bd932e9e04f40b8ccf829b43b99d0 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51632
I20260709 13:14:38.789064 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:38.791117 31604 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:38.794071 32542 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:38.796500 30955 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:38.801846 30954 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:38.799615 30955 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.802744 32542 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:38.805207 32542 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:38.808357 31603 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:38.810494 32546 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.820027 32511 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.834022 30877 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:38.836298 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c9907b959044453b57011278bbecdff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:38.840260 32482 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:38.841737 30883 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:14:38.846053 31604 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.860246 32517 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:38.867401 30955 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.868681 30883 raft_consensus.cc:2955] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.865430 32482 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.880761 31601 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.884421 32559 tablet_replica.cc:333] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:14:38.885519 32559 raft_consensus.cc:2243] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:38.886317 32559 raft_consensus.cc:2272] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:38.906425 30879 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.923461 30776 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New cstate: current_term: 1 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:38.917739 30779 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:38.932320 32559 ts_tablet_manager.cc:1916] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:38.944886 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c9907b959044453b57011278bbecdff with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36650
I20260709 13:14:38.958917 31024 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:38.961298 32568 tablet_replica.cc:333] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:14:38.966022 32568 raft_consensus.cc:2243] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:38.967013 32568 raft_consensus.cc:2272] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:38.975286 31601 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:38.976881 32562 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:38.979995 30952 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:38.983824 32482 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:38.983884 32559 ts_tablet_manager.cc:1929] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:14:38.986019 32559 log.cc:1199] T 668bd932e9e04f40b8ccf829b43b99d0 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/668bd932e9e04f40b8ccf829b43b99d0
I20260709 13:14:38.983121 32568 ts_tablet_manager.cc:1916] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:38.993384 32503 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:39.002305 31604 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:39.005348 30952 raft_consensus.cc:2955] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:39.011920 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 668bd932e9e04f40b8ccf829b43b99d0 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:39.013734 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f210916a06449d99b2c71170e4d3d68 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:39.024901 30776 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 5 to 6, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:39.026479 32568 ts_tablet_manager.cc:1929] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:14:39.032321 32568 log.cc:1199] T 2c9907b959044453b57011278bbecdff P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/2c9907b959044453b57011278bbecdff
I20260709 13:14:39.040436 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet 2c9907b959044453b57011278bbecdff (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:39.048763 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f210916a06449d99b2c71170e4d3d68 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:48708
I20260709 13:14:39.050472 32569 tablet_replica.cc:333] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:14:39.051618 32569 raft_consensus.cc:2243] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:39.052397 32569 raft_consensus.cc:2272] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:39.110486 32569 ts_tablet_manager.cc:1916] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:39.154151 32569 ts_tablet_manager.cc:1929] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:14:39.154574 32569 log.cc:1199] T 9f210916a06449d99b2c71170e4d3d68 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/9f210916a06449d99b2c71170e4d3d68
I20260709 13:14:39.156213 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 9f210916a06449d99b2c71170e4d3d68 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:14:40.131050 31024 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.136799 30954 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:40.136968 30879 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:40.137156 30996 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adb189bd941147e0924cc38c9f01bd11. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:40.138351 32482 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.139185 32562 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.148335 32562 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.154023 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:40.154845 30954 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.160194 30879 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.172281 30779 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.198601 30954 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.222317 31024 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:14:40.223383 30922 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d95504ff00154bdf99a5de1ad11f4f58. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:40.224291 30879 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:40.224864 32511 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.225999 32517 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.230753 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53c19478dc740149d296778042dd3a8"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:40.231385 31024 raft_consensus.cc:606] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:40.239029 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:14:40.239929 30879 raft_consensus.cc:606] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:40.239274 32511 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.245846 31027 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.247581 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:40.249888 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:40.267352 30879 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.284277 30780 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.299067 30954 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:40.317260 30922 consensus_peers.cc:597] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3909ef5ede2e43f1872fec585566b998. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:40.317798 31024 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:40.318805 30883 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:40.320120 32586 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:40.322135 32517 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:40.330950 32586 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.332832 31024 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.335136 30883 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.346558 30779 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index -1 to 4, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.351745 31024 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:40.367157 30996 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Couldn't send request to peer 74f5a5b7556240508983221981af4ab4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0daef7b4af5348a298c365152f0bea47. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:40.368530 30883 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:40.369273 30952 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:40.369899 32482 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.370647 32574 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:40.378526 32482 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.380718 30883 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.380718 30954 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.406630 30780 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index -1 to 3, NON_VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132) added. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } }
I20260709 13:14:40.424819 32562 raft_consensus.cc:993] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:40.425374 32562 raft_consensus.cc:1081] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:40.432109 31604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b53c19478dc740149d296778042dd3a8"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:14:40.432704 31604 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:40.433138 31604 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.451268 31604 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:40.455485 31604 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:40.457216 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 57065.8us
I20260709 13:14:40.459288 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:40.459867 30952 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.466365 30952 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:40.468139 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:40.468612 31024 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.468847 31024 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:40.470532 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:40.469586 31024 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:40.471873 31024 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.472261 32595 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.473551 32595 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:40.474462 32595 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:40.480072 31024 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:40.485330 30780 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 3, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 3 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:40.504192 32561 raft_consensus.cc:993] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:40.504709 32561 raft_consensus.cc:1081] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:14:40.509964 30952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:14:40.510588 30952 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:40.511070 30952 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.517545 30952 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:40.519970 30952 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:40.520162 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:40.520761 30883 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:40.521061 30883 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:40.521884 30883 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:40.520220 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:40.522912 31024 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.523180 30883 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:40.530501 31024 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:40.529449 30883 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:40.531672 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:40.532979 32517 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:40.533514 32517 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:40.534451 32517 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:40.552733 30780 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:40.572540 32599 ts_tablet_manager.cc:933] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:40.574620 32599 tablet_copy_client.cc:323] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:40.576104 31042 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet adb189bd941147e0924cc38c9f01bd11 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:40.576658 31042 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet adb189bd941147e0924cc38c9f01bd11 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-adb189bd941147e0924cc38c9f01bd11
I20260709 13:14:40.590960 31042 tablet_copy_source_session.cc:215] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:40.593820 32599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb189bd941147e0924cc38c9f01bd11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:40.610826 32599 tablet_copy_client.cc:806] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:40.611526 32599 tablet_copy_client.cc:670] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:40.618131 32599 tablet_copy_client.cc:538] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:40.627926 32599 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:40.652590 32599 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:40.653613 32599 tablet_bootstrap.cc:492] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:40.654295 32599 ts_tablet_manager.cc:1403] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.003s
I20260709 13:14:40.657460 32599 raft_consensus.cc:359] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.658351 32599 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:40.659049 32599 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.667613 32599 ts_tablet_manager.cc:1434] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:14:40.669734 31042 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-adb189bd941147e0924cc38c9f01bd11 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:40.670199 31042 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-adb189bd941147e0924cc38c9f01bd11 on tablet adb189bd941147e0924cc38c9f01bd11 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:40.790972 32599 ts_tablet_manager.cc:933] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:40.793063 32599 tablet_copy_client.cc:323] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:40.794589 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet d95504ff00154bdf99a5de1ad11f4f58 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:40.795099 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet d95504ff00154bdf99a5de1ad11f4f58 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-d95504ff00154bdf99a5de1ad11f4f58
I20260709 13:14:40.798310 32603 ts_tablet_manager.cc:933] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:40.802312 30968 tablet_copy_source_session.cc:215] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:40.804306 32603 tablet_copy_client.cc:323] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.131:37487
I20260709 13:14:40.806278 31042 tablet_copy_service.cc:140] P f535fccbafb14e3f92bd45065da403db: Received BeginTabletCopySession request for tablet 0daef7b4af5348a298c365152f0bea47 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:34930)
I20260709 13:14:40.806795 31042 tablet_copy_service.cc:161] P f535fccbafb14e3f92bd45065da403db: Beginning new tablet copy session on tablet 0daef7b4af5348a298c365152f0bea47 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:34930: session id = 74f5a5b7556240508983221981af4ab4-0daef7b4af5348a298c365152f0bea47
I20260709 13:14:40.807021 32599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95504ff00154bdf99a5de1ad11f4f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:40.820077 31042 tablet_copy_source_session.cc:215] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:40.823349 32603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0daef7b4af5348a298c365152f0bea47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:40.825147 32599 tablet_copy_client.cc:806] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:40.825824 32599 tablet_copy_client.cc:670] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:40.829900 32599 tablet_copy_client.cc:538] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:40.838541 32599 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:40.842106 32603 tablet_copy_client.cc:806] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:40.842797 32603 tablet_copy_client.cc:670] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:40.847347 32603 tablet_copy_client.cc:538] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:40.858238 32603 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:40.879069 32606 ts_tablet_manager.cc:933] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Initiating tablet copy from peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:40.885064 32606 tablet_copy_client.cc:323] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: tablet copy: Beginning tablet copy session from remote peer at address 127.29.5.130:46199
I20260709 13:14:40.894436 30968 tablet_copy_service.cc:140] P bda0856a7efd4d0e96615b66bef383c6: Received BeginTabletCopySession request for tablet 3909ef5ede2e43f1872fec585566b998 from peer 74f5a5b7556240508983221981af4ab4 ({username='slave'} at 127.0.0.1:44258)
I20260709 13:14:40.894979 30968 tablet_copy_service.cc:161] P bda0856a7efd4d0e96615b66bef383c6: Beginning new tablet copy session on tablet 3909ef5ede2e43f1872fec585566b998 from peer 74f5a5b7556240508983221981af4ab4 at {username='slave'} at 127.0.0.1:44258: session id = 74f5a5b7556240508983221981af4ab4-3909ef5ede2e43f1872fec585566b998
I20260709 13:14:40.894902 32599 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:40.897547 32599 tablet_bootstrap.cc:492] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:40.898548 32599 ts_tablet_manager.cc:1403] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.060s	user 0.036s	sys 0.005s
I20260709 13:14:40.902817 32599 raft_consensus.cc:359] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.905542 32599 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:40.906694 32599 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.909288 32599 ts_tablet_manager.cc:1434] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:40.909857 30968 tablet_copy_source_session.cc:215] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:40.911963 30967 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-d95504ff00154bdf99a5de1ad11f4f58 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:40.912415 30967 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-d95504ff00154bdf99a5de1ad11f4f58 on tablet d95504ff00154bdf99a5de1ad11f4f58 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:40.918686 32606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3909ef5ede2e43f1872fec585566b998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:40.925076 32603 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:40.926162 32603 tablet_bootstrap.cc:492] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:40.926942 32603 ts_tablet_manager.cc:1403] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.019s
I20260709 13:14:40.930114 32603 raft_consensus.cc:359] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.931090 32603 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:40.931823 32603 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:40.934607 32603 ts_tablet_manager.cc:1434] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:14:40.937891 31042 tablet_copy_service.cc:342] P f535fccbafb14e3f92bd45065da403db: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-0daef7b4af5348a298c365152f0bea47 received from {username='slave'} at 127.0.0.1:34930
I20260709 13:14:40.938378 31042 tablet_copy_service.cc:434] P f535fccbafb14e3f92bd45065da403db: ending tablet copy session 74f5a5b7556240508983221981af4ab4-0daef7b4af5348a298c365152f0bea47 on tablet 0daef7b4af5348a298c365152f0bea47 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:40.936744 32606 tablet_copy_client.cc:806] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:40.944142 32606 tablet_copy_client.cc:670] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:40.947728 32606 tablet_copy_client.cc:538] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:40.957197 32606 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Bootstrap starting.
I20260709 13:14:40.964233 31604 raft_consensus.cc:1217] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:41.012655 32606 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:41.013720 32606 tablet_bootstrap.cc:492] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Bootstrap complete.
I20260709 13:14:41.014494 32606 ts_tablet_manager.cc:1403] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.012s
I20260709 13:14:41.017864 32606 raft_consensus.cc:359] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:41.018738 32606 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Initialized, Role: LEARNER
I20260709 13:14:41.019452 32606 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:41.022481 32606 ts_tablet_manager.cc:1434] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:41.036404 30968 tablet_copy_service.cc:342] P bda0856a7efd4d0e96615b66bef383c6: Request end of tablet copy session 74f5a5b7556240508983221981af4ab4-3909ef5ede2e43f1872fec585566b998 received from {username='slave'} at 127.0.0.1:44258
I20260709 13:14:41.036942 30968 tablet_copy_service.cc:434] P bda0856a7efd4d0e96615b66bef383c6: ending tablet copy session 74f5a5b7556240508983221981af4ab4-3909ef5ede2e43f1872fec585566b998 on tablet 3909ef5ede2e43f1872fec585566b998 with peer 74f5a5b7556240508983221981af4ab4
I20260709 13:14:41.070713 30956 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:41.095129 32571 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:41.146925 30879 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:41.258303 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:42.140781 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.008s
W20260709 13:14:42.141403 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.011s	sys 0.008s
W20260709 13:14:42.143509 30849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.007s	sys 0.024s
W20260709 13:14:42.144062 30849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.007s	sys 0.024s
W20260709 13:14:42.152899 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.017s	sys 0.038s
W20260709 13:14:42.153416 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.017s	sys 0.038s
W20260709 13:14:42.161129 30846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.026s	sys 0.029s
W20260709 13:14:42.161664 30846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.026s	sys 0.029s
W20260709 13:14:42.161147 30922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.004s	sys 0.006s
W20260709 13:14:42.163290 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.012s	sys 0.031s
W20260709 13:14:42.165197 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.032s
I20260709 13:14:42.189970 30779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 241) took 1125 ms. Trace:
I20260709 13:14:42.201678 30779 rpcz_store.cc:276] 0709 13:14:41.064214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.068112 (+  3898us) service_pool.cc:224] Handling call
0709 13:14:42.189864 (+1121752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1105687,"reported_tablets":1}
I20260709 13:14:42.171350 32574 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.209000 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 332) took 1096 ms. Trace:
I20260709 13:14:42.203802 32574 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.209591 30875 rpcz_store.cc:276] 0709 13:14:41.112278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.207998 (+1095720us) service_pool.cc:224] Handling call
0709 13:14:42.208385 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.208595 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.208631 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.208684 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.208731 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.208804 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.208931 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.247140 32574 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:42.295645 31571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.005s	sys 0.025s
I20260709 13:14:42.354029 32574 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.394639 32574 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.499902 32643 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.500643 32637 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.500511 32643 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.501212 32637 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.502961 32643 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.503327 32596 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.504204 32632 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.504702 32632 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.505152 32636 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.505688 32636 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.506932 32632 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.508723 32630 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.509222 32630 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.509971 32596 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.511318 32630 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.510967 32636 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.512157 32646 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:42.512694 32646 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.513166 32596 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.513813 32574 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.514835 32646 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:42.515141 32574 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.515867 32585 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.515380 32646 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.515659 32574 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.516409 32646 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.515419 32641 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.517531 32641 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.517973 32574 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:42.518426 32646 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:42.518916 32646 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.519251 32574 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.516333 32585 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.573791 32642 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.801970 32633 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.801693 32663 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:42.520082 32630 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.520620 32652 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:42.802211 32657 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.876194 32630 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:42.876634 32657 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.670126 32629 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.528671 32561 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.877686 32629 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.878031 32561 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:42.878944 32657 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.527981 32636 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.856160 32482 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.527972 32659 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.880548 32629 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.880743 32650 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.880422 32659 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.881170 32629 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:42.880084 32482 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.881439 32650 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.606110 32596 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.880692 32628 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.529670 32656 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.883011 32482 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.882754 32628 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.882983 32656 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:42.803056 32648 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:42.883698 32650 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.884173 32648 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.885084 32628 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.885314 32656 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.885891 32574 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:42.573890 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8140 after lost signal to thread 29721
I20260709 13:14:42.520403 32619 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.887275 32648 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.527519 32658 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.887821 32648 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.887521 32619 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.887957 32658 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.888517 32574 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:42.890138 32619 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.890693 32650 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.891043 32585 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.891664 32585 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.891372 32650 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:42.874898 32633 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.520612 32637 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.527076 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 331) took 1421 ms. Trace:
I20260709 13:14:42.891674 32636 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.893726 32650 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.521028 32647 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.894088 32633 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.894553 32647 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.895084 32636 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.874843 32642 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.885829 32596 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.528370 32615 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.876400 32652 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.875001 32663 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.897183 32647 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.893306 30883 rpcz_store.cc:276] 0709 13:14:41.105910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.526248 (+1420338us) service_pool.cc:224] Handling call
0709 13:14:42.526587 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:42.526756 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:42.526782 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:42.526820 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:42.526851 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:42.526903 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.527017 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:42.904850 32663 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.879063 32630 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.717803 32631 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.687971 32643 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.897434 32658 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.881678 32629 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.907459 32631 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.907819 32643 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.897670 32615 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.898658 32642 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.909871 32631 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:42.898680 32596 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.695019 32635 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.910672 32615 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.910903 32635 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.900681 32652 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:42.899674 32561 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.892293 32585 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:42.903313 32574 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.888330 32648 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.198107 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.114984 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:43.185185 30812 debug-util.cc:398] Leaking SignalData structure 0x7b080035bf60 after lost signal to thread 30815
I20260709 13:14:43.198843 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.140978 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.227270 31601 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:43.114600 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.122764 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.231510 31026 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:14:42.973100 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.665s	user 0.015s	sys 0.044s
W20260709 13:14:43.232337 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.924s	user 0.015s	sys 0.052s
I20260709 13:14:43.237174 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:42.802817 32625 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.519603 32641 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:43.132213 31569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.011s	sys 0.002s
I20260709 13:14:43.237563 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.122676 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:43.250954 30998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.019s	sys 0.005s
I20260709 13:14:43.226040 30879 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:42.531438 32634 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:43.259101 31569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.011s	sys 0.006s
I20260709 13:14:43.259481 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:42.917344 32643 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.260116 31024 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:42.801807 32653 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:42.803211 32644 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.871505 32622 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.261189 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.258956 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:42.519340 32646 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:42.530795 32620 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.956887 32615 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.861953 32654 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.197324 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.029704 32642 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.185441 32629 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.126201 32665 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.215656 32635 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.133167 32664 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:42.979449 32613 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.269407 32482 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.844278 32640 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.872148 32638 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.270639 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.271862 31028 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:42.531188 32627 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.670527 32616 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.148815 32670 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:43.274744 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.271517 32678 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:42.670291 32621 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:42.958859 32655 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.263098 32652 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:43.263280 32657 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.279630 32615 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.278437 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.270164 32647 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.279960 30922 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:43.284651 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:43.287206 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.287479 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.278024 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.288646 32646 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:42.920336 32668 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.293833 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.275156 32643 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.294900 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:43.297225 32482 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.298260 32666 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.289520 32665 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.301566 31604 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:43.271364 32634 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:42.689570 32623 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.247784 32574 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.278167 32653 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.286044 32642 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.290639 32622 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:43.279207 32654 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.261981 32625 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.275902 32620 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.276459 32644 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.332990 32674 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.418773 32673 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.617445 32673 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.618464 32644 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.618384 32674 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.376339 32616 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.620884 30875 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:43.621023 32674 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.567564 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.622001 32616 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.622869 31024 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:43.623230 32673 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.594115 32648 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.493299 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.624648 32642 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.624930 31605 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:14:43.625303 32657 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.382685 32670 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.626458 31029 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:43.627277 32657 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.497624 32683 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.371078 32627 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.628201 32683 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.628995 32670 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.349045 32664 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.630180 32627 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.630635 32683 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.631868 31026 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:43.632304 32574 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.632390 32664 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.632599 32622 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.633005 32668 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.633388 32666 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.332715 32677 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.635401 32668 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.635174 32677 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.636348 32666 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.637137 31031 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:14:43.408362 32613 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.637621 32620 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.638656 32652 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.639248 32613 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.640666 32625 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.640846 32678 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.642951 32614 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.643221 32678 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.643477 32614 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.491832 32671 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.644563 32677 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.644838 32671 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.645349 32655 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.645991 32614 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.647532 32665 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.647867 32655 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.648976 32689 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.649482 32689 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.620216 32621 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.328195 32635 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.652561 32635 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.651953 32614 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:43.654212 32687 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.654309 32614 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.654898 32687 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.656584 32614 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.300731 32676 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.332389 32662 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:43.657706 32687 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.657445 32676 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:43.658370 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 351142us
I20260709 13:14:43.550483 32659 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.641474 32482 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.667316 32643 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.669906 32615 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.670186 32653 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:43.633255 32647 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:43.458187 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.463s	user 0.002s	sys 0.028s
I20260709 13:14:43.375998 32638 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.371248 32640 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.615592 32585 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.657910 32662 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.666054 32623 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.565908 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.651968 32689 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.762894 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.892899 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.678448 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:43.779918 32624 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:14:43.897964 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 219583us
I20260709 13:14:43.647446 32671 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.623230 32654 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.902853 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.776819 32574 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:43.652575 32621 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.907966 32623 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.907932 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.892795 31597 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:43.760381 32676 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.896342 32634 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.909852 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.757359 32652 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.900863 32653 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:43.912029 32653 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:43.912411 32653 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:43.913287 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.914705 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.914759 32640 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.905050 32635 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.909207 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.905934 32624 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:43.926347 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.932727 31598 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:14:43.929348 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:43.916275 32574 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.935565 32624 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.936421 32647 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.927924 32643 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.438556 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.937799 30882 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:43.938269 32574 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:43.933785 32662 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:43.418802 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.915083 32638 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:43.939051 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.939353 30880 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:14:43.940415 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.941504 32653 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:43.942484 31605 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:43.945602 32653 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:44.264902 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:43.437585 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.441186 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.406035 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 1956) took 1075 ms. Trace:
I20260709 13:14:44.406430 30874 rpcz_store.cc:276] 0709 13:14:43.330656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.330915 (+   259us) service_pool.cc:224] Handling call
0709 13:14:44.405946 (+1075031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:44.459000 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 335) took 1262 ms. Trace:
I20260709 13:14:44.459801 30875 rpcz_store.cc:276] 0709 13:14:43.196899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.197046 (+   147us) service_pool.cc:224] Handling call
0709 13:14:44.457947 (+1260901us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400124dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:44.458901 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780514048}
W20260709 13:14:44.520828 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 1.24085e+06us
I20260709 13:14:44.520947 32641 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:44.521469 32641 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:44.521849 32641 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.522049 30922 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:43.563421 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.523233 30878 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:44.523583 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:44.524443 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1317) took 1105 ms. Trace:
I20260709 13:14:44.524816 30878 rpcz_store.cc:276] 0709 13:14:43.418979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.563205 (+144226us) service_pool.cc:224] Handling call
0709 13:14:44.524382 (+961177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:44.528997 32641 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.531066 32641 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.531262 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1315) took 1122 ms. Trace:
I20260709 13:14:44.531344 32692 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:44.531922 32692 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.531782 30876 rpcz_store.cc:276] 0709 13:14:43.408815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.408952 (+   137us) service_pool.cc:224] Handling call
0709 13:14:43.420768 (+ 11816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.630665 (+209897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.630700 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:43.630747 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:43.630776 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.531013 (+900237us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000d43d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:44.531058 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.531188 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482234240}
I20260709 13:14:44.532498 32692 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.532817 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.534349 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.534399 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.535151 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.535331 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.536515 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.537148 31598 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:14:44.537235 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.537864 31600 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:14:44.523635 32691 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.542564 32692 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.543653 32691 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:44.544569 32691 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.544988 32692 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:44.546108 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.551s	user 0.018s	sys 0.039s
W20260709 13:14:44.546491 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 3.55122e+06us
I20260709 13:14:44.552322 32694 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.552861 32694 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:44.553601 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.559180 31601 raft_consensus.cc:1217] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:14:44.567675 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.568105 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.554986 32694 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:44.568737 31604 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:14:44.555099 32691 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.569602 31601 raft_consensus.cc:1217] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:44.570674 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.573763 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.574586 32691 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.575325 32693 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.575932 32694 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.575954 32693 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:44.576603 32694 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.579241 32694 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.579664 32665 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.588084 32665 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.590232 32665 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.591256 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:44.579499 30922 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:44.580399 32562 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.592429 32691 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.592862 32691 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:44.592577 32562 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:44.593281 32691 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.594671 32562 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:44.583048 32693 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:44.596675 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:43.507274 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3fc0 after lost signal to thread 30907
I20260709 13:14:44.598033 32693 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.598364 32693 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:14:44.598603 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8ce0 after lost signal to thread 30982
I20260709 13:14:44.598701 32693 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.597251 32697 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.601703 32697 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:44.602128 32697 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.606220 32691 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.607342 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:44.607573 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1319) took 1170 ms. Trace:
I20260709 13:14:44.608180 32562 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.608580 32562 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:44.608937 32562 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.609979 32691 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.607929 30880 rpcz_store.cc:276] 0709 13:14:43.437564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.941136 (+503572us) service_pool.cc:224] Handling call
0709 13:14:44.458129 (+516993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:44.458360 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:44.458403 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:44.458472 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:44.458526 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.458615 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.607375 (+148760us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400124dd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:44.607490 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1188330240}
I20260709 13:14:44.620332 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 539) took 1054 ms. Trace:
I20260709 13:14:44.620512 32665 raft_consensus.cc:1064] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:44.620769 31596 rpcz_store.cc:276] 0709 13:14:43.565776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.565903 (+   127us) service_pool.cc:224] Handling call
0709 13:14:43.566198 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.638131 (+ 71933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.638167 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:43.638216 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:43.638251 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.620027 (+981776us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b5400642dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:44.620086 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.620247 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164945792}
I20260709 13:14:44.622956 32665 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.623735 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:44.625268 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800134960 after lost signal to thread 31056
W20260709 13:14:44.625672 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08003409a0 after lost signal to thread 31057
W20260709 13:14:44.637764 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800343d00 after lost signal to thread 31629
I20260709 13:14:43.526101 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.650662 31605 raft_consensus.cc:1217] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:14:44.650791 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 1960) took 1216 ms. Trace:
I20260709 13:14:44.651190 30879 rpcz_store.cc:276] 0709 13:14:43.434248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.525683 (+ 91435us) service_pool.cc:224] Handling call
0709 13:14:44.650735 (+1125052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:44.628997 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 535) took 1065 ms. Trace:
I20260709 13:14:44.652050 31599 rpcz_store.cc:276] 0709 13:14:43.564004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.564148 (+   144us) service_pool.cc:224] Handling call
0709 13:14:43.564469 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.906750 (+342281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.906798 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:43.906845 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:43.906885 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.628761 (+721876us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54005f0354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:44.628813 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.628930 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779861888}
I20260709 13:14:44.633960 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.631062 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.631928 32690 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:43.562371 30779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 353) took 1263 ms. Trace:
I20260709 13:14:44.711452 32690 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.711984 30779 rpcz_store.cc:276] 0709 13:14:42.298991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.299111 (+   120us) service_pool.cc:224] Handling call
0709 13:14:43.562300 (+1263189us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:14:44.636441 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:43.331375 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.713762 30877 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:44.713996 32690 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:44.714260 30877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1313) took 1383 ms (client timeout 1565 ms). Trace:
W20260709 13:14:44.714665 30877 rpcz_store.cc:269] 0709 13:14:43.330619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.331050 (+   431us) service_pool.cc:224] Handling call
0709 13:14:44.714198 (+1383148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:44.645056 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.316s	user 0.011s	sys 0.021s
W20260709 13:14:44.715508 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.011s	sys 0.021s
W20260709 13:14:44.646311 30921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.351s	user 0.012s	sys 0.040s
W20260709 13:14:44.716799 30921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.426s	user 0.013s	sys 0.040s
I20260709 13:14:43.451346 30780 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 347) took 2467 ms. Trace:
I20260709 13:14:44.629416 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.719736 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.719846 30780 rpcz_store.cc:276] 0709 13:14:40.983939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:42.515999 (+1532060us) service_pool.cc:224] Handling call
0709 13:14:43.451210 (+935211us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:14:44.721442 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.722183 30949 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:44.634287 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.722971 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.724356 32706 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:44.635666 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.641273 32662 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:44.754551 32662 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.756762 32662 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:44.572110 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:44.656123 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800293840 after lost signal to thread 32605
W20260709 13:14:44.762019 30812 debug-util.cc:398] Leaking SignalData structure 0x7b080033d5c0 after lost signal to thread 32608
W20260709 13:14:44.762346 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 52209.8us
I20260709 13:14:44.649995 31571 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:44.634495 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.767874 32681 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.606694 32693 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.672228 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 564) took 1414 ms. Trace:
I20260709 13:14:44.769914 32641 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.770117 31025 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.770499 32641 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.771171 32693 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.681689 32695 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.772818 32691 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:44.772744 32695 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:44.773173 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:44.773319 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44886.5us
I20260709 13:14:44.773402 32691 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:44.774770 32695 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:44.769755 31603 rpcz_store.cc:276] 0709 13:14:43.257525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.259517 (+  1992us) service_pool.cc:224] Handling call
0709 13:14:43.259819 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:43.634259 (+374440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:43.634290 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:43.634333 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:43.634363 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:44.671935 (+1037572us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54005f0fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:44.672009 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:44.672171 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860664704}
I20260709 13:14:44.775638 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:44.776201 31601 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.776965 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.777915 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.682559 32696 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:44.683913 32698 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:44.780259 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:44.684952 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 1.40022e+06us
I20260709 13:14:44.686450 32700 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:44.688661 32703 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:14:44.689319 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 57905.2us
I20260709 13:14:44.832157 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:44.694859 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.695861 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.696318 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.700106 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.702013 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.634951 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.863682 32690 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:44.863755 32703 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.847824 32698 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.724252 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.725144 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.866338 32641 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.647588 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:44.831558 32700 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:44.727344 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.728125 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.724869 32706 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:44.869515 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.728230 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.870154 30950 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:44.870553 30949 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:44.728809 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.734287 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.871083 32706 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:44.871371 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.871107 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.735872 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.728968 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.869515 30998 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:44.742787 32562 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.764084 32692 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:44.767740 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 117831us
I20260709 13:14:44.664389 32697 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.769043 32681 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:44.778129 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.885149 30879 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:44.885246 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:44.886044 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.778986 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.886762 30877 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:44.782104 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.781606 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:44.779402 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.684325 32702 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:44.888538 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.778461 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:44.827739 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 51573.1us
I20260709 13:14:44.836125 31023 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:44.836594 31030 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:44.833262 31028 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:14:44.889839 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.890857 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:44.851207 32710 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.854269 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.827309 32705 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.768186 32709 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:44.861815 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:44.856312 30923 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.501s (SENT)
I20260709 13:14:44.853547 32696 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.895009 31029 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.864279 32690 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:44.914863 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.866757 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.871467 30952 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:44.868289 32700 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:44.741039 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.762537 32708 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:44.873886 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.874042 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:44.869537 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:44.922216 32697 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.922412 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.921005 31031 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.916174 32709 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.828450 30874 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:44.877174 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:44.925015 32702 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:44.925593 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48507.7us
W20260709 13:14:44.927609 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 53651.6us
I20260709 13:14:44.893458 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.779860 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.928304 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:44.921818 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.928814 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.920707 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.913182 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:44.913950 31027 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:44.881505 32707 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.914920 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:44.900122 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 67358.9us
I20260709 13:14:44.738133 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.916520 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.942879 30953 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:44.888602 32681 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:44.944288 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.944686 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:44.895746 31605 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:44.926510 32709 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.917529 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.917359 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:44.977586 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:44.924623 30950 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.923465 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.979653 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.876055 31601 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:44.929060 30881 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:44.895794 31604 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:44.966866 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.979561 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:44.981774 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.981843 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:44.966202 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:44.972293 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.974611 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.917538 32690 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:44.920454 32698 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.945168 32707 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:44.888346 32692 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:44.921420 32703 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.984465 31602 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:44.937248 30958 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:44.944469 32665 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:44.960493 32653 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:44.977594 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.014652 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:44.977181 32662 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:44.912438 32710 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.030072 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.031227 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.032265 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.032476 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.032891 30956 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:45.016901 32707 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.034049 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:45.034132 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:45.035173 30951 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:45.035329 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.020691 32702 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:44.913836 32705 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.035214 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.012806 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.064357 31029 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:44.943843 32708 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.028877 32562 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.029672 32643 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.029814 31023 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:14:45.021575 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 189495us
I20260709 13:14:45.065698 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.066035 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.067875 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:45.068977 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 142423us
I20260709 13:14:45.069715 32720 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.069710 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.070552 32720 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.071112 32702 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:45.071498 32702 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.071861 32702 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.072023 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:45.072990 32720 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.018392 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.075130 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.076606 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.021646 32653 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:45.074752 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:45.075114 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93325.9us
I20260709 13:14:45.075361 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.080462 32562 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:45.080938 32562 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:45.067113 32643 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.081450 32694 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:45.081800 32562 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.081770 32643 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.085037 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.085264 32715 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.085762 32715 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:45.086488 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.021198 32662 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:45.087051 31028 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:14:45.087150 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:45.087949 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.085143 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.088498 31028 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:45.089540 31032 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:45.091591 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.092192 30956 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:45.100991 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.102587 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.102749 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.103248 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:45.104784 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:45.105427 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.102516 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.105767 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.106361 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:14:45.110360 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:45.081493 32708 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.112429 32703 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.113152 32696 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.086285 32653 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.086124 32715 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.114789 30955 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:45.077431 32721 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.099750 32691 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.100061 32713 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.100603 32698 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.099299 32662 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.132776 32712 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.141881 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.122398 32721 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:45.074206 32714 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:14:45.161093 31601 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:14:45.160758 32712 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.167970 32712 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.169198 32716 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.171665 32716 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:45.172076 32716 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.164040 32721 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.166348 32692 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.170912 32710 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.175539 32720 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.179693 32720 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:45.116210 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 259918us
I20260709 13:14:45.222151 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.252333 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.253023 30955 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.253912 30956 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
W20260709 13:14:45.140975 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.273475 31029 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:14:45.275094 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 171735us
I20260709 13:14:45.277891 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:14:45.306641 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 292078us
I20260709 13:14:45.314271 32728 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.314711 32705 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.314805 32728 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.315403 32728 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.313210 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:45.328063 32708 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:45.328881 32708 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:45.336453 32692 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:45.338524 32692 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.182252 32720 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:14:45.342963 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 232523us
I20260709 13:14:45.346235 30998 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:45.346307 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.347337 30958 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:45.347570 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:45.348237 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:45.350121 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.348353 32709 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:45.352259 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.352407 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.353111 30955 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
I20260709 13:14:45.353195 32730 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.353717 32730 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.354189 32730 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.354578 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.339715 32692 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:45.362133 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:45.367375 30953 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:45.331189 32708 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.373646 32705 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:45.381283 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:14:45.380661 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 241400us
I20260709 13:14:45.394044 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:45.395206 30953 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:45.395583 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.398265 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.399544 32643 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.401199 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.402540 32722 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.404685 32722 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.402719 32643 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:45.408100 32722 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.412614 32732 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.417691 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.420511 32708 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.424633 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.424700 32692 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.426290 32692 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.415158 32653 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.437845 30875 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:45.438860 32726 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.439280 32726 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:45.440356 32726 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.443876 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:45.447942 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 113284us
I20260709 13:14:45.449810 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.452492 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:45.456131 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.456974 30875 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:45.389806 32690 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.459837 32728 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.462963 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.466005 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.447295 32700 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.466455 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.472043 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.472265 30878 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:45.472612 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.473546 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.477463 32705 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.477535 30879 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:45.477995 32705 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.478420 32705 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.476315 30883 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:45.486428 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.486753 32709 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.487342 32709 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.487803 32709 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.475574 32653 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.496507 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.497658 31029 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:45.500155 32722 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:45.500873 32722 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.503255 32722 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.503499 32662 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.505076 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.506243 32662 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.506610 32722 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.507450 32707 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.510138 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.511897 32722 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.512866 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.509012 32702 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.513113 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:45.516606 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.517268 30877 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.512631 32730 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.522229 32727 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.522657 32727 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:45.523033 32727 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.527654 31028 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:45.526901 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 125953us
I20260709 13:14:45.493911 32690 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.535619 30877 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:45.537191 32697 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:45.538550 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.540222 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.539201 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.544377 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.545154 30878 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:45.546185 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.534340 32721 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.547828 32733 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.548298 31032 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:45.549734 32721 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.551505 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.548401 32722 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:45.552889 32681 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.002s
I20260709 13:14:45.553262 32722 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.553767 32722 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.553546 32681 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.555958 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.548327 32733 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.556748 31599 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:45.556878 32733 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.489347 32712 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.559315 32712 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:45.559901 32716 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:45.562501 32716 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.547974 32653 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.564250 32706 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:45.565577 32641 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.565949 32641 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:45.566629 30998 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.566973 32641 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.569336 32728 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:45.569833 32641 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.568809 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.573992 31603 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.574294 32697 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.574800 32697 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:45.575187 32697 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.559612 32705 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.579366 32705 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.581219 32681 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.594146 32705 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:45.594986 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.596834 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.597899 32714 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.598047 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.599291 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.600167 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.600804 32702 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:45.601841 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.606532 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.607268 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.607982 32707 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:45.609004 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.610062 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.611970 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.620199 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.623441 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.625241 30880 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.611980 32662 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.614042 32714 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:45.638190 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65465.6us
I20260709 13:14:45.622989 32681 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.636474 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:14:45.635295 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 122443us
I20260709 13:14:45.604945 32697 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.644333 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:45.656929 31600 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:14:45.657301 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 58135.4us
W20260709 13:14:45.656016 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080016b6c0 after lost signal to thread 29721
I20260709 13:14:45.645524 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.658367 32697 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.658782 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:45.659113 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080016b2c0 after lost signal to thread 30815
I20260709 13:14:45.660034 32705 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.660254 30924 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.661135 32705 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.661617 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:45.661844 32708 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:45.662531 32706 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.662967 32706 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.663412 32706 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.653244 30880 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:45.663512 32733 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.670274 32716 raft_consensus.cc:2764] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:45.676677 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.613279 32709 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.681797 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.681411 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.684032 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.679800 32700 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.687124 31603 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:45.688553 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.681736 32730 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:14:45.690223 32715 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.006s
I20260709 13:14:45.693738 32727 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.694047 32715 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.695123 30877 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:45.693408 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.695881 32730 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.692876 32695 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:45.697027 32681 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.699684 31597 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:45.693898 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.700619 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:45.701452 32709 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.702808 31596 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.703017 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.697050 31600 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.702664 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:45.703661 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:45.716336 32695 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:45.721609 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:45.722708 32740 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.722581 32695 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.724167 32740 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.724519 32740 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:45.724911 32740 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.726504 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.727098 30875 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
I20260709 13:14:45.718469 32726 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.742027 32726 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.743860 32733 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.748462 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:45.752493 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:14:45.753232 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 59446.6us
I20260709 13:14:45.753607 32700 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:45.743541 32653 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.754067 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:45.755949 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 91185.6us
I20260709 13:14:45.756646 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:45.757628 32690 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:45.758049 32690 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:45.758512 32690 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.758296 32732 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:45.761866 32732 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:45.762362 32732 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.762519 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.764012 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:45.765103 32727 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:45.768901 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 93176.6us
I20260709 13:14:45.754030 32700 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:45.739554 32721 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:45.772593 31598 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.775586 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:14:45.776404 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 55638.5us
I20260709 13:14:45.747349 32706 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.774737 32694 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:45.779096 31600 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.779227 32562 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:45.779349 32705 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.779731 32562 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:45.780745 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.780831 32562 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.775372 32700 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.783612 32562 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.786525 32740 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.789382 31599 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:45.793289 31571 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.794371 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:45.794746 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.795469 32662 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:45.794368 32730 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.796255 32714 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.800128 32714 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:45.799861 32694 consensus_queue.cc:1059] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:45.801134 32707 raft_consensus.cc:3055] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:45.801545 32707 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:45.802536 32653 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:45.803083 32653 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:45.802595 32707 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.801134 32714 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.803993 32653 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.770501 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:14:45.806178 31053 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc8e0 after lost signal to thread 30907
W20260709 13:14:45.807595 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080035eac0 after lost signal to thread 30982
I20260709 13:14:45.808151 32722 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:45.808910 31053 debug-util.cc:398] Leaking SignalData structure 0x7b0800387900 after lost signal to thread 31056
I20260709 13:14:45.810287 32722 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:45.809223 31053 debug-util.cc:398] Leaking SignalData structure 0x7b0800387940 after lost signal to thread 31057
I20260709 13:14:45.805230 32714 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.777263 32721 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:45.804751 32690 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:45.805294 32653 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.832235 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.834172 32707 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:45.822139 32732 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:45.837323 32709 raft_consensus.cc:1064] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:45.837828 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.838243 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:45.839666 32732 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.840642 31596 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.815469 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:45.817349 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.818303 32697 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:14:45.819877 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 57739.9us
I20260709 13:14:45.820456 32710 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:45.820804 30878 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:45.849680 32694 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:45.849963 31596 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.850035 32694 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:45.821013 32702 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:45.851315 32694 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.852658 32694 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:45.811342 32692 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.828130 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.867720 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:45.846637 30924 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.821924 32721 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:45.853988 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:45.855343 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.858675 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.860357 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.861233 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.862253 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.862591 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.863443 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.865329 32705 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:45.866655 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:45.872673 32697 raft_consensus.cc:1064] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:45.868340 32692 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:45.871415 32709 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:45.874714 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:45.875214 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 55914.7us
I20260709 13:14:45.879134 31023 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:45.854339 32690 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.886528 32716 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:45.888411 32732 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:45.883049 32653 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:45.906775 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:45.880642 32692 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.906603 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:45.914676 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 60796.4us
W20260709 13:14:45.917989 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 120817us
I20260709 13:14:45.922444 32739 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:45.922870 32739 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:45.923257 32739 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:45.922897 31571 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:45.892074 32715 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.933669 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:14:45.936121 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 123838us
I20260709 13:14:45.936523 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:45.936900 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:45.938048 30924 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:45.938126 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:14:45.924515 31053 debug-util.cc:398] Leaking SignalData structure 0x7b0800356d40 after lost signal to thread 31629
I20260709 13:14:45.919621 32722 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:45.932886 30848 connection.cc:256] RPC call timeout handler was delayed by -1.4844498299999032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:14:45.970489 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2306498299999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:14:45.970139 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:45.972641 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2261498299999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:14:45.973083 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2243498299999374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:14:45.973456 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0774783859999388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:14:45.973842 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0353498299998591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:14:45.974390 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0299498299998504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:14:45.953522 32662 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:46.002630 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64676.8us
I20260709 13:14:46.002314 31024 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:45.969653 30950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:14:45.978204 32708 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:45.969688 32740 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:45.977308 32722 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:14:46.009845 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 43847.3us
W20260709 13:14:46.008204 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65797.2us
I20260709 13:14:45.985988 32745 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:46.008387 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:45.978227 32706 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:45.979285 32695 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:14:45.986418 32662 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:46.027012 32748 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:14:46.028064 32722 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:46.015689 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 80844.9us
I20260709 13:14:46.032550 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:46.035317 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.037425 32734 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:46.037842 32734 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:46.038172 32734 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.014289 30950 raft_consensus.cc:606] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:46.047863 32741 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.040370 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:46.052613 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 48124.8us
I20260709 13:14:46.014585 32745 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.031224 32743 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.057575 32697 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.062065 32721 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.064289 31032 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:46.066272 32739 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:46.068404 32706 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:46.068564 32690 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.068836 32706 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:46.068962 32690 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.069314 32706 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:46.077894 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 98614.2us
I20260709 13:14:46.034077 32662 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.081620 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.082664 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.084209 32749 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:46.084317 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.084666 32749 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:46.085054 32749 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:46.087303 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47008us
I20260709 13:14:46.087960 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:46.088477 31571 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.091732 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:46.093185 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 83236.8us
I20260709 13:14:46.079145 32695 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.054694 32700 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:46.083236 32681 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:46.101406 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.110950 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.112576 32701 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:14:46.113484 31598 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.113804 32701 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.114243 32701 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.094609 32743 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:14:46.116194 32746 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:46.116642 32746 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:46.116737 32745 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.117897 32745 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.118573 32739 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:46.118974 32716 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.119371 32716 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.120285 32716 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.121522 32716 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.121595 32562 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.122117 32562 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:46.123021 32562 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.129410 32562 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.123782 32698 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.131942 32698 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:46.132987 32698 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.124696 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:46.136725 32700 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:46.137280 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 59857.4us
I20260709 13:14:46.137699 31026 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:46.125892 30776 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:46.117486 32746 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:46.096127 32727 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.106773 32733 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.094391 32641 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:14:46.109769 32695 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:46.171406 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 90728.9us
I20260709 13:14:46.135349 32692 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.164390 32722 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:46.177989 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89572.8us
I20260709 13:14:46.184840 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:14:46.185160 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:46.178632 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.098464 32690 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.181792 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.187548 32716 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.188565 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.115281 32701 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:46.192945 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.187623 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.189625 32716 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:46.201656 32722 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:46.202065 30951 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:46.202199 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 96398us
I20260709 13:14:46.203078 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.204382 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.204542 32716 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.205209 32716 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.188405 31598 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:46.211829 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.213575 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.217993 32732 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:46.222530 32732 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:46.224016 32700 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:46.224496 32700 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.229537 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:46.227072 32700 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.231164 32700 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:46.231524 30878 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:46.233260 32707 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:46.236142 32716 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:46.236693 32716 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.237565 32716 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.175969 32721 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:46.214334 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:46.255759 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 70684.2us
I20260709 13:14:46.296693 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:14:46.297324 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.193306 32746 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.305970 31603 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.202128 32722 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:46.321872 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.327865 32734 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.328923 32749 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.330056 32734 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:46.331125 32749 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:46.331012 32706 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:46.316609 32722 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.259688 32715 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 13:14:46.338133 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 123888us
I20260709 13:14:46.348479 32692 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:46.356376 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:46.368150 32733 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.368520 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.314323 32759 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:46.333575 32701 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.372931 30953 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.374737 30949 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.386875 30950 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.380164 31603 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:14:46.390038 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 71109.6us
I20260709 13:14:46.390558 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.391165 31030 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.392204 30957 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.393414 31601 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.394093 31026 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:46.394433 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.403002 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.372125 32733 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:46.312305 32761 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:14:46.407637 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.408545 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.445027 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:14:46.445034 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 44838.2us
I20260709 13:14:46.376873 32759 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:46.448764 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.450968 32761 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:46.451880 32698 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.452246 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:46.448835 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.457144 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:46.462863 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 61610.4us
I20260709 13:14:46.458712 32749 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:14:46.453641 32759 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:46.507237 32752 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:14:46.504383 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:46.509407 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 149365us
I20260709 13:14:46.509938 31030 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:46.406065 32662 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:46.512554 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48768.9us
I20260709 13:14:46.519593 30953 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:46.521915 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.523242 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.524600 30956 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:14:46.527256 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 63478.2us
I20260709 13:14:46.527534 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.528330 30950 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:14:46.528554 32765 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:14:46.535285 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:46.536613 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:46.536974 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.541326 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:46.538331 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:46.550796 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:46.550988 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.552711 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.553453 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.555351 32762 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:46.555347 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.555907 32762 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.556702 32762 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.557693 32762 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.560738 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:46.561797 31605 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.537098 32727 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.568488 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.583361   305 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:46.583247 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 63419.2us
I20260709 13:14:46.583658 31602 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.584456 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.546862 32749 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:46.591497 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.559613   304 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:14:46.591987 32749 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:46.592710   304 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:46.593068   304 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.594311   304 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.593035 32749 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.564919 32706 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:46.605093 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.606805 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.608148   300 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:14:46.610623 31024 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:46.611809 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.612267 32716 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:46.612670 32716 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:46.613562 32716 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.614742 32716 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.615550 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.616389 32662 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:46.617293 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.595569 30875 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:46.620803 31599 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:46.620754 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.622327 31024 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:14:46.621506 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.627187 30949 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:46.627948 30953 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.630192 30952 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:46.631063 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:46.632383 30951 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.633391 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.635097 31601 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.639135 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.646544 30949 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:46.606805 32722 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.650682 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.652590 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:14:46.653182 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 62152.8us
I20260709 13:14:46.652747 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.654117 31571 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:46.655220   301 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.657490 30877 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:46.657820 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.660116 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.660315 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.660862 30877 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.661024 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.661342 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.661754 30955 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:46.661949 30958 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:46.662490 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.662822 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.663065 30955 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:46.664597 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.665139 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.669318 30955 raft_consensus.cc:2410] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:46.671366 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.672425 31030 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:46.672588 31597 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.673482 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.673751 31031 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:46.671996 30952 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:46.674636 30877 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:46.680717 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.681771 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.682788 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.687544 32722 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:46.688870 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.690869 31571 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:46.692831 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.693866 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.694985 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.695233 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.671239   301 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.700523 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.701683 30952 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:46.704519 32733 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:46.705744 32733 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.707247 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.708025 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.708336 30874 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.708742 30955 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:46.710664 30950 raft_consensus.cc:2410] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:46.684638 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.713150 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.713629 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.713477 30951 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
W20260709 13:14:46.714393 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.683368 32653 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:14:46.723112 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 157924us
I20260709 13:14:46.710439 32722 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.725854 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:46.727138 32722 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.728231 32662 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.729746   301 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.729465 32722 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.731585 32653 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:46.732857 32662 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:46.733263 32662 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.736617 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:46.740366 32662 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.741693 32662 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.746445 31028 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:46.749711 30874 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:46.750684 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.751597 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:46.752372 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:46.721011 32732 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:14:46.756608   304 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.760617 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:46.757403 32762 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.785665   308 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.788851 32709 raft_consensus.cc:993] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:46.766410   306 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.789409 32709 raft_consensus.cc:1081] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:46.788466 32759 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:46.794410 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.766229 32730 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:46.800302 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.809309 30951 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:14:46.811851 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49413.6us
I20260709 13:14:46.812443 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:46.815335 30879 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:14:46.818255 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.814298 32753 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:46.818800 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.814047 32707 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:46.820902 31599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:14:46.821647 31599 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.822057 31599 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.821326 32707 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.825851 32707 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:46.826788 32690 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:46.827391 32730 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.827740   308 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.828402 32730 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.808235 32759 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:46.830210 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:46.842113 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.843356 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:46.844386 30874 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:14:46.844957 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.842099 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:14:46.852808 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.856475 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.856772 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.857582 31027 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:46.819367 32753 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.860596 32753 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:46.856663 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.849602   308 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.846247 32721 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:14:46.877348 30956 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:46.878706 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.867455 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:46.882905 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.883831   314 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:46.867118   306 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.884936 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:46.885721   313 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:14:46.872965   308 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:46.888253 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:46.892608 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:46.893384 30877 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:46.889637 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:46.889355   308 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.886245 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:46.898972 30950 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:14:46.881841   301 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:46.900002 32734 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.906527 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:46.912832 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:46.915733   305 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:46.924299   311 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:14:46.924882 31596 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.920773 30879 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:14:46.926229 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:46.927146 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:46.928315 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:46.929980 30953 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:46.931632 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:46.932271 30874 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:46.934427 30878 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:46.937151 30950 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.937251 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:46.938835   317 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:14:46.941335 32753 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:46.941810 32697 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:46.947268 30877 raft_consensus.cc:1217] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:14:46.932193 31598 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.947275 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:46.948880 32562 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:46.933236 32734 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:46.947870 30877 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:14:46.957669 32562 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:46.957902 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.958525 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:46.964538 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:46.933562 32722 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:14:46.967608 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.948278 32730 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:46.970178 32562 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:46.973033 32562 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:46.974864 30997 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:46.977028 30876 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.977234 30881 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:46.978000 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.978601 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:46.979235 31597 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:14:46.979539 32695 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:46.978061 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.980074 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.967216 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:46.981395 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.981850 30880 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:46.982040 30875 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:46.983357 30882 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:46.980011 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.984223 32562 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:46.990214 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:46.995548 32695 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:14:47.007350 32562 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:47.009213 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:47.013772 31026 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:46.921180   306 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.020809 32697 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:47.027594 32722 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:47.044404 32722 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.045555 32722 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.046885 32722 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.047751 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.048115 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:47.048636 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:47.049481 30950 raft_consensus.cc:2410] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:14:47.050153 30958 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.050287 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.051811 30949 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:14:47.052170 30949 pending_rounds.cc:85] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 2
I20260709 13:14:47.052089 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.052558 30949 pending_rounds.cc:107] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:14:47.052840 30949 raft_consensus.cc:2889] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:47.025048 32748 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:47.060845 30953 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:47.029387 32692 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:47.064368 32692 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.066543 30955 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:47.068667 32692 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.072629 30875 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:47.077215 30877 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.080783 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.086197 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:47.098176 32730 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.098469 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.100152 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:47.054813 32697 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:14:47.105914 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.042078 32733 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:14:47.109217 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.110477 32695 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:47.036144 32739 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:14:47.111855 32695 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.112586 30955 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:14:47.116590 30874 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.120671 30924 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.128693 30875 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:47.115070 32697 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:47.115505 32707 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.144860 30953 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:47.116906 32714 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.147434 30924 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.099351 32730 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.149061 32752 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.150631 30951 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.150390 32748 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:47.153118 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:47.169888 32727 raft_consensus.cc:1064] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: attempting to promote NON_VOTER 74f5a5b7556240508983221981af4ab4 to VOTER
I20260709 13:14:47.170065 32748 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.154052 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:47.170460 32748 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:47.171244 32748 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:47.171666 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:47.147723 32714 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:47.156644 32721 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.147943 31599 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.146921 32739 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.116222 32734 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.159596 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.115561   304 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:14:47.169589 30880 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.172791 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.145263   308 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:14:47.172006 32733 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:47.168134 32757 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:14:47.173327 32706 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.200338 32706 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.190367 32733 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:47.201568 32733 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.201615 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:47.202776 32726 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:47.180635   319 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.209s	user 0.001s	sys 0.002s
I20260709 13:14:47.198494 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:47.199270   335 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:47.205477   315 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:14:47.174669 32714 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.174808 32721 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:47.209064   321 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:47.212935 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 53407.3us
I20260709 13:14:47.219261 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.209515   308 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.216507 31604 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.217465 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.213950 32732 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.220523   331 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:47.214138 32709 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.221894   308 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.218130 32748 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.220374   335 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.269831 30924 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.216900 32706 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:14:47.286319 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:47.296617 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 77447.4us
I20260709 13:14:47.297555 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.270983 32752 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:14:47.299851 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 190750us
I20260709 13:14:47.295542   331 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.271927 32690 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:14:47.308696 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:47.311805 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.295082   300 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.294900 32695 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:47.308265 32706 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.309036 32716 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:47.326071 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:47.296663 32727 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.332502 32752 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.333076 32732 raft_consensus.cc:2764] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:47.305311 32721 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.334424 32721 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.334529   331 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:47.335263 32744 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.335721 32744 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:47.336778 32744 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:47.338267 32744 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.340088 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:47.326967 32698 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:47.332751 32750 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.336793 31598 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:47.360191 32694 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:14:47.297079 32734 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.339275   300 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.324579 32695 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.373920 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.352118 32707 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.342691 32726 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:14:47.348861 32697 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.399245 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.395246 32562 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.396972 32733 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.368331   300 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:47.363364 32750 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:47.400081 32562 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.414151 32562 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.390533 32707 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:47.388994 32757 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.407680 32695 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.365427 32732 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:14:47.409694   334 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:14:47.391287   314 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:47.328812   308 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.411625   300 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.430245 32697 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.435182 30776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 356) took 1366 ms. Trace:
I20260709 13:14:47.436501 32732 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:47.446995 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.425776 32745 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:14:47.456707 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 57497.5us
I20260709 13:14:47.454280   335 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:47.455886 32745 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:47.469681 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.470294 31603 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:47.471143 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:47.471262 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:47.471386 30996 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:47.472110 30878 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:47.474119 32562 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.474527 32562 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.474865 32562 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.471217 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:47.478435 30880 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:47.461112 32707 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:47.467016 30780 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.461630 32750 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.485280 32750 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.487231 32761 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.487643 32761 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.488538 32761 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.489728 32761 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.483481 32752 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.491158 32752 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.493310 32752 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.494711 32714 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.496966 32745 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:47.508890 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 222666us
I20260709 13:14:47.509490 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.510600 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.508571 30780 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 3 to 4, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.515035 31601 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:14:47.518746 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.520602 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.516676 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:47.524670 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.525158 32562 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:47.518479 32753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.008s
I20260709 13:14:47.538264 31027 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:47.527727 32692 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.533175 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:47.501192 31599 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:47.536365 32562 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.521727 32757 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.525269 32745 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.541805 31030 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.541885 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:47.537742   352 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.545713 32714 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.531638 32716 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.547848 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:47.548681 31601 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.549330 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:47.550021 31025 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:47.520849 32727 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:14:47.553809 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.554816   344 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.556124 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:47.540453 32753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.002s	sys 0.008s
I20260709 13:14:47.540436 32733 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.557279 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.564368 32727 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:47.540063 32692 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:47.564602 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:47.548185 32752 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.567915 32739 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:14:47.552898 32714 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.548372   345 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:47.555678 32750 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.588371 31601 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:47.562532   327 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.568225   344 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:47.590126 30996 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:47.592036   343 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.592927 32752 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:47.569144 32727 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:47.582607 32740 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:14:47.602123 30877 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.569161   348 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.598125 32706 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:47.569468 32757 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:47.604755 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47523.2us
I20260709 13:14:47.605170 30879 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.607240 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:47.607573 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.604444   345 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:47.609030 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:47.609690 32740 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.610092 32740 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:47.609843   345 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.610898 32740 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:47.613116 32562 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:47.618285 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.619236 32562 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.619688 32562 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:47.619954 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.621110 31031 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:47.621752 30880 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:47.620507 32562 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.624620 32562 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.618891   349 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.629443   344 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.622069 32748 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:47.435653 30776 rpcz_store.cc:276] 0709 13:14:46.068525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.069299 (+   774us) service_pool.cc:224] Handling call
0709 13:14:47.435092 (+1365793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:46.332053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:46.551564 (+219511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:46.565122 (+ 13558us) write_op.cc:435] Acquired schema lock
0709 13:14:46.567682 (+  2560us) tablet.cc:662] Decoding operations
0709 13:14:46.600446 (+ 32764us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:46.600551 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:46.600583 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:46.600879 (+   296us) tablet.cc:701] Row locks acquired
0709 13:14:46.600929 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:14:46.601080 (+   151us) write_op.cc:270] Start()
0709 13:14:46.601225 (+   145us) write_op.cc:276] Timestamp: P: 1783602886601022 usec, L: 0
0709 13:14:46.601264 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:14:46.601963 (+   699us) log.cc:844] Serialized 595 byte log entry
0709 13:14:47.134490 (+532527us) op_driver.cc:464] REPLICATION: finished
0709 13:14:47.427598 (+293108us) write_op.cc:301] APPLY: starting
0709 13:14:47.427714 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:47.427849 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:47.429176 (+  1327us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:47.429538 (+   362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:47.429778 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:47.429853 (+    75us) write_op.cc:312] APPLY: finished
0709 13:14:47.430139 (+   286us) log.cc:844] Serialized 23 byte log entry
0709 13:14:47.430330 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:47.430431 (+   101us) write_op.cc:454] Released schema lock
0709 13:14:47.430486 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:47.430851 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:47.430885 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":288538,"apply.run_cpu_time_us":2295,"apply.run_wall_time_us":3250,"num_ops":1,"prepare.queue_time_us":153296,"prepare.run_cpu_time_us":27246,"prepare.run_wall_time_us":442458,"raft.queue_time_us":154308,"raft.run_cpu_time_us":60208,"raft.run_wall_time_us":272533,"replication_time_us":517019,"thread_start_us":559466,"threads_started":4,"wal-append.queue_time_us":180132}]]}
I20260709 13:14:47.622807 30879 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:47.632193 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.637436 32748 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.637837 32748 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:47.638193 32748 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.612026 32695 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:47.603196 32750 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.645406 32748 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:47.646380 32750 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.647450 32748 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:47.659945   335 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.660426   335 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.613701   300 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.662635   335 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:47.664299   300 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.667191   308 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.612448   343 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.668007   343 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.668135 31604 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.648325 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.648484 30951 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.675696 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:47.649041 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.650084 30955 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:47.676647 30881 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.679113 30878 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.678951 32752 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.676716 30949 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:47.650173 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.650707 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:47.689201 31029 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:47.689106 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.651322 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:47.689899 30957 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:47.651839 32715 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.652074 30950 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.690714 32715 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:47.652567 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:47.617900 32641 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:47.692292 30953 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.692634 30953 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:47.652715 31600 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.653673 31025 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:47.652617 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:47.700965 31031 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:47.654276 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:47.654620 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.690691 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:47.702577 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.702577 31025 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:47.655268 31026 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:47.606683   327 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.617504 32726 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:47.690789 30776 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 3 to 4, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.653290 31023 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.698099 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.721750 30952 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:47.698321 31601 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 LEARNER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:14:47.699327 30880 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:47.704967 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:47.723877 31027 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:47.705835 31029 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.693382 30953 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.724812 30877 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:47.725116 30953 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.718535 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.726879 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.727895 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.733748 31028 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.735060 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.735931 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.738139   300 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.737739 30953 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:47.735715 31601 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:47.743275 31028 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:47.674868 32709 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:14:47.745216 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.700034   352 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.753821 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.699703 32641 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:14:47.755226 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 100692us
I20260709 13:14:47.757966 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:47.744858 32734 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:47.759423 32734 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:47.759811 32734 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.749774 31029 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:14:47.765637 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.762794 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:47.769985 31601 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:47.766312 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.680936 32692 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.772987 32692 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.775014   352 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.732410 32662 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:14:47.776490 32662 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:47.776841 32662 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:47.739063 32726 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:47.754473 30952 raft_consensus.cc:2376] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2. Re-sending same reply.
I20260709 13:14:47.743912   336 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:14:47.783595 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.784409 30952 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:47.732600   314 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:14:47.745450 32707 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.760878 30779 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.795608 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.785250 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.744112   307 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:14:47.791838 32740 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.793934   315 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:14:47.797394 30952 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:47.768999   345 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.788285   300 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.805140 30953 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.804067 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:47.814595 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.815373 30953 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:47.818315 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.819859 31597 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:47.750735 32715 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.825500 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:47.826166 31601 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:47.777721 32662 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.777612   352 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.802074 32707 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:47.833974 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.833899 32726 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.836398 32757 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:47.837147 30876 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.831660 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.841349 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:47.841747 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:47.851274 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:47.856457 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52486.8us
I20260709 13:14:47.859241 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.860183 32715 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.852689   305 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:14:47.861501 32727 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:47.860443 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:47.831379 32745 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.781689   327 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.870183 32750 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:47.870400   327 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:47.865450 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.833909 32707 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:47.874886   352 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.876989   336 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:47.865136   300 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:47.884378 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:47.876614 32716 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:47.877528   352 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:47.887027 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.868520 32662 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.870827 32750 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.824862 32641 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.865072   345 consensus_queue.cc:1059] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:14:47.889387 30875 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:47.889168   336 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:14:47.901409 32714 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:14:47.902721 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.915743 30955 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:47.903321 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:47.892174 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.909737 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.889057 32716 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:47.884874   300 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:47.891992 32727 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:47.863561 32734 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:47.922739 32641 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:47.980993 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:47.909610 32739 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:14:47.917917 30949 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
W20260709 13:14:47.920145 32733 consensus_queue.cc:1175] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74f5a5b7556240508983221981af4ab4" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:14:47.982759 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.984998 32721 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:47.987524 30957 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:47.982057 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:47.996716 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:47.998625 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:48.000771 30956 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:47.981462 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:48.008797 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:48.009410 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:48.010118 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:47.988174   300 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.984089 32716 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.013751 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:48.019536 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:48.019543 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:48.022717 30954 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:47.998014 32753 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.025074 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:48.003513   348 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:14:48.022560   336 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.029044 32734 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:48.029246   336 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:48.030107   336 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.031934 30952 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:48.032385 32753 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.019842 31600 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:48.020501 32709 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.033540 32709 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.034566 32753 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.034785 30956 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.037348 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.019892   314 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:48.041107 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.019645 32706 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:48.044397 30882 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:48.045194 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.042693 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:48.046871 32690 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:48.048034 30954 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:48.049981 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.050765 31601 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:48.023123 32749 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:48.053726 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:48.035703 32709 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.059594 32694 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:48.067281 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.055083   345 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:48.061479 32694 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.086163 30953 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:48.083374 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.095631 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:48.096740   331 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:48.097757 32653 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.098323 32653 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.098546   331 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:48.099079 32653 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.089758 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:48.094893 32694 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.122535 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:48.149808 32562 raft_consensus.cc:3055] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:48.150375 32562 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:48.166095 31597 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:48.167824 32753 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.168351 32753 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.170480 32753 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.173237 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.095113   345 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:48.174950 32562 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:48.177431 30879 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:48.181324 32759 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:48.182613 32759 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:48.183009 32759 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:48.183284 30950 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:48.183902 32739 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.187604 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:48.188274 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:48.189988   344 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:48.192121 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.193564 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:48.194128   343 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 13:14:48.194262 30956 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:48.194334 30876 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:48.194583   343 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.195726 30951 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:48.195755 32759 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.196995 30880 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:48.197553 32759 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.199880 30954 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:48.203543 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:48.212888 32562 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.199589 32740 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:48.216208 32740 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:48.216620 32740 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.221824 31599 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:48.231865   327 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:14:48.237141   365 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:14:48.238603   344 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.240350 31601 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:48.208478 32715 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:48.232962 32721 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:14:48.224776   300 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.222914 32694 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.254500 32698 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:48.254951 32641 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:48.254721 32740 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.255983 30958 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:14:48.249081 32715 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.258033 32716 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:48.258621 32752 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.242192   344 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.244617 32749 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:48.274958   352 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.282217 32752 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.261900   345 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:48.286341 32715 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:48.331445   372 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
I20260709 13:14:48.332338 32752 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.333701 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:48.288561   344 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.273929 32698 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:14:48.291062   364 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.413s	user 0.003s	sys 0.000s
I20260709 13:14:48.291307 32740 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.274392   343 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.300702 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.301501 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.343851 32698 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:48.346585 32750 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.302446 30874 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:48.273692 32641 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.305184 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:48.302261 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.305927 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.306308 32757 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:48.307371 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:48.307575 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:48.309556   300 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.311539 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:48.321797 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:48.452831 30881 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.452998 32694 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.454226 31027 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:48.453974 32749 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.149814   369 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:14:48.343832 30875 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:48.346643 30882 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:48.300788 30876 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.465576 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:48.304656 31598 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:48.393684   305 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.437311 30874 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:48.443832 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.438623 30879 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:14:48.353794 30878 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:48.404939 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.375154 32739 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:48.447707 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 99348us
I20260709 13:14:48.505945 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:48.425369 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.388616 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:48.378532 32716 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:48.346745 32698 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.374419 32641 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.376806 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:48.424043 32692 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:48.379041   338 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:48.472141 32690 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.468446 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:48.469069 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.475428 30881 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:48.472102 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:48.506476 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:48.482052 31601 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:48.510654 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:48.466979 32694 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.518764 31597 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:48.534909 32562 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:48.535476 32562 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.535939 32562 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.518646 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:48.520084 30847 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:48.462852 30877 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:48.545176 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:48.519152 32692 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:48.510677 32739 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:48.467710 32757 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.541858 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:48.522893 31605 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:48.518998   341 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:14:48.514953   345 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:48.552211 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.559351 30949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.022s	sys 0.053s
W20260709 13:14:48.565022 30949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.022s	sys 0.053s
I20260709 13:14:48.524950 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:48.585175 32562 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.545200 32716 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:48.606063 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45078.4us
I20260709 13:14:48.620080 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:14:48.615151 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 88348.2us
I20260709 13:14:48.508728   305 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.549325 32697 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:48.551504 31600 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.623494   376 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:48.522692 32721 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:14:48.624686 30882 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.568173   345 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.545969 32707 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:14:48.639650 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.545666 32694 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.630290 31605 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:48.545116 32761 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:14:48.631408 32750 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:48.622354 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:48.556066   338 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.562376   373 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:14:48.629268 32757 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.640573   345 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:48.702589 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 80325.7us
I20260709 13:14:48.705673 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:48.708879 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:48.722052 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:48.722765 31027 raft_consensus.cc:2368] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4.
I20260709 13:14:48.587678 32562 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:48.682268   308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.021s
I20260709 13:14:48.537236 32690 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:48.747216 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.657482   336 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.725687 32562 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:48.695477 32740 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.697585 32750 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.763414 32714 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:14:48.658789   376 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:14:48.723124 32706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.003s	sys 0.011s
I20260709 13:14:48.685446   327 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.782554 32562 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.719213   315 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.720193 32716 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:48.723889   304 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:48.770143   308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.015s	sys 0.023s
I20260709 13:14:48.789307 32562 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:48.803414 30957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.022s	sys 0.023s
W20260709 13:14:48.803828 30957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.023s	sys 0.023s
I20260709 13:14:48.767247 32757 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:14:48.786871 32706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.003s	sys 0.011s
I20260709 13:14:48.785854 32750 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.814224 32562 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.653040 32692 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:48.828883 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.783949 32740 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:48.836393 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 294598us
I20260709 13:14:48.836565 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:48.846745 31601 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.810683 32759 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:48.796705   327 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.785292   336 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.856642   336 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:48.858722 30882 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:48.833356 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.799674   315 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.868530   338 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.870869 32740 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.871896 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.898463 31601 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
W20260709 13:14:48.872895 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:48.873780 32653 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.003s
I20260709 13:14:48.880375 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:48.881455 32726 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.012s	sys 0.030s
I20260709 13:14:48.889303 32562 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.815917 32706 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:48.813603 32761 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:14:48.907645 32562 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.899739 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:48.911425 30848 leader_election.cc:400] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4.
I20260709 13:14:48.911525 31604 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:48.911885 30848 leader_election.cc:403] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.833361   374 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.246s
W20260709 13:14:48.915994 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 366146us
I20260709 13:14:48.919539 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.920264 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:48.907326   369 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:48.911156 32726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.013s	sys 0.031s
I20260709 13:14:48.907245 32698 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:48.891042 32759 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.906719   376 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:48.938469 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58181.2us
I20260709 13:14:48.939441 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:48.934721 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.915287   349 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4.
I20260709 13:14:48.945338 32562 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:48.947921 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:48.948083 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:48.948927 30877 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:48.953106 31600 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:48.953531 30776 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 244) took 1295 ms. Trace:
I20260709 13:14:48.954149 32697 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:48.955480   345 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.955868 32706 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.957623   345 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.910737 32653 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.960055 31603 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:48.960970 32653 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:48.953950 30776 rpcz_store.cc:276] 0709 13:14:47.657665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.679838 (+ 22173us) service_pool.cc:224] Handling call
0709 13:14:48.953448 (+1273610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:47.998454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:48.032277 (+ 33823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:48.032318 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:14:48.032338 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:48.032694 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:48.032736 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:48.032764 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:48.032945 (+   181us) tablet.cc:701] Row locks acquired
0709 13:14:48.032963 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:14:48.033090 (+   127us) write_op.cc:270] Start()
0709 13:14:48.033215 (+   125us) write_op.cc:276] Timestamp: P: 1783602888033047 usec, L: 0
0709 13:14:48.033232 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:14:48.033793 (+   561us) log.cc:844] Serialized 533 byte log entry
0709 13:14:48.793408 (+759615us) op_driver.cc:464] REPLICATION: finished
0709 13:14:48.861651 (+ 68243us) write_op.cc:301] APPLY: starting
0709 13:14:48.861725 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:48.861821 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:48.861929 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:48.862134 (+   205us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:48.862285 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:48.862339 (+    54us) write_op.cc:312] APPLY: finished
0709 13:14:48.862501 (+   162us) log.cc:844] Serialized 23 byte log entry
0709 13:14:48.862643 (+   142us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.862706 (+    63us) write_op.cc:454] Released schema lock
0709 13:14:48.862739 (+    33us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":62001,"apply.run_cpu_time_us":1346,"apply.run_wall_time_us":1348,"num_ops":1,"prepare.queue_time_us":238334,"prepare.run_cpu_time_us":2516,"prepare.run_wall_time_us":45863,"replication_time_us":751115,"threads_started":1}]]}
I20260709 13:14:48.928877   395 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:48.953146 32641 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.961126   305 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:48.959568 30780 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 348) took 2116 ms. Trace:
I20260709 13:14:48.955482 32694 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.964390   383 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.965035   383 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:48.965453 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:48.969720 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:48.971359 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:48.974324 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 161760us
W20260709 13:14:48.943670 31599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.016s	sys 0.054s
I20260709 13:14:48.944432   338 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:48.982326 31599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.016s	sys 0.054s
I20260709 13:14:48.989153 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:48.993866 31597 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:14:48.974080 30875 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:48.964274 30780 rpcz_store.cc:276] 0709 13:14:46.842870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.843645 (+   775us) service_pool.cc:224] Handling call
0709 13:14:48.959487 (+2115842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:47.733702 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:47.794874 (+ 61172us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:47.794909 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:47.794925 (+    16us) tablet.cc:662] Decoding operations
0709 13:14:47.795338 (+   413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:47.795422 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:47.795449 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:47.862545 (+ 67096us) tablet.cc:701] Row locks acquired
0709 13:14:47.865464 (+  2919us) write_op.cc:260] PREPARE: finished
0709 13:14:47.874959 (+  9495us) write_op.cc:270] Start()
0709 13:14:47.884703 (+  9744us) write_op.cc:276] Timestamp: P: 1783602887874903 usec, L: 0
0709 13:14:47.886876 (+  2173us) op_driver.cc:348] REPLICATION: starting
0709 13:14:47.982866 (+ 95990us) log.cc:844] Serialized 918 byte log entry
0709 13:14:48.334542 (+351676us) op_driver.cc:464] REPLICATION: finished
0709 13:14:48.779362 (+444820us) write_op.cc:301] APPLY: starting
0709 13:14:48.786259 (+  6897us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:48.799243 (+ 12984us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:48.825167 (+ 25924us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:48.860078 (+ 34911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:48.860274 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:48.860326 (+    52us) write_op.cc:312] APPLY: finished
0709 13:14:48.860535 (+   209us) log.cc:844] Serialized 29 byte log entry
0709 13:14:48.860725 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.860806 (+    81us) write_op.cc:454] Released schema lock
0709 13:14:48.860855 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:48.861235 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.861267 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91170,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":391643,"apply.run_cpu_time_us":2350,"apply.run_wall_time_us":91999,"num_ops":2,"prepare.queue_time_us":88877,"prepare.run_cpu_time_us":4535,"prepare.run_wall_time_us":290744,"replication_time_us":447550,"thread_start_us":425785,"threads_started":2}]]}
I20260709 13:14:48.998555 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.001305 30996 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:49.002086 32707 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:48.991622   373 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.003334   395 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:49.004444   377 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:14:49.004529   395 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.005016   395 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.005630 32641 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:49.006513   381 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:14:49.008338 32690 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.008512   338 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:49.009502   338 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.011130   327 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.002530 32707 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:48.954119 32750 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.013646 32707 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.015240 32750 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:48.936184   369 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:48.941769 32698 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.025274   383 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.028729 32721 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:49.029165 32721 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:49.030313   395 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.003345   373 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.032618 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:49.038528 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.034919   373 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.039269 30879 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:49.038527 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.046311 30882 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:14:48.995092   391 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:49.046990 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.048113 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.021178 32750 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.029986 32721 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.044371 31600 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.057229 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.043294   374 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.057621   373 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:49.087903 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 139193us
I20260709 13:14:49.091427 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:49.092162 31605 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.094900 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.106873 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.108028 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.080274   383 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:49.108654 30878 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
W20260709 13:14:49.117769 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 134033us
I20260709 13:14:49.079985   368 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.086534 32721 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.117650 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:49.088291   373 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.088076   395 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.059250 32750 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.112597 32716 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.104858   300 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.114521 32740 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.116223 32690 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.157617 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.120024   383 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.162464 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.189435 30956 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:14:49.146142 32739 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.003s
I20260709 13:14:49.118083   397 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.086865   374 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:49.173319 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 233923us
I20260709 13:14:49.121279   315 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:49.194216 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.202265 32562 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.156729   373 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.206254 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:49.207089 30877 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.158016 32759 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.204648 32562 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.208145 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.192494   396 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.165477 32641 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.216995 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.197366   383 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.191676 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:49.221159 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.232874 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:49.233528 32761 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.228049 30879 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:49.234753 32761 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.216094 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:49.198714   388 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.203267   395 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:49.167244 32716 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.166991   300 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.219514   396 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:49.261940 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 61343.4us
I20260709 13:14:49.263200 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.250342 32562 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.191095 32740 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.212038   315 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.148748   368 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:49.200062   379 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.218847   343 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.249181 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.199846 32739 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.276861 30954 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:49.268079 30877 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:49.270969   401 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.235260 32761 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.223683   308 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:49.240042 31599 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.199092 32690 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.267122   396 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.206388   397 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.228899 32641 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:49.297984   394 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:14:49.264333   405 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.294543 30950 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:49.287510 32761 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.301853   401 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.313386 32716 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.264026   395 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.316825 32749 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.341797 32749 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.342481   397 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.342831 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.317299   410 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:49.276538   369 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.297186   308 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.328751 32698 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.332890 32641 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.292354   315 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.319209 32740 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:49.336077 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 50063.4us
I20260709 13:14:49.339109 32690 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.327482   374 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.341267   395 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.343930 32749 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.346473 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.253849   388 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.351159 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1315) took 1365 ms. Trace:
I20260709 13:14:49.285768   343 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.321187   405 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.363595   396 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.355510   315 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:49.392570 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.366055 31605 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:49.369673   383 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.292616   379 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.373071 32739 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.351992 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.365696   373 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.377840 30875 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:49.380090 31601 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:49.384673 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.407133 30877 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:49.385672 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.408354 30879 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:49.380008 30949 rpcz_store.cc:276] 0709 13:14:47.978582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.025806 (+ 47224us) service_pool.cc:224] Handling call
0709 13:14:48.035945 (+ 10139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:48.566570 (+530625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:48.566605 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:48.567135 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:14:48.914225 (+347090us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:49.106604 (+192379us) log.cc:844] Serialized 14 byte log entry
0709 13:14:49.106881 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.106953 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.344093 (+237140us) raft_consensus.cc:1685] finished
0709 13:14:49.344114 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.344229 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294031,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":5090,"raft.queue_time_us":43521,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":18547,"thread_start_us":980502,"threads_started":3,"wal-append.queue_time_us":395370}
I20260709 13:14:49.400007 32698 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:49.400534 32562 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.404569 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.411955 32562 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.413318   396 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.429718 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.431926   383 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.432880   305 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.433595 32692 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.406004 32749 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.435141 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.402702   374 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:49.443033   392 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:49.433454   305 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.446774 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.449286 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.453547 31605 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:49.453886 32562 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.454636 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.454988 32562 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:49.414714 31598 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:49.458549 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.441411 32698 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.449137 32697 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.440140   307 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.465575   307 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.464608 32726 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:49.468266 32726 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:49.469131 32726 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.471717 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:49.468292   368 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.475943 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.478509 30877 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:49.479888   408 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.480348   408 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.480674   408 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.449664 32749 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.456405   374 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.470613   300 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.473028 31600 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:49.495126   368 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.498134   368 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.485806 32750 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.507941 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:49.508606 31602 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.513124 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.513998 30877 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:49.519547 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:49.520341 30877 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:49.525784 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.526726 30883 raft_consensus.cc:2410] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:14:49.494609   343 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.532202   405 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.500257 31599 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:14:49.517928   368 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.493825 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:49.541031 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.542049 30779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54998 (request call id 321) took 2432 ms. Trace:
I20260709 13:14:49.547320 30883 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 2: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:49.550261 30877 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:14:49.529517   401 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.557706   343 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.557878   368 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.558493   343 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.558686   368 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.560889   343 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.561923   368 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.570122 32695 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.571003 32695 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.557922 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.593158 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.593663 31602 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:49.554706   373 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.601063 32706 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:49.584021   336 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.546368 30779 rpcz_store.cc:276] 0709 13:14:47.103974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:47.124064 (+ 20090us) service_pool.cc:224] Handling call
0709 13:14:47.638987 (+514923us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400260054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc4090 00007f273ac62f3a 00007f2740a191cc 00007f2740b1737e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc 00007f273efd7392 00007f2738f9548c 00007f2738f948c6
0709 13:14:49.536111 (+1897124us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:48.034186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:48.034698 (+   512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:48.034727 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:14:48.034745 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:48.035040 (+   295us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:48.035085 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:48.035117 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:48.035274 (+   157us) tablet.cc:701] Row locks acquired
0709 13:14:48.035291 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:14:48.035408 (+   117us) write_op.cc:270] Start()
0709 13:14:48.035511 (+   103us) write_op.cc:276] Timestamp: P: 1783602888035371 usec, L: 0
0709 13:14:48.035531 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:48.070189 (+ 34658us) log.cc:844] Serialized 533 byte log entry
0709 13:14:48.993879 (+923690us) op_driver.cc:464] REPLICATION: finished
0709 13:14:49.001144 (+  7265us) write_op.cc:301] APPLY: starting
0709 13:14:49.001221 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:49.001316 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:49.001438 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:49.001654 (+   216us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:49.001788 (+   134us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:14:49.001828 (+    40us) write_op.cc:312] APPLY: finished
0709 13:14:49.002012 (+   184us) log.cc:844] Serialized 23 byte log entry
0709 13:14:49.002172 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:49.002249 (+    77us) write_op.cc:454] Released schema lock
0709 13:14:49.002287 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:49.002591 (+   304us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:49.002617 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":551103872,"child_traces":[["op",{"apply.queue_time_us":4336,"apply.run_cpu_time_us":1430,"apply.run_wall_time_us":1430,"num_ops":1,"prepare.queue_time_us":224854,"prepare.run_cpu_time_us":2536,"prepare.run_wall_time_us":44644,"replication_time_us":958225}]]}
W20260709 13:14:49.620078 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 173369us
I20260709 13:14:49.602118   422 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:49.631563 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:49.619206 32706 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:14:49.637928 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.620687 32695 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.675607 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:49.678574 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.679313 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:49.680217 30996 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:49.681457 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.682166 30879 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:49.680490 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:49.686877 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:49.687815 30881 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.622087   336 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:49.687345   384 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:49.683629 32690 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.678725   374 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.705329 30881 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:49.686148   300 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.685937 32697 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.684350   379 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:49.715106 32721 consensus_meta.cc:287] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
I20260709 13:14:49.690825 32695 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:49.716745 32706 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.691849   426 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:14:49.682319   416 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.705221 32690 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:49.725828 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 155628us
W20260709 13:14:49.730068 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 107585us
I20260709 13:14:49.686690   422 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:49.722816   341 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.723973 31596 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:49.736164   416 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.741405 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:49.742959   416 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.738952   426 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:49.743445   307 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.745963   426 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.747028   374 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.722754 32761 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.749671   336 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.750891 32761 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.754581   401 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.736904 32690 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.755149   401 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.757058 32721 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:49.736663 32695 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:49.763245   401 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.763306 32695 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.747449   374 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:49.766649   374 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.724224   300 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.738078   341 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:49.776980 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:49.776980   341 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.778156 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.776358   388 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.777727 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:49.781342 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.769011 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.781994 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.782822 30883 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:49.784160 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.784950 30877 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:49.785867 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.786337 30874 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:49.778959 30879 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:49.744729 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.777627 30881 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.719754   408 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.777657 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.792820 30875 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:49.789539   388 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:49.793856   390 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.816s	user 0.004s	sys 0.000s
I20260709 13:14:49.794528 32692 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.795025 32692 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.798609 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.799327 30879 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:49.800148 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.800916 30883 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:49.801160 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.802067 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:49.797015 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adb189bd941147e0924cc38c9f01bd11 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f535fccbafb14e3f92bd45065da403db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:49.803617   376 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.797289 32709 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.804234   376 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.804466 32709 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.806485 32709 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.787050   379 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.808104 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.808715 30957 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:49.809123 32698 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.809239   300 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.809624 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.834017 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:49.836776 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.811275 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.837786 30877 raft_consensus.cc:2368] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6.
I20260709 13:14:49.820691 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:14:49.838584 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93896.3us
I20260709 13:14:49.809954 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.839241 30951 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:49.835093 30952 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.789115   416 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:49.841137 30874 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:14:49.842361 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.839277 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:49.832317 32721 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.849807 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:49.841797 30924 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.851095 31023 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:14:49.852602 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.848557 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.833390 32662 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.855299 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:49.857116 31025 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:49.832372   376 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.843133   338 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.808739 32749 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.857478 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:49.861078 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:49.868822 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.848702   300 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.872704 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:49.851481   401 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.880621 32749 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.881081 32749 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.880890   401 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:49.881459 32749 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.883069   401 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:49.884011 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:49.884341   300 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.884717 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:49.885975 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:49.886476   300 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.887076 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:49.873776   376 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.888200   376 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.888528   376 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.853299 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.846765   421 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:49.875193 31030 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:49.851276 32757 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.893294 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.877766 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.859584   343 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:49.859355   392 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.900818 32562 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:14:49.901742 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.808137   379 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.858021 32692 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.859431 32653 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.854166   304 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:49.794142   388 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.890758 30881 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:49.852438 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.879758 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.894264 30877 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:49.894939 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.919368 30951 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:49.895437   421 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.883570   401 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:49.880057 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:49.903585 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64386.6us
I20260709 13:14:49.903818 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.872226   327 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:49.896123   343 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:49.860944 32709 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:14:49.878393 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:49.920414 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.933750 30874 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:49.921334 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.881088   391 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:49.897332 32753 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:49.906190   393 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.905926 32697 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:14:49.927811 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 79313.7us
I20260709 13:14:49.929530 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:49.931249 30997 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:49.950212 32753 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.952004 31029 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:14:49.952185   434 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:14:49.952414 32753 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.952795 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.952986 32753 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.953064 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:49.953497 31598 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:49.957845 30950 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:49.958691 32690 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.960063 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.961756   379 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:49.910610   392 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.962731 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.963953 30876 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:49.908780   374 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.926734   327 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:49.868162 32662 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.906857 30875 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:49.928011   421 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:49.941514 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:49.964179   392 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:49.931998 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.901834 32757 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:49.868659   422 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.934908   343 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.929067 32692 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:49.938474 31601 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:49.975587 31605 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:49.873674   338 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.970929   327 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:49.997589 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.010773 31601 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:50.013417 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.998518 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:49.998773 31027 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:49.964695 32697 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:49.927579   304 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:49.968971 32721 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:49.987944 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:49.931044 32653 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.005987 31032 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:49.934378   401 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.030861   401 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:50.016202 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:50.032027 30949 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.018247 31605 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:49.970705   408 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:50.020656 30924 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:50.022675 30877 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:50.001119 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 351) took 1201 ms. Trace:
I20260709 13:14:50.046272 30952 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
W20260709 13:14:50.025681 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 105556us
I20260709 13:14:50.024751 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:50.026173 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 150499us
I20260709 13:14:50.047631 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:50.048465 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:50.047631 31024 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:50.049865 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:50.108466 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:50.108835 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:50.109586 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 96259.5us
I20260709 13:14:50.110591 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:50.111193 31601 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
W20260709 13:14:50.112457 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 64091.7us
I20260709 13:14:50.020169 32697 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:50.114190 31605 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:50.019318 32692 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:50.115458 30922 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:50.019856 32690 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:50.028769   379 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:50.119680 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:50.115160 31023 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
W20260709 13:14:50.122152 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 74597.2us
I20260709 13:14:50.041579 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:50.116202   410 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.738s	user 0.005s	sys 0.005s
I20260709 13:14:50.125348 30922 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:50.127561 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:50.126346 32750 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.120538   373 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.135138   373 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.135569   373 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.136977   304 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:50.137373 32662 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:50.137734   304 raft_consensus.cc:2764] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:50.122500   420 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:50.139621   388 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:50.127041 32714 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:14:50.128858   379 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:50.128772 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:50.142174 31024 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:50.129413   408 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:50.130151 31604 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:50.113974   383 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:50.126777   431 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:14:50.145054 30998 leader_election.cc:400] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6.
I20260709 13:14:50.148909 30998 leader_election.cc:403] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:50.145394 30949 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:50.127229 32695 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.153251 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.148252   408 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.153990 30874 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:50.155893   408 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:50.156533 32692 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.158607   420 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:50.164188 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:50.143321   406 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:50.141711 32750 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:50.144749   410 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:50.167017 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:50.124557 32709 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:14:50.150341   388 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.146704   383 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:50.160131 32695 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.168660 31598 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:50.177593 31024 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:50.180722 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:50.182518 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:50.185225 31025 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:50.188190 32750 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.191881 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.195955 31024 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:50.173414 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:50.200536 32721 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.181548   388 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.184264   383 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:50.167815   421 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:50.183382 32695 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:50.216012 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 418) took 1298 ms. Trace:
I20260709 13:14:50.223320   401 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.228577 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:50.229863 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:50.228682 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:50.232398 30780 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 3, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 3 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:50.198500   379 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:50.259413 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 274745us
I20260709 13:14:50.050199 30958 rpcz_store.cc:276] 0709 13:14:48.799753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.804908 (+  5155us) service_pool.cc:224] Handling call
0709 13:14:49.210362 (+405454us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:14:49.237462 (+ 27100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.582315 (+344853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.584562 (+  2247us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.625923 (+ 41361us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.740098 (+114175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:49.748426 (+  8328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:49.756152 (+  7726us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:49.967289 (+211137us) raft_consensus.cc:1685] finished
0709 13:14:49.967313 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:49.990314 (+ 23001us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70460,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":81,"spinlock_wait_cycles":12842368,"thread_start_us":301526,"threads_started":2,"wal-append.queue_time_us":187519}
I20260709 13:14:50.432731   457 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:50.423060 32707 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:50.435319 32707 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:50.434943   457 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.436558   305 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:50.237224 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.367720 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.386175 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:50.438037 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 209567us
W20260709 13:14:50.206154   435 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:14:50.376331 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 262794us
W20260709 13:14:50.364146   341 consensus_meta.cc:287] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.586s	user 0.005s	sys 0.006s
I20260709 13:14:50.449081 30879 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:14:50.433058 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 272799us
I20260709 13:14:50.200767   406 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.324s
I20260709 13:14:50.457862 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:50.733933 31024 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.529834 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:50.735203 31032 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:50.545042 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:50.460244 30883 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:50.439368 30780 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:50.531742 30955 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:50.433568 30880 rpcz_store.cc:276] 0709 13:14:48.917703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:48.917824 (+   121us) service_pool.cc:224] Handling call
0709 13:14:48.918169 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.428204 (+510035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.428233 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:49.452342 (+ 24109us) log.cc:844] Serialized 26 byte log entry
0709 13:14:49.623802 (+171460us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:49.623847 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.215380 (+591533us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b5400124dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:50.215444 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:50.215507 (+    63us) raft_consensus.cc:1685] finished
0709 13:14:50.215527 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:50.215895 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12041,"raft.queue_time_us":12591,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8155,"spinlock_wait_cycles":1144382336,"thread_start_us":161651,"threads_started":1,"wal-append.queue_time_us":164336}
I20260709 13:14:50.485642 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:50.325313   446 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:14:50.751660 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:50.207849   374 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:50.755565 30780 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to <none>, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:50.757575 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.763936 30879 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:50.758392 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.762166 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:50.204807   444 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:14:50.765390 30880 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:14:50.688433 32697 consensus_meta.cc:287] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.001s
I20260709 13:14:50.308987 32690 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:50.460002   376 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.003s
I20260709 13:14:50.437848   388 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:50.679102 32749 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.797s	user 0.005s	sys 0.005s
W20260709 13:14:50.687336   373 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.000s
I20260709 13:14:50.767604 30780 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:50.545578   391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.011s
I20260709 13:14:50.350677 32753 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:50.530411 32759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.007s	sys 0.015s
I20260709 13:14:50.235929 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.351665 32653 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:50.772966 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.460253 32662 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:50.309373 32757 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:50.325665 32709 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:50.437515 32721 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:50.779923 31024 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:50.461263 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:50.689527   405 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:50.685390   457 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:50.548030 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:50.632210   440 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:50.457214   396 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:50.763398   423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.011s
I20260709 13:14:50.459054 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:50.781243 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:50.759637   315 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.759812   305 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:50.523663 30950 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:50.770116   408 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:14:50.783092 32706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.001s	sys 0.024s
I20260709 13:14:50.788643   373 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.788946 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:50.789791 32749 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:50.790001 30780 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:14:50.793313 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.012s	sys 0.017s
W20260709 13:14:50.892393 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.012s	sys 0.017s
W20260709 13:14:50.877357   423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.011s
I20260709 13:14:50.471877   401 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:50.791615   391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.009s	sys 0.021s
W20260709 13:14:50.804944 31030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.011s	sys 0.019s
I20260709 13:14:50.491591   327 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.798604 30880 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:50.809078 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:50.761075   341 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:50.795436 32759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.011s	sys 0.018s
I20260709 13:14:50.792372 32694 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.784035   421 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:50.852227 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:50.798748 32692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.017s	sys 0.009s
I20260709 13:14:50.780831 32697 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.856604 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:50.843859 32653 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:50.785797   376 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:50.847802 32721 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:50.842994 32662 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:50.783370 32690 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:50.884682 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 133005us
I20260709 13:14:50.848242 32757 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:14:50.887778 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 402195us
W20260709 13:14:50.875815   343 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.000s
I20260709 13:14:50.893218 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:50.766345   410 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:50.902989 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 137925us
I20260709 13:14:50.858494   453 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:50.826730   383 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.847496 32709 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:50.862186   405 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.904332 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:51.258894 31030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.014s	sys 0.025s
I20260709 13:14:51.260143 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 441) took 1017 ms. Trace:
I20260709 13:14:51.260511 31024 raft_consensus.cc:2376] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4. Re-sending same reply.
I20260709 13:14:51.261045 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2168) took 1082 ms. Trace:
W20260709 13:14:51.260206 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 367076us
I20260709 13:14:51.261489 31024 rpcz_store.cc:276] 0709 13:14:50.178417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.851888 (+673471us) service_pool.cc:224] Handling call
0709 13:14:51.260991 (+409103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.262862 31031 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
W20260709 13:14:51.267057 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:51.258846 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 448) took 1013 ms. Trace:
I20260709 13:14:50.953322 30954 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:50.905207 30780 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 5, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:51.260747 30880 rpcz_store.cc:276] 0709 13:14:50.243083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.761900 (+518817us) service_pool.cc:224] Handling call
0709 13:14:51.260079 (+498179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.269286 30879 rpcz_store.cc:276] 0709 13:14:50.245031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.808006 (+562975us) service_pool.cc:224] Handling call
0709 13:14:51.258768 (+450762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:51.332844 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:50.887228 32706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.024s
I20260709 13:14:50.901818 31597 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4.
I20260709 13:14:51.360884 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:51.361042 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 70551.8us
I20260709 13:14:50.874274   457 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:50.881076   396 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.884872   305 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.361310 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:51.361579 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:50.940466 31598 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:51.439322 30883 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:50.885289   315 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:50.885062   440 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.405685 30951 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:14:51.232081   461 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 13:14:51.259361 32692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.017s	sys 0.019s
I20260709 13:14:51.504021 31026 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:51.398102 31029 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
W20260709 13:14:51.446502 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 175139us
W20260709 13:14:51.561484 30849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.004s	sys 0.024s
W20260709 13:14:51.581415 30849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.005s	sys 0.025s
I20260709 13:14:51.204787   467 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:51.453606 31602 raft_consensus.cc:2368] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4.
I20260709 13:14:50.932567   466 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.329789   422 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:51.198722 32753 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.291600 32653 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.588976 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:51.587347 30880 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:51.289002   406 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.537544   470 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:51.260283   391 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:51.571029   457 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:51.298570   343 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:51.339571 32757 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.361786 32694 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.387210   410 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:51.329030   453 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.560889 30875 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:51.746579 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:51.669727 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:52.176750 30952 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:14:52.176877 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 430366us
W20260709 13:14:51.738788 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 470889us
I20260709 13:14:51.854288   421 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:52.116091   470 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.118772 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1435) took 1365 ms. Trace:
I20260709 13:14:52.216401 30880 rpcz_store.cc:276] 0709 13:14:50.753594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.332587 (+578993us) service_pool.cc:224] Handling call
0709 13:14:52.118689 (+786102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.119834 32697 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:51.630762 32706 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:52.120491   457 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:51.670527 32653 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.121560 30957 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:52.122462   410 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:52.122658   343 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:51.635648 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 591) took 1377 ms. Trace:
I20260709 13:14:52.123927 30881 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:51.646732   448 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:51.645125 32692 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:14:52.204339 30995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.017s	sys 0.037s
I20260709 13:14:52.180526 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:52.211021 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2177) took 1415 ms. Trace:
I20260709 13:14:52.212797 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:51.798777 30922 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 2.241s (SENT) [suppressed 47 similar messages]
I20260709 13:14:52.227626 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:14:52.230202 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.002s	sys 0.034s
I20260709 13:14:51.648505   422 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:52.174127 32759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.004s	sys 0.004s
I20260709 13:14:51.723860 32749 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:51.635974 31598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 592) took 1407 ms (client timeout 1712 ms). Trace:
I20260709 13:14:51.804939   305 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:51.694991 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:52.254827 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:51.647657   466 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.629033   467 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.694525 30950 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:51.747321   468 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.110076   341 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:52.178725   383 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:51.776154   479 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:51.695811 32753 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.222569   421 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:51.695674 32662 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.125339   406 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:52.303220   376 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:52.223621   308 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:52.893843   396 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:52.311620 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1650) took 2428 ms (client timeout 2124 ms). Trace:
W20260709 13:14:52.311988 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 131562us
I20260709 13:14:52.902256 32753 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.214455   480 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:52.902825 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:52.866530 32757 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.903491   480 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.850407   488 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.904567   421 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.905019   488 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.387956 32692 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.907051   406 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:52.880007   477 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:52.234362 32706 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.907984   477 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:52.908679   477 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.909013 32692 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:52.624682   459 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.035s	user 0.000s	sys 0.001s
I20260709 13:14:52.316075   315 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:52.909801 32706 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.910398   315 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:52.216414   405 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.910912   315 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:52.911295   405 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.593549   475 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:52.911708   315 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:52.483858 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 203849us
W20260709 13:14:52.912592 30923 connection.cc:256] RPC call timeout handler was delayed by -1.0553320900000926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2504s for a response
I20260709 13:14:52.912274   475 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:52.913430 30923 connection.cc:256] RPC call timeout handler was delayed by -1.0181916270000784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 13:14:52.311677 32697 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.913789   396 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:52.347523   448 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.914669   475 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:52.695993   440 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.915714 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1320) took 1253 ms. Trace:
I20260709 13:14:52.615940   391 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.916435 30950 rpcz_store.cc:276] 0709 13:14:51.662053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.670685 (+  8632us) service_pool.cc:224] Handling call
0709 13:14:51.694039 (+ 23354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:52.915405 (+1221366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:52.915649 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.917201   448 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:52.451472 32695 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.959s	user 0.011s	sys 0.002s
I20260709 13:14:52.918179 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:52.901049 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 1.10222e+06us
I20260709 13:14:52.303397   327 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:52.636130 32690 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:52.312222 30996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.000s	sys 0.060s
I20260709 13:14:52.920008   422 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:52.920161 30996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.002s	sys 0.104s
I20260709 13:14:52.625099   482 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:52.918263 32695 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:52.581946 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.004s	sys 0.015s
W20260709 13:14:52.311136 30995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.017s	sys 0.037s
W20260709 13:14:52.929507 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.017s	sys 0.045s
W20260709 13:14:52.939975 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 1.35265e+06us
W20260709 13:14:52.902287 31023 rpcz_store.cc:269] 0709 13:14:49.866186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.867093 (+   907us) service_pool.cc:224] Handling call
0709 13:14:52.293934 (+2426841us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003782d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:52.294098 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380710656}
I20260709 13:14:52.941741 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:52.913864 30923 connection.cc:256] RPC call timeout handler was delayed by -1.0095585080000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:14:52.945482 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1330) took 1260 ms (client timeout 1520 ms). Trace:
W20260709 13:14:52.692894 32721 consensus_meta.cc:287] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.331s	user 0.010s	sys 0.002s
W20260709 13:14:52.922238 30996 connection.cc:256] RPC call timeout handler was delayed by -1.0185577240001749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:14:52.940104   470 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.904624 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:52.356271   465 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.088s	user 0.002s	sys 0.002s
I20260709 13:14:52.300060   373 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:52.904348 32757 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:14:52.996997 30846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.298s	user 0.039s	sys 0.076s
W20260709 13:14:52.997658 30846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.039s	sys 0.076s
I20260709 13:14:52.640807   464 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.941141 32706 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:52.937177   448 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:14:53.001813 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.047s	sys 0.099s
W20260709 13:14:53.002123 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.047s	sys 0.099s
W20260709 13:14:52.630052   463 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.981s	user 0.001s	sys 0.000s
W20260709 13:14:52.891400   388 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 2.098s	user 0.010s	sys 0.000s
W20260709 13:14:52.946173 30952 rpcz_store.cc:269] 0709 13:14:51.684929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.212459 (+527530us) service_pool.cc:224] Handling call
0709 13:14:52.945409 (+732950us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:52.937027 32759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.007s	sys 0.007s
W20260709 13:14:52.640395   454 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.969s	user 0.001s	sys 0.000s
I20260709 13:14:52.929047 31031 rpcz_store.cc:276] 0709 13:14:50.694425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.588331 (+893906us) service_pool.cc:224] Handling call
0709 13:14:52.109435 (+521104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.914602 32697 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.015033 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:52.620129 32709 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:52.954964 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.018734 30953 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
W20260709 13:14:53.019236 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1325) took 1342 ms (client timeout 1664 ms). Trace:
I20260709 13:14:52.624946   471 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:52.947796 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.009s	sys 0.016s
I20260709 13:14:52.937031 32749 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.023655 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 82014.8us
I20260709 13:14:53.024154   467 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:53.004125 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2173) took 2427 ms (client timeout 2078 ms). Trace:
W20260709 13:14:53.024947 31023 rpcz_store.cc:269] 0709 13:14:50.596009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.003946 (+2407937us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.004066 (+   120us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.024628 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:52.962167   308 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:52.630367   474 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:52.593878   486 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:53.014649 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1644) took 3159 ms. Trace:
W20260709 13:14:52.937665   444 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 2.156s	user 0.014s	sys 0.000s
I20260709 13:14:53.016181 30952 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:53.004886 32653 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.702s	user 0.003s	sys 0.007s
W20260709 13:14:53.017714 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2184) took 2298 ms (client timeout 1938 ms). Trace:
W20260709 13:14:52.950419 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45873.6us
I20260709 13:14:53.038570 31027 rpcz_store.cc:276] 0709 13:14:49.847207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.847510 (+   303us) service_pool.cc:224] Handling call
0709 13:14:49.847740 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:50.020514 (+172774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.006203 (+2985689us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400147154. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:53.006411 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326688128}
W20260709 13:14:53.042933 31031 rpcz_store.cc:269] 0709 13:14:50.719234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.017525 (+2298291us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.017649 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.044095 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2180) took 2348 ms (client timeout 2003 ms). Trace:
W20260709 13:14:53.044468 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 294) took 2130 ms (client timeout 1805 ms). Trace:
W20260709 13:14:53.044649 31027 rpcz_store.cc:269] 0709 13:14:50.695292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.043857 (+2348565us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.044007 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.045023 31031 rpcz_store.cc:269] 0709 13:14:50.913699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.044271 (+2130572us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.044399 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:52.998973 30950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1331) took 1310 ms (client timeout 1606 ms). Trace:
I20260709 13:14:53.001494   470 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.019608 30953 rpcz_store.cc:269] 0709 13:14:51.676378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.954647 (+1278269us) service_pool.cc:224] Handling call
0709 13:14:53.019174 (+ 64527us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.000463   408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.465s	user 0.055s	sys 0.121s
I20260709 13:14:52.627978   478 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:14:53.046197 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2175) took 2352 ms (client timeout 2110 ms). Trace:
W20260709 13:14:53.049458 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2170) took 2766 ms (client timeout 2504 ms). Trace:
W20260709 13:14:53.049891 31031 rpcz_store.cc:269] 0709 13:14:50.693758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.046016 (+2352258us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.046137 (+   121us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.032536 30848 connection.cc:256] RPC call timeout handler was delayed by -1.6531909759999053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:14:53.050105 31027 rpcz_store.cc:269] 0709 13:14:50.283514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.049284 (+2765770us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.049396 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.024084 32749 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.041546 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2176) took 2331 ms (client timeout 1995 ms). Trace:
I20260709 13:14:52.943246   405 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.951732   341 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.006755   480 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.029176   467 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:53.003708 32753 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:52.976094 32721 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.000114 32757 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.022149   440 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.021450   464 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:53.006451 32706 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.942713   479 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.040547 32694 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.016189   448 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.945894   468 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.015797   388 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:52.942773   482 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.070565 31023 rpcz_store.cc:269] 0709 13:14:50.694084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.025663 (+2331579us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.025784 (+   121us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.071043 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1652) took 1801 ms (client timeout 1573 ms). Trace:
I20260709 13:14:53.081735 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.153028 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 434) took 2933 ms. Trace:
W20260709 13:14:53.157137 31031 rpcz_store.cc:269] 0709 13:14:51.269145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.070801 (+1801656us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.070960 (+   159us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.157861 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1328) took 1473 ms (client timeout 1706 ms). Trace:
W20260709 13:14:53.158528 30953 rpcz_store.cc:269] 0709 13:14:51.684359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.048072 (+1363713us) service_pool.cc:224] Handling call
0709 13:14:53.157803 (+109731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:52.298543 31597 rpcz_store.cc:276] 0709 13:14:50.221794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.521243 (+299449us) service_pool.cc:224] Handling call
0709 13:14:51.598792 (+1077549us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.149734 30923 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.892s (SENT)
I20260709 13:14:53.169344 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:53.062744 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2796909759999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:14:53.071734 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2185) took 2352 ms (client timeout 2138 ms). Trace:
W20260709 13:14:52.928696 31598 rpcz_store.cc:269] 0709 13:14:50.222099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.458763 (+236664us) service_pool.cc:224] Handling call
0709 13:14:51.629013 (+1170250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.051833 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0645273089999137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3286s for a response
I20260709 13:14:53.157653 30874 rpcz_store.cc:276] 0709 13:14:50.219509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.219675 (+   166us) service_pool.cc:224] Handling call
0709 13:14:53.152100 (+2932425us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:14:53.152349 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.152581 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.152616 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.152672 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:53.152720 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.152791 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.152918 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37122304}
W20260709 13:14:53.171156 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2796909759999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:14:53.171895 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0546909759998471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23740000000000003s for a response
I20260709 13:14:53.172492 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 658) took 2408 ms. Trace:
W20260709 13:14:53.169422 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2182) took 2451 ms (client timeout 2176 ms). Trace:
W20260709 13:14:53.048979   408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.542s	user 0.055s	sys 0.121s
I20260709 13:14:53.172612 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 442) took 2929 ms. Trace:
I20260709 13:14:53.173676   480 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:53.174018 30874 rpcz_store.cc:276] 0709 13:14:50.243355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.171873 (+2928518us) service_pool.cc:224] Handling call
0709 13:14:53.172136 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.172303 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.172331 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.172373 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.172405 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.172459 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.172559 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.173319 31031 rpcz_store.cc:269] 0709 13:14:50.718617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.169248 (+2450631us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.169364 (+   116us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.174561   315 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.175612 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1654) took 1780 ms (client timeout 1563 ms). Trace:
I20260709 13:14:53.175895 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 443) took 2932 ms. Trace:
I20260709 13:14:53.042943   481 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.176131 31031 rpcz_store.cc:269] 0709 13:14:51.395652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.175409 (+1779757us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.175541 (+   132us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.176409 30874 rpcz_store.cc:276] 0709 13:14:50.243624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.175104 (+2931480us) service_pool.cc:224] Handling call
0709 13:14:53.175370 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.175536 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.175561 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.175598 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.175643 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.175693 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.175828 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.176957   481 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
W20260709 13:14:53.177488 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1653) took 1843 ms (client timeout 1632 ms). Trace:
I20260709 13:14:53.178166 30880 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:53.178122 31031 rpcz_store.cc:269] 0709 13:14:51.333798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.177285 (+1843487us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.177424 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.026630   475 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:53.171175 31027 rpcz_store.cc:269] 0709 13:14:50.719496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.071510 (+2352014us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.071659 (+   149us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.180356 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 290) took 3172 ms (client timeout 2999 ms). Trace:
W20260709 13:14:53.180634 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 293) took 2267 ms (client timeout 2179 ms). Trace:
W20260709 13:14:53.181816 31027 rpcz_store.cc:269] 0709 13:14:50.913379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.180479 (+2267100us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.180578 (+    99us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.182612 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2181) took 2487 ms (client timeout 2443 ms). Trace:
W20260709 13:14:53.183490 31027 rpcz_store.cc:269] 0709 13:14:50.695611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.182470 (+2486859us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.182562 (+    92us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.184293 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2187) took 1911 ms (client timeout 1892 ms). Trace:
W20260709 13:14:53.184645 31027 rpcz_store.cc:269] 0709 13:14:51.273316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.184155 (+1910839us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.184246 (+    91us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.047941   444 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6.
I20260709 13:14:53.178579 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 445) took 2934 ms. Trace:
I20260709 13:14:53.186688 31032 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:14:53.186909 30874 rpcz_store.cc:276] 0709 13:14:50.244198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.177814 (+2933616us) service_pool.cc:224] Handling call
0709 13:14:53.178129 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.178295 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.178318 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.178352 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.178387 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.178438 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.178530 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.188704 31570 connection.cc:256] RPC call timeout handler was delayed by -1.7800749289999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2389s for a response
W20260709 13:14:53.189294 31570 connection.cc:256] RPC call timeout handler was delayed by -1.6195012509999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:14:53.189747 31570 connection.cc:256] RPC call timeout handler was delayed by -1.4523731729998417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:14:53.189908 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 446) took 2945 ms. Trace:
I20260709 13:14:53.181221   475 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:14:53.180958 31031 rpcz_store.cc:269] 0709 13:14:50.007702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.180150 (+3172448us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.180289 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:53.149958   491 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:53.049515 32653 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.190160 31570 connection.cc:256] RPC call timeout handler was delayed by -1.4523731729998417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:14:53.201757 31570 connection.cc:256] RPC call timeout handler was delayed by -1.3981012509998436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
I20260709 13:14:53.201871 30880 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:14:53.202165 31570 connection.cc:256] RPC call timeout handler was delayed by -1.1846795819999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:14:53.202541 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0745857750000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:14:53.188220   494 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.190884   467 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:53.191301   396 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:53.192024   305 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:53.192538   308 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.194432 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.148317   466 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:53.133122   423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.498s	user 0.030s	sys 0.025s
W20260709 13:14:53.194912 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2164) took 3077 ms (client timeout 2776 ms). Trace:
W20260709 13:14:53.216861 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1327) took 1540 ms (client timeout 1794 ms). Trace:
W20260709 13:14:53.217008 31023 rpcz_store.cc:269] 0709 13:14:50.117704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.194749 (+3077045us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.194855 (+   106us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.217299 30953 rpcz_store.cc:269] 0709 13:14:51.683986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.164748 (+1480762us) service_pool.cc:224] Handling call
0709 13:14:53.216800 (+ 52052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.198035 30952 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:53.199112 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:53.200330 30997 connection.cc:256] RPC call timeout handler was delayed by -1.0226229630000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:14:53.218843 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1335) took 1532 ms (client timeout 1664 ms). Trace:
W20260709 13:14:53.185444 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2190) took 1900 ms (client timeout 1888 ms). Trace:
I20260709 13:14:53.151341 32707 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:53.149825 32695 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:53.207512   447 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:53.074923 32759 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:14:53.223630 31027 rpcz_store.cc:269] 0709 13:14:51.284659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.185291 (+1900632us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:53.185392 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:53.224251 31571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.597s	user 0.010s	sys 0.023s
I20260709 13:14:53.202459   426 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.225268 31571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.010s	sys 0.023s
I20260709 13:14:53.204840 30874 rpcz_store.cc:276] 0709 13:14:50.244462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.188650 (+2944188us) service_pool.cc:224] Handling call
0709 13:14:53.188961 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.189417 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.189455 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.189508 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.189559 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.189630 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.189841 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.069449   488 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:53.047312 30950 rpcz_store.cc:269] 0709 13:14:51.685214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.917787 (+1232573us) service_pool.cc:224] Handling call
0709 13:14:52.995822 (+ 78035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.173027 31598 rpcz_store.cc:276] 0709 13:14:50.764556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.171544 (+2406988us) service_pool.cc:224] Handling call
0709 13:14:53.171895 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.172082 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.172156 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.172197 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:53.172236 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.172306 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.172428 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.052301   470 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.221324 31031 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:14:53.219122 30997 connection.cc:256] RPC call timeout handler was delayed by -1.0073229629999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:14:53.230055 30952 rpcz_store.cc:269] 0709 13:14:51.686302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.014713 (+1328411us) service_pool.cc:224] Handling call
0709 13:14:53.218767 (+204054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.168846   341 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.231889 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:53.162592 32753 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.202957   393 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:53.225991 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:53.232484 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:53.216691   423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.031s	sys 0.027s
I20260709 13:14:53.233047 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:53.230697 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2179) took 2535 ms (client timeout 2579 ms). Trace:
W20260709 13:14:53.257293 31031 rpcz_store.cc:269] 0709 13:14:50.695019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.198816 (+2503797us) service_pool.cc:224] Handling call
0709 13:14:53.230642 (+ 31826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.258656 31027 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:53.225965 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:53.224253 30958 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4.
I20260709 13:14:53.219663 32690 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.238286 30952 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:53.200201   440 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.259155 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2174) took 2566 ms (client timeout 2686 ms). Trace:
W20260709 13:14:53.259797 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1329) took 1575 ms (client timeout 1927 ms). Trace:
I20260709 13:14:53.261555 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:53.263198 31027 rpcz_store.cc:269] 0709 13:14:50.693303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.225652 (+2532349us) service_pool.cc:224] Handling call
0709 13:14:53.259100 (+ 33448us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.263322 30953 rpcz_store.cc:269] 0709 13:14:51.684658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.218301 (+1533643us) service_pool.cc:224] Handling call
0709 13:14:53.259709 (+ 41408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.216810   305 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.263862 31031 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:53.223863   466 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.265301 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2189) took 1984 ms (client timeout 2211 ms). Trace:
W20260709 13:14:53.266839 31031 rpcz_store.cc:269] 0709 13:14:51.281392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.261221 (+1979829us) service_pool.cc:224] Handling call
0709 13:14:53.265240 (+  4019us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.268765 31571 connection.cc:256] RPC call timeout handler was delayed by -1.668081562999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:14:53.276815 31603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.007s	sys 0.030s
W20260709 13:14:53.287915 31571 connection.cc:256] RPC call timeout handler was delayed by -1.3915061029999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:14:53.071223   486 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.279979 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:53.288416 31603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.008s	sys 0.030s
I20260709 13:14:53.290072 31027 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:53.211551   467 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.290723 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2191) took 1746 ms. Trace:
I20260709 13:14:53.269163 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:53.291306 31027 rpcz_store.cc:276] 0709 13:14:51.544872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.266779 (+1721907us) service_pool.cc:224] Handling call
0709 13:14:53.290650 (+ 23871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.291926 31031 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:53.292595 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2186) took 2023 ms. Trace:
I20260709 13:14:53.292972 31031 rpcz_store.cc:276] 0709 13:14:51.269613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.267587 (+1997974us) service_pool.cc:224] Handling call
0709 13:14:53.292528 (+ 24941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.287249 31023 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:53.207540   475 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.214371   396 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.220634   308 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.307225 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:53.264060 32697 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.313741 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.314540 30953 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:14:53.314913 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1326) took 1638 ms. Trace:
I20260709 13:14:53.058967   474 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.315239 30953 rpcz_store.cc:276] 0709 13:14:51.676663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.264904 (+1588241us) service_pool.cc:224] Handling call
0709 13:14:53.314853 (+ 49949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.234834 32759 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.233536   426 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.290283   408 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:53.289898 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.263172   393 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.306727 31597 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:14:53.091866   478 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.074352   471 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.352435 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 149183us
W20260709 13:14:53.353022 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:53.354218 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.368355 30953 raft_consensus.cc:2410] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:14:53.266111 32690 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.360239 30952 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:14:53.317896   379 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.519s	user 0.002s	sys 0.027s
W20260709 13:14:53.368988 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 229740us
I20260709 13:14:53.370625   300 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.371061 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:53.351945 32697 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.371755   474 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.286801   466 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:53.373799 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1324) took 1697 ms (client timeout 2084 ms). Trace:
W20260709 13:14:53.375348 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1334) took 1689 ms (client timeout 2223 ms). Trace:
I20260709 13:14:53.214610   491 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.377398 30849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.621s	user 0.004s	sys 0.031s
I20260709 13:14:53.220702   494 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.259302   447 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.366775   408 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:14:53.378157   379 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.603s	user 0.003s	sys 0.027s
I20260709 13:14:53.377686 32749 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.365955 30950 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:53.374132   327 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.409288 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1432) took 2974 ms. Trace:
W20260709 13:14:53.409974 30953 rpcz_store.cc:269] 0709 13:14:51.686036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.318303 (+1632267us) service_pool.cc:224] Handling call
0709 13:14:53.375283 (+ 56980us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.428296 30849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.672s	user 0.006s	sys 0.040s
W20260709 13:14:53.409864 30952 rpcz_store.cc:269] 0709 13:14:51.676074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.231643 (+1555569us) service_pool.cc:224] Handling call
0709 13:14:53.373741 (+142098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.409807   405 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.402590 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:53.484894 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1338) took 1740 ms. Trace:
I20260709 13:14:53.404616   481 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:53.407150   472 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.012s	sys 0.042s
I20260709 13:14:53.411144   468 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.429530 32757 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.265273   464 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.385406   489 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:53.401957   448 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.404276   488 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:53.429152   474 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:14:53.378659 32695 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:53.475239 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 74279.5us
I20260709 13:14:53.480077   494 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.480159 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.481288 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 596) took 3156 ms. Trace:
I20260709 13:14:53.482295   440 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.475751   315 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:53.482596 30876 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2022) took 3705 ms (client timeout 3338 ms). Trace:
I20260709 13:14:53.401469 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 659) took 2636 ms. Trace:
I20260709 13:14:53.485246 30956 rpcz_store.cc:276] 0709 13:14:51.744928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.402309 (+1657381us) service_pool.cc:224] Handling call
0709 13:14:53.484833 (+ 82524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.488059 30952 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:14:53.490037   388 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.442648 32653 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:53.443734 32706 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.485833 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1332) took 1800 ms. Trace:
I20260709 13:14:53.402426   300 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.402490 32697 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:53.483064 30950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1333) took 1797 ms (client timeout 2122 ms). Trace:
W20260709 13:14:53.483909   422 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:14:53.606349   422 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.609157 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:53.608913 30953 rpcz_store.cc:276] 0709 13:14:51.685490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.484994 (+1799504us) service_pool.cc:224] Handling call
0709 13:14:53.485319 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.485484 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.485525 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.485565 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.485594 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.485646 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.485756 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.486140 30874 rpcz_store.cc:276] 0709 13:14:50.433653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.230465 (+2796812us) service_pool.cc:224] Handling call
0709 13:14:53.230743 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.235963 (+  5220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:53.350754 (+114791us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.408012 (+ 57258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.408083 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:53.408141 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.408230 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.408380 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196102,"prepare.run_cpu_time_us":933,"prepare.run_wall_time_us":14252,"raft.queue_time_us":72046,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":144014,"threads_started":2}
I20260709 13:14:53.427083   492 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:53.507455 30880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2036) took 2227 ms (client timeout 2225 ms). Trace:
I20260709 13:14:53.472060   470 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:53.608875 30876 rpcz_store.cc:269] 0709 13:14:49.777225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.777346 (+   121us) service_pool.cc:224] Handling call
0709 13:14:53.482337 (+3704991us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54001266d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:53.482493 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419346432}
I20260709 13:14:53.607962 31604 rpcz_store.cc:276] 0709 13:14:50.325394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.752921 (+427527us) service_pool.cc:224] Handling call
0709 13:14:50.753291 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.628754 (+875463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.628794 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:51.628835 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.628868 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.481064 (+1852196us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b540014f0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:53.481109 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.481231 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012911488}
W20260709 13:14:53.612875 30880 rpcz_store.cc:269] 0709 13:14:51.265543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:52.227286 (+961743us) service_pool.cc:224] Handling call
0709 13:14:53.493001 (+1265715us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54003412d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:53.493127 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628371712}
I20260709 13:14:53.404513 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 657) took 2640 ms. Trace:
I20260709 13:14:53.624696 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1337) took 1937 ms. Trace:
I20260709 13:14:53.614960 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1336) took 1928 ms. Trace:
W20260709 13:14:53.616190 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 210653us
I20260709 13:14:53.634413 30953 rpcz_store.cc:276] 0709 13:14:51.744471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.623906 (+1879435us) service_pool.cc:224] Handling call
0709 13:14:53.624199 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.624377 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.624401 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.624444 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:53.624488 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.624540 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.624641 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.616096 32695 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.534818   341 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:53.605211   471 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.634646 30952 rpcz_store.cc:276] 0709 13:14:51.686576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.487471 (+1800895us) service_pool.cc:224] Handling call
0709 13:14:53.487745 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.613952 (+126207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.614748 (+   796us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.510200   408 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.621810 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.625200 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.648818 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.650092 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.651264 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:53.626477 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1434) took 2892 ms. Trace:
I20260709 13:14:53.629685   479 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.630518 30880 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:53.652518 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1433) took 3176 ms. Trace:
I20260709 13:14:53.652936 30880 rpcz_store.cc:276] 0709 13:14:50.476157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.629426 (+3153269us) service_pool.cc:224] Handling call
0709 13:14:53.629695 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.652179 (+ 22484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.652455 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146624}
I20260709 13:14:53.631876   300 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.631978 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 435) took 3412 ms. Trace:
W20260709 13:14:53.609273 30950 rpcz_store.cc:269] 0709 13:14:51.685770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.257818 (+1572048us) service_pool.cc:224] Handling call
0709 13:14:53.482997 (+225179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.632905 31602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 643) took 3701 ms (client timeout 2241 ms). Trace:
I20260709 13:14:53.654327 30878 rpcz_store.cc:276] 0709 13:14:50.236460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.236776 (+   316us) service_pool.cc:224] Handling call
0709 13:14:53.631134 (+3394358us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:14:53.631327 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.631516 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.631556 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.631631 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.631687 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.631801 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.631924 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3974016}
W20260709 13:14:53.633530 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1649) took 3773 ms (client timeout 1556 ms). Trace:
I20260709 13:14:53.637017 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:53.605540   501 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:14:53.525712   472 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.013s	sys 0.049s
W20260709 13:14:53.533527   499 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:14:53.536042   457 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.239s	user 0.011s	sys 0.002s
I20260709 13:14:53.655431 30876 rpcz_store.cc:276] 0709 13:14:50.734499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.625710 (+2891211us) service_pool.cc:224] Handling call
0709 13:14:53.625927 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.626092 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.626125 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.626172 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:53.626215 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.626279 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.626399 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.525630   467 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.501987 32721 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.600376   305 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.612778   492 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:53.599439   308 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:14:53.657807 31025 rpcz_store.cc:269] 0709 13:14:49.860602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.860772 (+   170us) service_pool.cc:224] Handling call
0709 13:14:53.633356 (+3772584us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54002d4e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:53.633462 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730267904}
W20260709 13:14:53.657219 31602 rpcz_store.cc:269] 0709 13:14:49.931467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.931613 (+   146us) service_pool.cc:224] Handling call
0709 13:14:53.632670 (+3701057us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400459054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:53.632823 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3371634048}
I20260709 13:14:53.643008   475 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.613133 32759 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.663419 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1437) took 2027 ms. Trace:
I20260709 13:14:53.664742 31605 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:53.635535   396 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.488572   327 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:53.659471 31604 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:14:53.615347 31597 rpcz_store.cc:276] 0709 13:14:50.764781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.202758 (+2437977us) service_pool.cc:224] Handling call
0709 13:14:53.256762 (+ 54004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:53.367681 (+110919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.384568 (+ 16887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.623024   489 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.635143   488 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:53.707701 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 70803.1us
I20260709 13:14:53.706559 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:53.705890 30847 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.021s	sys 0.027s
W20260709 13:14:53.665563 31596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 650) took 3677 ms (client timeout 1996 ms). Trace:
W20260709 13:14:53.766286 30847 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.021s	sys 0.027s
I20260709 13:14:53.708303 30878 rpcz_store.cc:276] 0709 13:14:51.636380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.662498 (+2026118us) service_pool.cc:224] Handling call
0709 13:14:53.662780 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.662988 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.663025 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.663081 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:53.663135 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.663207 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.663334 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.759414 31025 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:14:53.707819 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 450) took 3250 ms. Trace:
I20260709 13:14:53.777429 30874 rpcz_store.cc:276] 0709 13:14:50.457615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.625435 (+3167820us) service_pool.cc:224] Handling call
0709 13:14:53.625708 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.625864 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.625886 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.625923 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.707598 (+ 81675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.707657 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.707749 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.779083 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1439) took 2051 ms. Trace:
W20260709 13:14:53.766671 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 738288us
W20260709 13:14:53.783305 30847 connection.cc:256] RPC call timeout handler was delayed by -1.0317793830001847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 13:14:53.779415 30874 rpcz_store.cc:276] 0709 13:14:51.727844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.778306 (+2050462us) service_pool.cc:224] Handling call
0709 13:14:53.778606 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.778795 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.778818 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.778859 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:53.778890 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.778938 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.779033 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:53.817405 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:53.826438 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 67148.4us
I20260709 13:14:53.845727 30878 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.684993   482 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.890431 31605 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:14:53.808588   477 consensus_meta.cc:287] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.899s	user 0.009s	sys 0.003s
I20260709 13:14:53.706614 32690 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.808873   487 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:53.693563   457 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.906190 31602 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:53.887912   486 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.888425   426 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.770232   393 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.938441 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 678) took 4125 ms. Trace:
I20260709 13:14:53.941392 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:53.948482 30878 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:53.949414 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1440) took 2194 ms. Trace:
I20260709 13:14:53.949824 30878 rpcz_store.cc:276] 0709 13:14:51.755401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.808500 (+2053099us) service_pool.cc:224] Handling call
0709 13:14:53.845557 (+ 37057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.949071 (+103514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.949338 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:53.900018   466 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.977423 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:53.957476 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:53.976150 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:53.988953 30882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 438) took 3750 ms (client timeout 2692 ms). Trace:
I20260709 13:14:53.989321 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.985848 30879 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:53.975914 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:53.936200   502 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:53.988272 30878 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:53.975225 31602 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:53.734663   509 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:53.943037 31603 rpcz_store.cc:276] 0709 13:14:49.813337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.813602 (+   265us) service_pool.cc:224] Handling call
0709 13:14:49.832720 (+ 19118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:49.836014 (+  3294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:49.836046 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:52.429229 (+2593183us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b2c00047358. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:14:52.449823 (+ 20594us) log.cc:844] Serialized 26 byte log entry
0709 13:14:53.290240 (+840417us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.290283 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.290359 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:53.938077 (+647718us) raft_consensus.cc:1685] finished
0709 13:14:53.938106 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.938367 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2925,"raft.queue_time_us":8336,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5914,"spinlock_wait_cycles":12913536,"thread_start_us":757952,"threads_started":1,"wal-append.queue_time_us":915015}
I20260709 13:14:53.905836   491 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.695472   492 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:53.808564 31596 rpcz_store.cc:269] 0709 13:14:49.988352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.000253 (+ 11901us) service_pool.cc:224] Handling call
0709 13:14:53.479991 (+3479738us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:14:53.660252 (+180261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20448640}
I20260709 13:14:53.941635   338 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:53.989403 30882 rpcz_store.cc:269] 0709 13:14:50.238797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.239350 (+   553us) service_pool.cc:224] Handling call
0709 13:14:53.975993 (+3736643us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:14:53.988889 (+ 12896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9305856}
I20260709 13:14:54.009246 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:54.017462 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:54.001694   503 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.033s	sys 0.065s
I20260709 13:14:54.023259   422 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:53.634328 31599 rpcz_store.cc:276] 0709 13:14:50.764288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.943835 (+179547us) service_pool.cc:224] Handling call
0709 13:14:51.226791 (+282956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:51.693814 (+467023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:51.702945 (+  9131us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:52.117989 (+415044us) log.cc:844] Serialized 26 byte log entry
0709 13:14:52.490731 (+372742us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:53.382133 (+891402us) log.cc:844] Serialized 14 byte log entry
0709 13:14:53.404133 (+ 22000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:53.404226 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:53.404267 (+    41us) raft_consensus.cc:1685] finished
0709 13:14:53.404283 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:53.404416 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11202,"prepare.queue_time_us":1078834,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":1424184,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":152660,"thread_start_us":898030,"threads_started":3,"wal-append.queue_time_us":1073063}
I20260709 13:14:54.025198   457 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.025348 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.017133   466 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:54.027055   466 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:53.976928   489 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.020368 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.903185   477 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:54.023362   503 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.034s	sys 0.066s
I20260709 13:14:54.028717 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.031708 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.033337 31605 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:54.033977 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.034582 31602 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:54.023577 32695 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:54.036073   401 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.040125 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:53.951094   447 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:53.936995   487 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:54.049185 32753 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:54.049788   487 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.018265 31025 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:54.051007 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:54.051524 31025 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.054306 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:54.057190 30957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1693) took 4164 ms (client timeout 1709 ms). Trace:
I20260709 13:14:54.057643 32697 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:54.060401 30956 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:54.062446 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1339) took 2317 ms. Trace:
I20260709 13:14:54.062774 30956 rpcz_store.cc:276] 0709 13:14:51.745188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.622530 (+1877342us) service_pool.cc:224] Handling call
0709 13:14:54.060191 (+437661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.060861 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.062266 (+  1405us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54001955d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.062387 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004482816}
I20260709 13:14:54.027930 32761 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:14:54.064054 30883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 447) took 3819 ms (client timeout 1621 ms). Trace:
W20260709 13:14:54.064545 30883 rpcz_store.cc:269] 0709 13:14:50.244750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.758114 (+513364us) service_pool.cc:224] Handling call
0709 13:14:54.063865 (+3305751us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400436554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.063985 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495073024}
I20260709 13:14:54.064419 32761 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:54.068262 31597 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:54.030999 30878 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:54.073923 31025 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:54.074515 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2197) took 1027 ms. Trace:
I20260709 13:14:54.080125 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 277) took 4129 ms. Trace:
I20260709 13:14:54.141505 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.099790   376 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:54.647081   466 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.767944   376 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:54.768354 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.768700 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.769779 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.770123 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:54.057686 30957 rpcz_store.cc:269] 0709 13:14:49.892914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.893041 (+   127us) service_pool.cc:224] Handling call
0709 13:14:54.056917 (+4163876us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54001955d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.057084 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5122725760}
I20260709 13:14:54.140421 31604 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:14:54.242158 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:54.772173 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 661) took 1483 ms. Trace:
I20260709 13:14:54.772624 31604 rpcz_store.cc:276] 0709 13:14:53.288984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.651019 (+362035us) service_pool.cc:224] Handling call
0709 13:14:54.772105 (+1121086us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:54.456357 31570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.010s	sys 0.006s
W20260709 13:14:54.773957 31570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.018s	sys 0.011s
W20260709 13:14:54.774313 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 946514us
I20260709 13:14:54.771317 31025 rpcz_store.cc:276] 0709 13:14:53.047042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.050771 (+1003729us) service_pool.cc:224] Handling call
0709 13:14:54.074458 (+ 23687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.775575 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:54.778016 31025 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:14:54.784144 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2192) took 1779 ms (client timeout 1916 ms). Trace:
W20260709 13:14:54.786111 31025 rpcz_store.cc:269] 0709 13:14:53.004313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.775362 (+1771049us) service_pool.cc:224] Handling call
0709 13:14:54.784074 (+  8712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.770478 31603 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:54.027866   509 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:54.793958 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:54.795168 30955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1698) took 4892 ms (client timeout 2374 ms). Trace:
I20260709 13:14:54.796200 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.796527 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.797264 30953 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5.
I20260709 13:14:54.798331 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:54.798380 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.799000 30953 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.799384 30878 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.800235 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.800807 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.800799 30952 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:14:54.802211 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:54.802732 31025 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
W20260709 13:14:54.754660   492 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.737s	user 0.000s	sys 0.009s
I20260709 13:14:54.801927 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:14:54.803355 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2199) took 1728 ms (client timeout 2045 ms). Trace:
W20260709 13:14:54.795755 30955 rpcz_store.cc:269] 0709 13:14:49.895193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.929271 (+ 34078us) service_pool.cc:224] Handling call
0709 13:14:54.787500 (+4858229us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540024ca54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.787626 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337120000}
I20260709 13:14:54.767127 31030 rpcz_store.cc:276] 0709 13:14:49.951012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.951213 (+   201us) service_pool.cc:224] Handling call
0709 13:14:49.951560 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:50.119819 (+168259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.119850 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:50.141266 (+ 21416us) log.cc:844] Serialized 26 byte log entry
0709 13:14:51.259684 (+1118418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:51.259725 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.032216 (+2772491us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54001f2554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:54.032294 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:54.032354 (+    60us) raft_consensus.cc:1685] finished
0709 13:14:54.032374 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.080026 (+ 47652us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84350,"raft.queue_time_us":84775,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6011,"spinlock_wait_cycles":192095488,"thread_start_us":1118004,"threads_started":1,"wal-append.queue_time_us":1051776,"wal-append.run_cpu_time_us":12762,"wal-append.run_wall_time_us":2902595}
I20260709 13:14:54.806077 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.806434 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:54.807015 31030 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:54.807889 31025 rpcz_store.cc:269] 0709 13:14:53.074692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.791837 (+1717145us) service_pool.cc:224] Handling call
0709 13:14:54.803298 (+ 11461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.809968 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.810576 31603 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:14:54.810637 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.168699 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 660) took 2903 ms. Trace:
I20260709 13:14:54.217021   327 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.812531 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:14:54.792450   460 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.007s	sys 0.005s
I20260709 13:14:54.847680 30953 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:54.853281 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.155737 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.017886   502 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:54.141855 32761 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.815018 30956 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:54.817085 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.661586   477 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.770473   376 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.848562 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.849419 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.851140 30878 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:54.816212 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:54.862231 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1662) took 1705 ms (client timeout 2119 ms). Trace:
I20260709 13:14:54.100147   379 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:54.851801 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.854423   509 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:54.857429 30998 connection.cc:256] RPC call timeout handler was delayed by -2.7189563230001568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:14:54.862857 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.864835 30878 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:54.862641 31025 rpcz_store.cc:269] 0709 13:14:53.156634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.815244 (+1658610us) service_pool.cc:224] Handling call
0709 13:14:54.862175 (+ 46931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.865859 31603 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:54.865931 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.864670 30997 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1656) took 3355 ms. Trace:
I20260709 13:14:54.866765 31604 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:14:54.866678 30998 connection.cc:256] RPC call timeout handler was delayed by -1.701352130000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2645s for a response
W20260709 13:14:54.853163   460 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.008s	sys 0.007s
I20260709 13:14:54.847234 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:54.866632 30997 rpcz_store.cc:276] 0709 13:14:51.509170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.864621 (+3355451us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:54.867676 30998 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:54.872026 30997 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36654 dropped due to backpressure: service queue is full with 50 items
I20260709 13:14:54.871579 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.872599 31025 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:54.873447 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1670) took 1163 ms. Trace:
I20260709 13:14:54.873687 31025 rpcz_store.cc:276] 0709 13:14:53.709685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.869872 (+1160187us) service_pool.cc:224] Handling call
0709 13:14:54.873402 (+  3530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.814002   492 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:54.863891   376 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:54.871567 32562 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:54.876935 32562 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:54.878394 32562 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.875926 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.878839 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1438) took 3205 ms. Trace:
I20260709 13:14:54.879197 31025 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:14:54.879894 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1661) took 1723 ms (client timeout 2165 ms). Trace:
I20260709 13:14:54.879191 30876 rpcz_store.cc:276] 0709 13:14:51.673316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.681781 (+2008465us) service_pool.cc:224] Handling call
0709 13:14:53.682146 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.808588 (+126442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.808620 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:53.808677 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:14:53.808706 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.878600 (+1069894us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540043c454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:54.878654 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.878787 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290332544}
I20260709 13:14:54.867690 32697 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:54.880453 31025 rpcz_store.cc:269] 0709 13:14:53.156373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.874177 (+1717804us) service_pool.cc:224] Handling call
0709 13:14:54.879837 (+  5660us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:54.883713 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1695) took 4989 ms (client timeout 2124 ms). Trace:
W20260709 13:14:54.885182 30954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1694) took 4992 ms (client timeout 1556 ms). Trace:
W20260709 13:14:54.885710 30954 rpcz_store.cc:269] 0709 13:14:49.893876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.894626 (+   750us) service_pool.cc:224] Handling call
0709 13:14:54.884942 (+4990316us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002b6e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.885095 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376089856}
I20260709 13:14:54.886823 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.891399 30883 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:14:54.891687 31601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 597) took 4195 ms (client timeout 2113 ms). Trace:
I20260709 13:14:54.892678 30876 raft_consensus.cc:2368] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3.
W20260709 13:14:54.884166 30951 rpcz_store.cc:269] 0709 13:14:49.894186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.920106 (+ 25920us) service_pool.cc:224] Handling call
0709 13:14:54.883512 (+4963406us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400112954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.883638 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3384330624}
I20260709 13:14:54.874550 30950 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:14:54.892092 31601 rpcz_store.cc:269] 0709 13:14:50.696469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.891509 (+4195040us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:54.891620 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:14:54.867794   379 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:54.896911 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.898581 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.900853 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:54.905351 30881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 439) took 4662 ms (client timeout 2194 ms). Trace:
I20260709 13:14:54.880916   376 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:54.910475 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.890391 32697 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:54.898902 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:54.905939 30881 rpcz_store.cc:269] 0709 13:14:50.242492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.904007 (+661515us) service_pool.cc:224] Handling call
0709 13:14:54.905127 (+4001120us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54000d43d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.905263 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988783488}
I20260709 13:14:54.913362 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:14:54.915131 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2194) took 1898 ms (client timeout 2225 ms). Trace:
W20260709 13:14:54.915536 31030 rpcz_store.cc:269] 0709 13:14:53.017045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.806224 (+1789179us) service_pool.cc:224] Handling call
0709 13:14:54.915070 (+108846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.917483 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.919127 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.922082 31570 leader_election.cc:400] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5.
I20260709 13:14:54.922405 30878 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:54.924276 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:54.926437 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.877329   451 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:14:54.872298 30997 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36654 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1666)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1665)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1671)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1668)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2211)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2212)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1664)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1667)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1660)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2205)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 298)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45416 (request call id 10)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2160)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2162)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2163)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2165)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2166)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2169)
Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36650 (request call id 84)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1657)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 295)
I20260709 13:14:54.928284 31570 leader_election.cc:403] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:54.928319 30881 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:54.931542 30954 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:14:54.927415 30882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.023s	sys 0.074s
I20260709 13:14:54.936736 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:54.945017 30882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.023s	sys 0.075s
I20260709 13:14:54.945226 30878 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:54.945580 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:54.932649 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:54.947371 32562 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:54.943938 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.930943 30876 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:54.948737 30881 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:54.950305 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.942065   477 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5.
I20260709 13:14:54.951462 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:54.928328   408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.035s	sys 0.073s
I20260709 13:14:54.954252 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.954831 30878 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:54.951546 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.956004 30876 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
W20260709 13:14:54.956053 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 287) took 4979 ms (client timeout 2389 ms). Trace:
I20260709 13:14:54.956278 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.957094 30878 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.958546 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.958803 32562 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:14:54.956642 31029 rpcz_store.cc:269] 0709 13:14:49.971345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.385828 (+414483us) service_pool.cc:224] Handling call
0709 13:14:54.950394 (+4564566us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54001bfb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.950489 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511393536}
I20260709 13:14:54.961354 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:54.962025 30881 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:54.964450 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.965423 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1666) took 1323 ms. Trace:
I20260709 13:14:54.965838 31029 rpcz_store.cc:276] 0709 13:14:53.642466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.964138 (+1321672us) service_pool.cc:224] Handling call
0709 13:14:54.965340 (+  1202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.966900 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:54.957386   408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.035s	sys 0.074s
I20260709 13:14:54.953533 32761 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:54.814333 31598 rpcz_store.cc:276] 0709 13:14:51.265437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.291053 (+2025616us) service_pool.cc:224] Handling call
0709 13:14:53.346016 (+ 54963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:53.367745 (+ 21729us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:53.800186 (+432441us) log.cc:844] Serialized 14 byte log entry
0709 13:14:54.144665 (+344479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:54.153386 (+  8721us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:54.156922 (+  3536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.157004 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:54.157115 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253273,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":30647,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":2050,"thread_start_us":503162,"threads_started":2}
I20260709 13:14:54.974849 30881 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:54.975080 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.976200 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1645) took 5120 ms. Trace:
I20260709 13:14:54.976528 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:54.977200 31029 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:54.977722 30882 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:54.969656 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.979074 30878 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:54.979698 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.976701 31026 rpcz_store.cc:276] 0709 13:14:49.850503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.850637 (+   134us) service_pool.cc:224] Handling call
0709 13:14:49.854823 (+  4186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:51.580579 (+1725756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.970297 (+3389718us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400346f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:54.970420 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3792257280}
I20260709 13:14:54.982903 30876 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:54.980754 30881 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:54.985810 30878 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:54.985862 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.986631 30876 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:54.986603 31026 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:54.988428 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1665) took 1346 ms. Trace:
I20260709 13:14:54.988647 31026 rpcz_store.cc:276] 0709 13:14:53.641728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.980717 (+1338989us) service_pool.cc:224] Handling call
0709 13:14:54.988382 (+  7665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:54.989329 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:54.989918 30882 raft_consensus.cc:2410] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:14:54.975962 32761 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:54.996068 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2172) took 4503 ms (client timeout 1596 ms). Trace:
I20260709 13:14:54.997412 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.999267 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1671) took 1239 ms. Trace:
I20260709 13:14:54.999625 31026 rpcz_store.cc:276] 0709 13:14:53.760160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:54.993194 (+1233034us) service_pool.cc:224] Handling call
0709 13:14:54.999212 (+  6018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.008687 31029 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:55.009361 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:54.995564 32761 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:55.009994 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:54.998687 31032 rpcz_store.cc:269] 0709 13:14:50.492819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.763576 (+270757us) service_pool.cc:224] Handling call
0709 13:14:54.995889 (+4232313us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54001f2a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:54.995996 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5319788288}
I20260709 13:14:55.011566 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.012385 31029 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:55.013163 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:54.998651   492 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:54.992110 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.016674 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.017488 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:55.023281 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.020184 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.000468   502 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:55.002815 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.042392 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.042827 31598 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
W20260709 13:14:55.043869   523 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:14:55.044333   525 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:14:55.045070 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.045828 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1664) took 1405 ms. Trace:
I20260709 13:14:55.046144 31027 rpcz_store.cc:276] 0709 13:14:53.640957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.044818 (+1403861us) service_pool.cc:224] Handling call
0709 13:14:55.045772 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.046624 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1436) took 3418 ms. Trace:
I20260709 13:14:55.047166 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.047115 30880 rpcz_store.cc:276] 0709 13:14:51.628754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.660658 (+2031904us) service_pool.cc:224] Handling call
0709 13:14:53.661021 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:53.735154 (+ 74133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.735187 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:53.735693 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:14:54.080700 (+345007us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:54.080741 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:54.080817 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.046362 (+965545us) raft_consensus.cc:1685] finished
0709 13:14:55.046389 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.046553 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73684,"raft.queue_time_us":86244,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":48602,"thread_start_us":185485,"threads_started":1,"wal-append.queue_time_us":1138355}
I20260709 13:14:55.008858   379 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:55.054380 31027 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.039848 32697 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:55.040127   526 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:14:55.042131 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.053407 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.053503 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.019536 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.064621 31601 raft_consensus.cc:2410] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:55.065001 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.021755 31596 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:55.061604 30847 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:55.031450   376 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.078447 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2213) took 1005 ms. Trace:
I20260709 13:14:55.083674 31027 rpcz_store.cc:276] 0709 13:14:54.073170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.055357 (+982187us) service_pool.cc:224] Handling call
0709 13:14:55.078371 (+ 23014us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:55.086467   473 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 3.250s	user 0.000s	sys 0.031s
I20260709 13:14:55.091638   488 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:14:55.088147   492 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:55.096148 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.097675 31032 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:14:55.098306 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2207) took 1026 ms. Trace:
I20260709 13:14:55.098685 31032 rpcz_store.cc:276] 0709 13:14:54.071650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.011255 (+939605us) service_pool.cc:224] Handling call
0709 13:14:55.098234 (+ 86979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.024091 31026 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:55.100143 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2033) took 4971 ms. Trace:
I20260709 13:14:55.100309 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1667) took 1442 ms. Trace:
I20260709 13:14:55.100834 31027 rpcz_store.cc:276] 0709 13:14:53.657914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.084635 (+1426721us) service_pool.cc:224] Handling call
0709 13:14:55.100236 (+ 15601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.099754 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.102887 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2214) took 1029 ms. Trace:
I20260709 13:14:55.103385 31032 rpcz_store.cc:276] 0709 13:14:54.073368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.099450 (+1026082us) service_pool.cc:224] Handling call
0709 13:14:55.102810 (+  3360us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:55.103891 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 211196us
I20260709 13:14:55.104555 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.100766 30877 rpcz_store.cc:276] 0709 13:14:50.117500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.117632 (+   132us) service_pool.cc:224] Handling call
0709 13:14:50.117912 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:50.549720 (+431808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:50.554920 (+  5200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:50.754620 (+199700us) log.cc:844] Serialized 26 byte log entry
0709 13:14:50.933143 (+178523us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:50.933179 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:50.933251 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.085763 (+4152512us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:14:55.088856 (+  3093us) raft_consensus.cc:1685] finished
0709 13:14:55.088883 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.089130 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24701,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3844,"spinlock_wait_cycles":628264192,"thread_start_us":569824,"threads_started":2,"wal-append.queue_time_us":872581}
I20260709 13:14:55.105343 31027 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.106253 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1668) took 1425 ms. Trace:
I20260709 13:14:55.107756 31026 rpcz_store.cc:276] 0709 13:14:53.680479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.012239 (+1331760us) service_pool.cc:224] Handling call
0709 13:14:55.106177 (+ 93938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.109122 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.112579 31026 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.113086 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2216) took 1028 ms. Trace:
I20260709 13:14:55.113718 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.114013 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:55.114678 30956 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:55.114702 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.114816 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.115967 30953 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:55.116022 30957 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4.
I20260709 13:14:55.117915 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.118928 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.119467 30953 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:55.120273 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.120817 30953 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:55.121086 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.121634 30952 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:55.122570 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.123629 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.124125 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:55.121599 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.125512 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.126286 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:55.126794 30877 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.127661 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:55.129343 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.124218 30952 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:55.130817 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.131595 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.132625 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.133409 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1660) took 1977 ms. Trace:
I20260709 13:14:55.113456 31026 rpcz_store.cc:276] 0709 13:14:54.084841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.108786 (+1023945us) service_pool.cc:224] Handling call
0709 13:14:55.113015 (+  4229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.134424 31032 rpcz_store.cc:276] 0709 13:14:53.156045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.104210 (+1948165us) service_pool.cc:224] Handling call
0709 13:14:55.133347 (+ 29137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.120477 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:55.135119 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.122892 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.136312 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:55.136580 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.137249 30952 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:55.137046 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.137862 30953 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 1.
I20260709 13:14:55.138908 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:55.135986 30924 connection.cc:256] RPC call timeout handler was delayed by -2.5204380149998542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33380000000000004s for a response
W20260709 13:14:55.140235 30924 connection.cc:256] RPC call timeout handler was delayed by -2.136479123999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:14:55.140594 30924 connection.cc:256] RPC call timeout handler was delayed by -2.0275852930001292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:14:55.140969 30924 connection.cc:256] RPC call timeout handler was delayed by -2.0122852930001045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:14:55.140822 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:55.135821 30956 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:55.141543 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:55.141836 30924 connection.cc:256] RPC call timeout handler was delayed by -1.8880852930001311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:14:55.142230 30924 connection.cc:256] RPC call timeout handler was delayed by -1.8583791239998391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 13:14:55.142515 30924 connection.cc:256] RPC call timeout handler was delayed by -1.789085292999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:14:55.103024   492 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:55.144559 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.150637 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.151665 31026 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5.
I20260709 13:14:55.151554 30953 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:14:55.142858 30924 connection.cc:256] RPC call timeout handler was delayed by -1.7107852930000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 13:14:55.143818 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:55.153280 30956 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:55.154650 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 281702us
W20260709 13:14:55.154794 30924 connection.cc:256] RPC call timeout handler was delayed by -1.6981852930000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:14:55.155264 30924 connection.cc:256] RPC call timeout handler was delayed by -1.6864852930000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:14:55.156002 30924 connection.cc:256] RPC call timeout handler was delayed by -1.5379852930000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 13:14:55.156404 30924 connection.cc:256] RPC call timeout handler was delayed by -1.1878852930001358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2433s for a response
I20260709 13:14:55.157073 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:55.157940 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.158970 31026 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:55.159745 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.160482 31026 raft_consensus.cc:2410] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:14:55.160818 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2217) took 1075 ms. Trace:
I20260709 13:14:55.161106 31026 rpcz_store.cc:276] 0709 13:14:54.085240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.159540 (+1074300us) service_pool.cc:224] Handling call
0709 13:14:55.160775 (+  1235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.144958   453 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.104925 32761 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.150103   466 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:55.164136 32697 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:55.165171 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.153585   492 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.165242 32562 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:55.140738   451 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:14:55.169003 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.169166 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.170064   420 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.167536   453 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:55.178925   453 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.179312   453 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:55.179683   453 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.171429 32761 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:55.166710   466 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:55.176592 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 681) took 1398 ms. Trace:
I20260709 13:14:55.184839 31026 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:55.185465 31032 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:55.188182 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.189086 31032 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
W20260709 13:14:55.192778 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 239771us
I20260709 13:14:55.193845 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:55.196511 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:55.202679 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:55.205662 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 71999.9us
I20260709 13:14:55.206974 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.207667 31026 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 1.
W20260709 13:14:55.208724 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 67964.4us
I20260709 13:14:55.208740 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:55.210100 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.210216 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76217.2us
I20260709 13:14:55.210764 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.209636 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:55.211720 31026 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.212260   542 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.214565   542 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:55.215042   542 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.214685 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2205) took 1143 ms. Trace:
I20260709 13:14:55.187222   466 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:55.216342 31026 rpcz_store.cc:276] 0709 13:14:54.071207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.210549 (+1139342us) service_pool.cc:224] Handling call
0709 13:14:55.214628 (+  4079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.220687 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:55.221155 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 159618us
I20260709 13:14:55.221276 31026 raft_consensus.cc:2376] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4. Re-sending same reply.
I20260709 13:14:55.221463   539 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:55.222141 30847 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:55.222507 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.223404 31026 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:55.224442 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.225183 31026 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:55.226238 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.213313 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:55.226902 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:55.226914 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.227514 30954 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:14:55.230566 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 75150.6us
I20260709 13:14:55.231005 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.232312 31026 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:55.233521 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:55.216979   488 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:55.208181 32761 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:55.295648 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2188) took 3966 ms (client timeout 1998 ms). Trace:
I20260709 13:14:55.249388 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:55.452450 31023 rpcz_store.cc:269] 0709 13:14:51.278640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.218077 (+1939437us) service_pool.cc:224] Handling call
0709 13:14:55.245009 (+2026932us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b54003f52d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.245144 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69623040}
W20260709 13:14:55.248083 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 279) took 5296 ms (client timeout 3286 ms). Trace:
I20260709 13:14:55.427450 31027 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:55.454288 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2215) took 1380 ms. Trace:
I20260709 13:14:55.454834 31027 rpcz_store.cc:276] 0709 13:14:54.073593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.101953 (+1028360us) service_pool.cc:224] Handling call
0709 13:14:55.454227 (+352274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.249943 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.455988 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.456947 31027 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:55.245999 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.461560 31031 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.372594 30954 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:14:55.457711 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 244440us
W20260709 13:14:55.343242 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 186233us
W20260709 13:14:55.327836 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 110769us
W20260709 13:14:55.453768 31028 rpcz_store.cc:269] 0709 13:14:49.951578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.952837 (+  1259us) service_pool.cc:224] Handling call
0709 13:14:55.116277 (+5163440us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b5400334120. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abd1dc0 00007f273ac5de18 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6
0709 13:14:55.247837 (+131560us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b54001f2054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.248004 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7931556096}
I20260709 13:14:55.484854 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:55.489274 31024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 292) took 4576 ms (client timeout 1621 ms). Trace:
W20260709 13:14:55.489845 31024 rpcz_store.cc:269] 0709 13:14:50.912938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.329414 (+416476us) service_pool.cc:224] Handling call
0709 13:14:55.489032 (+4159618us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400146c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.489177 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556600704}
I20260709 13:14:55.490206 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.491815 31027 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:14:55.492134 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:55.493100   549 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:55.493626   549 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.493999   549 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.494036   554 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:55.494653   554 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.495064   554 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.486877 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:55.504659 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:55.498993 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:55.496654 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 274591us
I20260709 13:14:55.500548 31024 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 4. Ops: [2.4-2.4]
I20260709 13:14:55.506575 31027 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 6. Ops: []
W20260709 13:14:55.499290 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 62586.7us
I20260709 13:14:55.507267 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2160) took 5483 ms. Trace:
I20260709 13:14:55.500408 31026 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:14:55.508291 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 285) took 5541 ms. Trace:
I20260709 13:14:55.508612 31026 rpcz_store.cc:276] 0709 13:14:49.966889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.499604 (+5532715us) service_pool.cc:224] Handling call
0709 13:14:55.500006 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.508069 (+  8063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.508240 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.508874 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:55.510046 31026 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.237267   488 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:55.515050 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.187155 31597 rpcz_store.cc:276] 0709 13:14:53.778327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:53.884363 (+106036us) service_pool.cc:224] Handling call
0709 13:14:53.950725 (+ 66362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:54.068810 (+118085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.176280 (+1107470us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54005f28d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:55.176505 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269162240}
I20260709 13:14:55.513773 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2163) took 5398 ms. Trace:
I20260709 13:14:55.521647 31026 rpcz_store.cc:276] 0709 13:14:50.115703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.509453 (+5393750us) service_pool.cc:224] Handling call
0709 13:14:55.509796 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.513452 (+  3656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.513703 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:55.506022 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 267047us
I20260709 13:14:55.521489 31031 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:55.507324 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2162) took 5396 ms. Trace:
I20260709 13:14:55.507644 31024 rpcz_store.cc:276] 0709 13:14:50.024174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.499643 (+5475469us) service_pool.cc:224] Handling call
0709 13:14:55.500194 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.506884 (+  6690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.507201 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.523160 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.501077 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.524092 31027 rpcz_store.cc:276] 0709 13:14:50.110595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.500691 (+5390096us) service_pool.cc:224] Handling call
0709 13:14:55.506409 (+  5718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.507072 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.507274 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.525635 31023 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:55.526230 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2209) took 1454 ms. Trace:
I20260709 13:14:55.526727 31031 rpcz_store.cc:276] 0709 13:14:54.072198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.245680 (+1173482us) service_pool.cc:224] Handling call
0709 13:14:55.526152 (+280472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.500842   539 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:55.533473 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2165) took 5408 ms. Trace:
I20260709 13:14:55.324347   492 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.535749 31032 rpcz_store.cc:276] 0709 13:14:50.125415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.517672 (+5392257us) service_pool.cc:224] Handling call
0709 13:14:55.532817 (+ 15145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.533060 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.533098 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.533154 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:55.533200 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.533268 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.533405 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.539983 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.540490 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.496894   420 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:14:55.543547   420 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:55.544180   420 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:55.516014   547 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:14:55.545095   547 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:55.545619   547 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:55.545205   420 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:55.504956   410 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:14:55.511394   535 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:14:55.556201   535 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.556676   535 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:55.557680   535 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:55.559052   535 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.538239   539 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:55.560525   539 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.497328   460 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:14:55.562008   460 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.562431   460 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:55.535176 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.517134   488 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.295331   469 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.229s
I20260709 13:14:55.565696 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:14:55.574283 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 86505.6us
I20260709 13:14:55.575021 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.577466 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.580994 32726 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:55.589275   492 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.563323   460 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.582165   478 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:55.594769   519 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.012s	sys 0.009s
I20260709 13:14:55.577170   549 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.603106 32761 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:55.576946   453 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.611582   450 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.618896   488 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.620102   450 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:55.622754   488 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:55.613550   547 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:55.623672   549 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.624778   460 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.625914   547 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:55.605849   519 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.012s	sys 0.010s
I20260709 13:14:55.614269   554 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:55.663184 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1321) took 3998 ms (client timeout 1503 ms). Trace:
W20260709 13:14:55.664448 30958 rpcz_store.cc:269] 0709 13:14:51.664780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.670769 (+  5989us) service_pool.cc:224] Handling call
0709 13:14:55.662172 (+3991403us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54003ffcd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.662705 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678798208}
I20260709 13:14:55.668071 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:55.668542 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:55.670958 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.671367 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:14:55.671960 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.672614 31024 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:55.674187 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.675082 31024 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:55.676462 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.678293 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.679001 31024 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.576089 31027 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.680478 31029 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.681654 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.682663 31027 raft_consensus.cc:2376] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4. Re-sending same reply.
I20260709 13:14:55.683997 31028 raft_consensus.cc:606] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:55.591918 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:55.684798 31028 raft_consensus.cc:614] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:55.685904 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93978.8us
I20260709 13:14:55.690266 31570 leader_election.cc:400] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5.
I20260709 13:14:55.685920 31032 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:55.692965 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:55.693691 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.694643 31032 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:14:55.683902 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89172.8us
I20260709 13:14:55.699697 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.704381 31596 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:55.708124 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.708567 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.709868 31601 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:55.710347 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:55.707446 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:55.711014 30875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1428) took 5517 ms (client timeout 2122 ms). Trace:
I20260709 13:14:55.712064 31596 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:14:55.713379 30879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2035) took 4449 ms (client timeout 1916 ms). Trace:
W20260709 13:14:55.714006 30879 rpcz_store.cc:269] 0709 13:14:51.264018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:51.361015 (+ 96997us) service_pool.cc:224] Handling call
0709 13:14:55.712823 (+4351808us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b540023ffd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.713135 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5533485952}
I20260709 13:14:55.715884 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.716737 31032 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:55.717914 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.718806 31032 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:55.720494 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.722116 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.722923 31027 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
W20260709 13:14:55.725605 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.727167 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:55.711701 30875 rpcz_store.cc:269] 0709 13:14:50.193343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.198329 (+  4986us) service_pool.cc:224] Handling call
0709 13:14:55.710544 (+5512215us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54001257d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.710736 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604624768}
I20260709 13:14:55.612329 32761 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.719753 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.754604   408 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:14:55.756637 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.758733   453 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.747020 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:55.762925   542 consensus_meta.cc:287] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.000s
W20260709 13:14:55.766242 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2195) took 2748 ms (client timeout 2433 ms). Trace:
I20260709 13:14:55.770579   555 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:55.769505 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.777799 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45416 (request call id 10) took 5355 ms. Trace:
I20260709 13:14:55.779953 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.780274 30950 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
W20260709 13:14:55.781715 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1669) took 2088 ms (client timeout 1921 ms). Trace:
W20260709 13:14:55.784086 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2212) took 1711 ms (client timeout 2003 ms). Trace:
I20260709 13:14:55.790253 31026 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:14:55.787992 31025 rpcz_store.cc:269] 0709 13:14:53.017712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.765669 (+2747957us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:55.765965 (+   296us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:55.789855 31030 rpcz_store.cc:269] 0709 13:14:53.700092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.781224 (+2081132us) service_pool.cc:211] Skipping call since client already timed out
0709 13:14:55.781451 (+   227us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:14:55.789906 31029 rpcz_store.cc:269] 0709 13:14:54.072970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.023069 (+950099us) service_pool.cc:224] Handling call
0709 13:14:55.783721 (+760652us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b540007ba54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.783987 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506667392}
I20260709 13:14:55.793618 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:14:55.796943 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:55.788867 31028 rpcz_store.cc:276] 0709 13:14:50.422720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.499527 (+5076807us) service_pool.cc:224] Handling call
0709 13:14:55.777448 (+277921us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540007ba54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac54853 00007f273fc2260a 00007f27391a87d4 00007f27391a8762 00007f27391a8691 00007f27391a860c 00007f27391a78c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:55.777630 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410549120}
I20260709 13:14:55.804008 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:55.808282 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.809108 31029 raft_consensus.cc:2376] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4. Re-sending same reply.
I20260709 13:14:55.811076   440 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.811586   440 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:55.802814   408 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:55.812523   554 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.813859 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2166) took 5671 ms. Trace:
I20260709 13:14:55.813210   408 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.814349 31029 rpcz_store.cc:276] 0709 13:14:50.141966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.810135 (+5668169us) service_pool.cc:224] Handling call
0709 13:14:55.810664 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.811102 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.811138 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.811199 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:55.813480 (+  2281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.813586 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.813757 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.819113 30998 leader_election.cc:400] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3.
I20260709 13:14:55.821913   449 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:55.820096 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.799575   542 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.824149 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.819556 30998 leader_election.cc:403] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:55.825017 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 647) took 5850 ms. Trace:
I20260709 13:14:55.813071   440 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:55.827421   450 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:55.826140 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.828866   440 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.826148 31600 rpcz_store.cc:276] 0709 13:14:49.966120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.969748 (+  3628us) service_pool.cc:224] Handling call
0709 13:14:50.022260 (+ 52512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:53.301022 (+3278762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:53.305191 (+  4169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:53.375555 (+ 70364us) log.cc:844] Serialized 26 byte log entry
0709 13:14:53.573909 (+198354us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:53.573973 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.785276 (+2211303us) spinlock_profiling.cc:243] Waited 3.2 s on lock 0x7b5400541354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:55.785402 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:55.785546 (+   144us) raft_consensus.cc:1685] finished
0709 13:14:55.785564 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.795011 (+  9447us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30143,"raft.queue_time_us":104162,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8296,"spinlock_wait_cycles":7352615296,"thread_start_us":165094,"threads_started":1,"wal-append.queue_time_us":542763,"wal-append.run_cpu_time_us":1754,"wal-append.run_wall_time_us":1003966}
I20260709 13:14:55.789655   555 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:55.832916 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.833132   555 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.835605   488 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:55.836777   556 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:55.838192 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.840554   542 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:55.842150 31031 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:55.834211 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.843750 31026 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.845878 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1655) took 4393 ms. Trace:
I20260709 13:14:55.846846 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:55.847580 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:55.848425   560 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:14:55.849570 32753 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.850092 32753 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:55.850494 32753 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.850656 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.852499 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:55.853240 31602 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.855072 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e61719587d824d0680b05c15592027a3"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:14:55.851545 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.853039 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.819178 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:55.846318 31026 rpcz_store.cc:276] 0709 13:14:51.452749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.844652 (+4391903us) service_pool.cc:224] Handling call
0709 13:14:55.845046 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.845428 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.845462 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.845539 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:14:55.845587 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.845662 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.845795 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.872936 31027 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:55.876995 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:55.861931 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.856071 31029 raft_consensus.cc:606] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:14:55.884279 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.885267   546 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.885766   546 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:55.886240 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:55.887163 31604 raft_consensus.cc:2376] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
I20260709 13:14:55.889103 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.890601 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1657) took 4315 ms. Trace:
I20260709 13:14:55.856848 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.895397 31030 rpcz_store.cc:276] 0709 13:14:51.575453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.866168 (+4290715us) service_pool.cc:224] Handling call
0709 13:14:55.889958 (+ 23790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.890262 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.890285 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.890345 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:55.890373 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.890431 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.890530 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.861021 31597 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:55.902355 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.856505   416 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:55.904142 31600 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:55.904259   416 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.906599 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.856976   308 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:55.918359 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.918613   379 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:55.919106   379 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:55.919639   379 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.920775 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2193) took 2907 ms. Trace:
I20260709 13:14:55.921149 31026 rpcz_store.cc:276] 0709 13:14:53.013677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.880078 (+2866401us) service_pool.cc:224] Handling call
0709 13:14:55.919511 (+ 39433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.920358 (+   847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.920390 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:55.920458 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:55.920496 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.920558 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:55.920699 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134}
I20260709 13:14:55.922956 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.924811 31029 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:55.925629 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2210) took 1853 ms. Trace:
I20260709 13:14:55.926024 31029 rpcz_store.cc:276] 0709 13:14:54.072470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.894603 (+1822133us) service_pool.cc:224] Handling call
0709 13:14:55.924250 (+ 29647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:55.925288 (+  1038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:55.925560 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:55.927829 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.928843 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:55.932524 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.890743 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.856633   468 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:55.855986 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.856356   488 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:55.935914 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:55.935266 31604 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:14:55.935863 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 240387us
I20260709 13:14:55.887089   546 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:55.951333   468 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.951943 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.957969 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:55.961757 31597 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:55.961825 31599 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:14:55.964689   416 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:55.965719   468 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:55.966044 30780 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 357) took 6550 ms. Trace:
I20260709 13:14:55.923568 31026 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:14:55.959030 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36650 (request call id 84) took 5744 ms. Trace:
I20260709 13:14:55.966773 31031 rpcz_store.cc:276] 0709 13:14:50.214740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.843035 (+5628295us) service_pool.cc:224] Handling call
0709 13:14:55.958947 (+115912us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:14:55.943077   466 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.712s	user 0.000s	sys 0.019s
I20260709 13:14:55.960440   546 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.958899   308 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:55.970721 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:55.971400 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:55.970177 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:14:55.973428 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 94897.2us
I20260709 13:14:55.978654 31602 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:55.985600 31598 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:55.986899 31570 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:55.986388 30779 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:55.987314 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:55.988157 30922 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 1.517s (SENT)
I20260709 13:14:55.988621 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:55.966421 30780 rpcz_store.cc:276] 0709 13:14:49.415823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.430822 (+ 14999us) service_pool.cc:224] Handling call
0709 13:14:55.965785 (+6534963us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:51.804378 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:51.805119 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:51.805172 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:14:51.805197 (+    25us) tablet.cc:662] Decoding operations
0709 13:14:52.416055 (+610858us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:52.457122 (+ 41067us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:52.470161 (+ 13039us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:14:52.641499 (+171338us) tablet.cc:701] Row locks acquired
0709 13:14:52.641523 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:14:52.641739 (+   216us) write_op.cc:270] Start()
0709 13:14:52.641882 (+   143us) write_op.cc:276] Timestamp: P: 1783602892641674 usec, L: 0
0709 13:14:52.641914 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:14:52.865100 (+223186us) log.cc:844] Serialized 2462 byte log entry
0709 13:14:54.216876 (+1351776us) op_driver.cc:464] REPLICATION: finished
0709 13:14:55.561946 (+1345070us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f2737b500ac 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273e690ef0
0709 13:14:55.607664 (+ 45718us) write_op.cc:301] APPLY: starting
0709 13:14:55.607756 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:55.608197 (+   441us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:55.608222 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:55.613724 (+  5502us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:55.613997 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:14:55.614066 (+    69us) write_op.cc:312] APPLY: finished
0709 13:14:55.614339 (+   273us) log.cc:844] Serialized 53 byte log entry
0709 13:14:55.631394 (+ 17055us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:55.631647 (+   253us) write_op.cc:454] Released schema lock
0709 13:14:55.631696 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:55.823971 (+192275us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:55.824080 (+   109us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":74624,"child_traces":[["op",{"apply.queue_time_us":1342119,"apply.run_cpu_time_us":17666,"apply.run_wall_time_us":183597,"num_ops":6,"prepare.queue_time_us":279732,"prepare.run_cpu_time_us":35359,"prepare.run_wall_time_us":1539638,"raft.queue_time_us":654587,"raft.run_cpu_time_us":23530,"raft.run_wall_time_us":1638780,"replication_time_us":1515437,"spinlock_wait_cycles":5882624,"thread_start_us":2356672,"threads_started":5,"wal-append.queue_time_us":529179,"wal-append.run_cpu_time_us":102637,"wal-append.run_wall_time_us":1723876}]]}
W20260709 13:14:55.991847 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 482859us
I20260709 13:14:55.992110   531 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:55.987320 31570 leader_election.cc:403] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:55.995265 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:55.997496   308 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.002226 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.002907 31032 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.007512 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:56.008749   440 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:56.009178   440 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:56.009574   440 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.010756 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:56.011904   542 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.012323   542 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.012355   408 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:56.012738   542 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.012953   408 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:56.013521   408 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:56.015976 31031 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:56.019969 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:56.020835 31023 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:55.983588 31029 raft_consensus.cc:2376] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
I20260709 13:14:56.032104 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.038064 31026 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.038911 31032 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:56.041435 31025 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.040560 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.023233   466 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.041088   440 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.047909   440 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.047871 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:56.048722 31602 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:56.048864   466 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:56.045751 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.045655 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:56.031803 31600 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 1.
W20260709 13:14:56.066340 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 247215us
I20260709 13:14:56.075754 31024 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:56.079006 31024 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:14:56.063489 30922 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 1.996s (SENT)
I20260709 13:14:56.079582   440 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:56.082858   440 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:14:56.083873 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 46314.2us
I20260709 13:14:56.088162 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:56.090009 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.081018   449 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3.
I20260709 13:14:56.096680 31602 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:14:56.096879 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 302) took 1114 ms. Trace:
I20260709 13:14:56.099016 30998 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.089442 30779 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:56.083711 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 388072us
I20260709 13:14:56.085057 31598 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:56.084229 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:56.108314 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.085412   440 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.097254 31023 rpcz_store.cc:276] 0709 13:14:54.978063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.021647 (+1043584us) service_pool.cc:224] Handling call
0709 13:14:56.022046 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.022393 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:56.022757 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.083338 (+ 60581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:56.083401 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:56.091805 (+  8404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.091883 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.092004 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5128,"prepare.queue_time_us":190,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":5602,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":21888,"thread_start_us":54716,"threads_started":1}
I20260709 13:14:56.110713 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:56.107635 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 62666.6us
I20260709 13:14:56.063640 32753 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.115442 32726 raft_consensus.cc:2764] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:14:56.117117 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 91755.1us
I20260709 13:14:56.124045 31027 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:56.120451 30779 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:56.132758 31029 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.118436 32692 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.127295 31600 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:56.129444 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.138904 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 303) took 1152 ms. Trace:
I20260709 13:14:56.142177 31029 rpcz_store.cc:276] 0709 13:14:54.986944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.042140 (+1055196us) service_pool.cc:224] Handling call
0709 13:14:56.129593 (+ 87453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.133189 (+  3596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.138760 (+  5571us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b5400378cd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:56.138856 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69925632}
I20260709 13:14:56.141237 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:56.151171 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 63146.5us
I20260709 13:14:56.152868 31025 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:56.154173 32726 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.154760 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.148710 30779 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 5, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 5 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:56.156384   546 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.163069 32761 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:56.163358   546 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:56.163527 32761 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:56.163842   546 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.159159 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.160652 31023 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.166432 31023 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:56.170743 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:56.171948 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:56.173295 32692 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.174443 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:56.173120   531 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:56.175406   568 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.177248 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:56.163978 32761 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.178339   532 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:56.178493   531 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.178493   379 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:56.179186   531 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:56.179648   531 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.178956   532 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:56.183621 31026 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:56.186096 31032 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:56.188712 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 106686us
I20260709 13:14:56.189646 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 295) took 1338 ms. Trace:
W20260709 13:14:56.189656 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 44507.6us
I20260709 13:14:56.204031 30779 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:56.215502 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.190068 31030 rpcz_store.cc:276] 0709 13:14:54.846894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.901157 (+1054263us) service_pool.cc:224] Handling call
0709 13:14:55.901686 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:55.902381 (+   695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:55.902428 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:55.903149 (+   721us) log.cc:844] Serialized 26 byte log entry
0709 13:14:55.972789 (+ 69640us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:55.996156 (+ 23367us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.004236 (+  8080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.004335 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.185131 (+180796us) raft_consensus.cc:1685] finished
0709 13:14:56.185150 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.185284 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20569,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":22506,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":14271,"thread_start_us":69188,"threads_started":1,"wal-append.queue_time_us":197663}
I20260709 13:14:56.218240 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 306) took 1203 ms. Trace:
I20260709 13:14:56.132222   488 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.207964 31027 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.218777 31032 rpcz_store.cc:276] 0709 13:14:54.995979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.058319 (+1062340us) service_pool.cc:224] Handling call
0709 13:14:56.185940 (+127621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.186438 (+   498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.198887 (+ 12449us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b54003f57d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:56.199066 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216284928}
W20260709 13:14:56.229451 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 111353us
I20260709 13:14:56.234237 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.184696   532 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.238961 32726 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:56.239485 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.241339 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.279122   416 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.279582   416 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.279964   416 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:56.284109 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 66736.1us
I20260709 13:14:56.286234 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:56.239009 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.287226 32753 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.208324   466 raft_consensus.cc:2764] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:14:56.289834 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 61066.6us
W20260709 13:14:56.291415 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 70143.9us
I20260709 13:14:56.285565   460 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:56.295258 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 77207.3us
W20260709 13:14:56.303740 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64843.3us
W20260709 13:14:56.296198   539 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.580s	user 0.018s	sys 0.000s
I20260709 13:14:56.312222 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.320374 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:56.321220 30877 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:56.321740 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.309935   556 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:56.324496   556 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.315092   565 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:56.325611   565 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.326038   565 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.326618   556 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.307888 32753 raft_consensus.cc:2764] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:14:56.328078 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 103926us
I20260709 13:14:56.313141 31023 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.294407   542 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.335353 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:56.336141 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.337006 30879 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:14:56.337066 31596 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.000s
I20260709 13:14:56.337484 31596 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:56.337987   468 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.338135 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.333941 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:14:56.338385 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:56.339617 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.340782 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:56.345873 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.348004 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.351347 30874 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:56.345467 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.352080 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.343236   460 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.333809 31600 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
W20260709 13:14:56.357492 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 61340.2us
I20260709 13:14:56.344015   379 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.360010   376 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.360107   568 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:56.360564   376 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:56.360841   568 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:56.361038   376 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.361949   568 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.364312 30883 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:14:56.364462 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 186282us
W20260709 13:14:56.355232   555 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260709 13:14:56.365851 31023 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.328768   539 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.370484 30875 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.368762 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.370668   553 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.344113   408 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.377015 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.371280 31596 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.385703 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.384680 30923 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.388114 31604 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:14:56.394078   571 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:14:56.391383 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:56.397679 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 158925us
I20260709 13:14:56.399127 30996 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:56.383927   466 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.399941 32753 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.400362 32753 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:56.400723 32753 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.401741 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.402675 30876 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.403273 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.403980 31603 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:14:56.403905 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.404971 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.405630 30880 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:56.406548 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.407186 31600 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:56.408308   574 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:14:56.409569   542 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.410377 31570 leader_election.cc:400] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.410729 31570 leader_election.cc:403] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:14:56.412322   573 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:14:56.413951 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 300) took 1445 ms. Trace:
I20260709 13:14:56.414341 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:56.416957 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47582.8us
I20260709 13:14:56.418145 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:56.414306 31031 rpcz_store.cc:276] 0709 13:14:54.969005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.016784 (+1047779us) service_pool.cc:224] Handling call
0709 13:14:56.017182 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.017639 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.017670 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.018181 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:14:56.036862 (+ 18681us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:56.081259 (+ 44397us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.083657 (+  2398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.083726 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.413722 (+329996us) raft_consensus.cc:1685] finished
0709 13:14:56.413743 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.413870 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2135,"prepare.queue_time_us":44243,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":7498,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":9052,"thread_start_us":18284,"threads_started":1,"wal-append.queue_time_us":143296}
I20260709 13:14:56.372298   555 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.423811 31023 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:14:56.427639 31023 pending_rounds.cc:85] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 4
W20260709 13:14:56.523002 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 143452us
I20260709 13:14:56.429365 30874 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.527037 31605 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:14:56.528009 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.452301 30879 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:56.531205 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 46741.4us
I20260709 13:14:56.449038 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:56.499855 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.481951 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:56.486414 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 157743us
I20260709 13:14:56.534428 30883 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:56.529657 31023 pending_rounds.cc:107] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:14:56.449033 30875 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:56.449157 32692 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:56.426766   308 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.542454 31023 raft_consensus.cc:2889] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:56.545123 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 130873us
I20260709 13:14:56.419585   379 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.538501 32726 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:56.495922   408 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.477203 30877 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
W20260709 13:14:56.579525 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 97712.9us
I20260709 13:14:56.455595   553 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:14:56.499287   546 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:56.591737 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 48780.8us
W20260709 13:14:56.593596 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 69048.5us
I20260709 13:14:56.592008 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.588176 30996 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.590178 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2229) took 1069 ms. Trace:
I20260709 13:14:56.595677 31023 rpcz_store.cc:276] 0709 13:14:55.520972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.126575 (+605603us) service_pool.cc:224] Handling call
0709 13:14:56.141844 (+ 15269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:56.589939 (+448095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.590122 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:56.495992   460 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:14:56.545861   565 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:56.599638   565 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.599898 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.601902   556 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.602334   556 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.602682   556 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.605839 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.424536   468 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.536881   440 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.611598 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:56.614472 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 192420us
W20260709 13:14:56.615953 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 73609.7us
I20260709 13:14:56.454830 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.615412 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.623669 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:56.626682   466 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:56.627229   466 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:56.627941   531 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.630184   531 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.631881   440 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:56.632700   576 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:14:56.636773   584 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:56.638744   584 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:56.642848   575 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.410s	user 0.003s	sys 0.002s
W20260709 13:14:56.644775   577 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:14:56.651273 30877 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:56.429394   416 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.622098 32726 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:14:56.659557 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49627.5us
I20260709 13:14:56.662858 30882 raft_consensus.cc:2368] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.657063 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.667094 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2169) took 6458 ms. Trace:
I20260709 13:14:56.659091 32692 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:56.681353 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.684204 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.684816 31031 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.669696 32726 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.687875   531 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:56.688191 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.688391   531 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.688798   531 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.688235 32726 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:56.675967 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52421.4us
I20260709 13:14:56.681389 32692 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:56.696313   539 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.697345 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.700519 30882 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:56.700992   555 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.701130   416 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.701956   466 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.667639 31028 rpcz_store.cc:276] 0709 13:14:50.201436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:55.833683 (+5632247us) service_pool.cc:224] Handling call
0709 13:14:55.912349 (+ 78666us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:56.045059 (+132710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.045086 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:56.068521 (+ 23435us) log.cc:844] Serialized 52 byte log entry
0709 13:14:56.300313 (+231792us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:14:56.314073 (+ 13760us) log.cc:844] Serialized 14 byte log entry
0709 13:14:56.314561 (+   488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:56.314652 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:56.643997 (+329345us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:14:56.646650 (+  2653us) raft_consensus.cc:1685] finished
0709 13:14:56.656676 (+ 10026us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:56.659862 (+  3186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":666,"prepare.queue_time_us":13430,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":90,"raft.queue_time_us":9350,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":5518,"spinlock_wait_cycles":13744896,"thread_start_us":231098,"threads_started":1,"wal-append.queue_time_us":350811}
I20260709 13:14:56.427610 32761 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.712172 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:56.726343 30847 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.660413 32753 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.725934 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:56.735534 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 84000.4us
I20260709 13:14:56.736443 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.737020 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.738265 31601 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:56.722327 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.739518 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:14:56.747679 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 75396.2us
I20260709 13:14:56.749992 30922 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.736443   416 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:56.755015 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 174417us
W20260709 13:14:56.755502 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 73262.9us
I20260709 13:14:56.758535 30847 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.760703 31031 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:56.725528   376 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.740818 31596 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:56.749334   565 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.749032   553 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.759127 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:56.752595 31597 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:56.775930 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.755553   416 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:56.775238 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.780520 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:56.778044 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:56.778854 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55688.5us
I20260709 13:14:56.779031 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.779449 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.782608 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.783202 30876 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:56.783360 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.785020 30882 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.782727 30877 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:56.783841   553 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.784201 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.783566   468 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:56.793159   376 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.793421 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:56.795289   589 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.795918 32753 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.774324   539 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.796739 30875 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:56.797053   568 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.800025 32692 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.785887   416 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.800537 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.801128   556 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:56.765650   588 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:14:56.801373 32726 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.803443 32726 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.788051 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:56.786195 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.805850 30883 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.773943   308 raft_consensus.cc:2764] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:14:56.788244 30878 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:56.804065 31600 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:56.779168 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.781081 30880 raft_consensus.cc:2376] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4. Re-sending same reply.
I20260709 13:14:56.808027   379 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.808408 31603 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:56.808058   546 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.803443   556 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.810091 32761 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.812105 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:56.812646 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.813678   556 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.814000 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:56.800490 32692 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:56.814693 32692 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.800668 30881 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:56.815970 31601 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:14:56.817116 30847 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:56.795341 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.821622 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:56.821002 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 70988.3us
I20260709 13:14:56.795938   589 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:56.829101 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.826725 32753 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:56.827024   376 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.830281   546 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:56.828336   589 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.839908 32753 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:56.841212 32753 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:56.843997 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 55158.8us
I20260709 13:14:56.844269 32726 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:56.844900 32726 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:14:56.845402 32726 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.825963   468 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:14:56.846487   468 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:56.848135   468 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:56.848905   308 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:56.849275   308 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:56.850052   308 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.850886 30951 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.851421   308 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:56.852035   408 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.857367   408 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:56.857488 30956 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.858129 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.858807 30953 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:56.859148 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.859616 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.860270 30955 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:56.860386 30957 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:56.852523 31031 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:56.861256   376 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.862347   588 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:56.862702   588 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:56.862824 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.863651 30950 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:56.863620   588 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:56.865324   588 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.855273 30954 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:56.866955 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.854208 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:56.867731 30954 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:56.868036   553 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:56.868634 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.868981 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.869432 30954 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:14:56.869598 30953 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.870097   583 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:56.871153 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.871940 30958 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.872241 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:56.854879   488 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.856767 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.858381   408 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.865103 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.870249 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.855314   555 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:56.854260 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.821820   556 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:56.852429   468 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:14:56.875285 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 55037.7us
I20260709 13:14:56.876940 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:56.886511 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.815629   531 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.887893 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.888360   542 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:56.890064   488 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:56.890708 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.871219   586 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:56.891376 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.868659   553 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:56.899469 30958 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:56.886143   539 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:56.916851 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 62640.8us
I20260709 13:14:56.917006 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.876559   546 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:14:56.920037 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 153983us
I20260709 13:14:56.884959   468 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:56.902978   586 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:56.925040 30958 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:56.924827 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.925899 30953 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:56.925956 30923 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.903330   488 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:56.908833   466 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:14:56.933557 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:56.930827 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.931931 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.929776 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.934744 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:56.934968 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:56.935611 30877 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
W20260709 13:14:56.936229 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adb189bd941147e0924cc38c9f01bd11 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f535fccbafb14e3f92bd45065da403db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:14:56.932914 30955 raft_consensus.cc:2376] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3. Re-sending same reply.
I20260709 13:14:56.936893 32726 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.937049   587 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:14:56.937424 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.937932 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.938189 31030 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:14:56.938638 30955 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:14:56.938903 30949 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:56.939182 32726 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:56.939931   590 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:56.940853 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.886511 32761 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:14:56.941120 30881 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:56.886191   440 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:14:56.950227   565 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:56.950670   565 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:56.939458 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.951982 30956 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:56.951644   565 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.953151   565 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.953186 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.954121 30956 raft_consensus.cc:2410] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:14:56.954902 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.956543 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.957211   408 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:56.941713 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.960151 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.961205   587 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:56.961330 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.961664   587 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:56.962453 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.962565   587 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.964811 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.966010 30923 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:56.944124 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:56.940584   546 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:56.944684 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.944801 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.945925 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:56.947005   584 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:56.910817   542 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:56.963595 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:56.979528 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.979779 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.933290   488 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:56.981868 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.916251   460 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:56.940604 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.979528 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:56.983867 30881 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:56.967708   587 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:56.983745 30949 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
W20260709 13:14:56.984592 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 206674us
I20260709 13:14:56.986208 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:56.982699 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 96288.9us
I20260709 13:14:56.999178 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:56.991045 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:56.972666 31570 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:56.992561 31023 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:14:56.991858 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:56.981590   590 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.015435 32692 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.017122 30955 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:14:57.022070 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 149897us
I20260709 13:14:57.023316 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:57.021185 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:57.025122 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.027020 31571 leader_election.cc:400] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:57.031141 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:57.031724 31030 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.012667   532 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:56.980713   416 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.043304 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:57.046190 30958 raft_consensus.cc:2376] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3. Re-sending same reply.
I20260709 13:14:57.028573   539 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:57.036433   440 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.051004 31030 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:14:57.046793 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:57.051656 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.052287 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 86350us
I20260709 13:14:57.054435 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:57.055560 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.056847 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:14:57.057793 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52118us
I20260709 13:14:56.991145   586 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.043176   532 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:14:57.058238 30848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.529s (SENT) [suppressed 112 similar messages]
I20260709 13:14:57.062148 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.088943 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:57.090350 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.091830 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:57.092572 30951 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:57.061641   531 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:57.061782 31599 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:57.098387 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 46779.7us
W20260709 13:14:57.099036 30997 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.503s (SENT)
I20260709 13:14:57.111806 30997 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:57.091205 32692 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:57.099880   593 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.101078   591 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:57.102859 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:57.103344 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:57.104184   603 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.125774 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.104331 30876 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:57.090191   532 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.127105 30996 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:57.053418   556 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:57.041044   468 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.115666 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:57.115624 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.121017 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.114486   568 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:57.144109 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 84490.2us
I20260709 13:14:57.122807   591 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.057276   542 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.182412 30953 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:14:57.183264 30958 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:14:57.154592 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.144518   586 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:57.189337 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 162191us
I20260709 13:14:57.153671   591 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:57.196130 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 80937.4us
I20260709 13:14:57.198328 30958 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:14:57.216531 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 62016.5us
I20260709 13:14:57.146587 32761 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:14:57.198973 30848 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.507s (SENT)
W20260709 13:14:57.219885 30997 leader_election.cc:336] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.520s (SENT)
I20260709 13:14:57.184520   440 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:57.125612   593 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:57.188338   598 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:57.234107 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46642.7us
I20260709 13:14:57.204368 32726 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:14:57.204600   568 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.149230   553 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:14:57.230718 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 167220us
I20260709 13:14:57.240792 31571 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:57.248788 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 66712.7us
I20260709 13:14:57.232443 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:57.229869 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.237918 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:57.254937   585 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:14:57.255255 32761 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:57.256367 32761 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:57.258189   605 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:57.258703   605 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:57.259759   605 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.236145   598 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.278409 30953 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:57.264183 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:57.264343   610 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:57.264827 32692 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:57.271749 30877 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:57.272009 30954 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:57.235927   416 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:57.288236 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47518.7us
I20260709 13:14:57.289410 31571 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:57.290453 31571 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:14:57.293412 30997 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.598s (SENT)
W20260709 13:14:57.294793 30997 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.606s (SENT)
W20260709 13:14:57.296622 30997 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.664s (SENT)
I20260709 13:14:57.298717 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:57.303679 30997 leader_election.cc:336] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.664s (SENT)
I20260709 13:14:57.303892   632 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.284212   600 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.306332   632 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:57.319850 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 84433.9us
W20260709 13:14:57.320688 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 56597.8us
I20260709 13:14:57.283342 32692 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:57.282437   598 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:57.328231 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 138628us
I20260709 13:14:57.283492   610 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:57.309228   568 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:57.314270   585 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.340821   585 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:57.340917   568 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:57.341887   585 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.342932   585 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.342458   568 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:57.338853 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:57.340936 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 64804.9us
I20260709 13:14:57.346186   565 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:14:57.337072 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46712.3us
I20260709 13:14:57.346711   565 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:57.347282 31571 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:57.348438 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.347893   565 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:57.350768 30848 leader_election.cc:336] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.556s (SENT)
W20260709 13:14:57.351575 30848 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.563s (SENT)
I20260709 13:14:57.351992 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:57.356879 30848 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.573s (SENT)
I20260709 13:14:57.357429 31571 leader_election.cc:400] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:14:57.357286 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.315244   546 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.358678 31571 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.361598 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:57.358507   613 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:57.363471 30953 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:57.363471 31026 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:57.319284   539 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:57.351549   585 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:57.380125 30848 leader_election.cc:336] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.618s (SENT)
I20260709 13:14:57.384433 31023 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:14:57.385279 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:57.387676 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:57.388643   603 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:57.391039 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53452.9us
I20260709 13:14:57.391983 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:57.330962 32692 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.394106   623 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:57.330703   416 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:57.339672   605 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.336251   610 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:57.266584   556 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.397470 31025 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:57.398343 31571 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.397078 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:57.410442   617 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:57.411340   615 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:14:57.398494 30997 leader_election.cc:336] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.706s (SENT)
I20260709 13:14:57.412777 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:57.398432   416 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:14:57.412149   621 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:14:57.417244   416 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.400492   623 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.400233   594 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.186s
I20260709 13:14:57.420432   594 consensus_queue.cc:1243] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:14:57.400622 31597 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:57.420930   594 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:57.421299   594 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:57.422528 32753 raft_consensus.cc:993] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:57.422154   594 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.422984 32753 raft_consensus.cc:1081] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:14:57.400206   618 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.417332   629 raft_consensus.cc:2764] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:57.423492   594 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:57.340430   408 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:14:57.424062   618 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:57.426234   635 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.432984   618 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.413630   603 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:14:57.434271   618 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:57.400936   440 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:57.433162   617 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:57.412847   584 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:57.446208 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47943.6us
I20260709 13:14:57.458194 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:57.459024   379 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:14:57.460520   376 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:57.460804   632 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:57.461050   376 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:57.461470   376 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.424823   539 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.426548   604 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:57.463558   539 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:57.468745 30876 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:57.468864   376 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:57.473093 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 74634us
I20260709 13:14:57.447570 30950 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:14:57.493046 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50523.4us
I20260709 13:14:57.494598   620 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:57.460489   610 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.496335   608 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:57.497089   620 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:57.497555   620 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:57.498067   610 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:57.499028 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45516us
W20260709 13:14:57.501242 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.501820   379 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:57.501966   635 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:57.451398   588 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:14:57.508324 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:57.510246 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.446857   599 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:57.537120 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 96781.7us
I20260709 13:14:57.453244   584 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:57.539549 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:57.539975 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.541692   635 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:14:57.448448   593 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:57.545944 30956 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:57.543421 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:57.482420   376 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:57.510257   587 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.002s
I20260709 13:14:57.544564 31604 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:14:57.534561   308 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.003s
I20260709 13:14:57.542891 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:57.551151 30879 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:14:57.542789   539 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.539345   614 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.536211 31605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e61719587d824d0680b05c15592027a3"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:14:57.539196 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:57.553675 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:14:57.556054 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 100750us
I20260709 13:14:57.545418   610 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:57.556056 31605 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:57.557652 30878 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:57.452970   598 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:57.556123 30881 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:14:57.546525   584 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.545259   608 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:57.583792 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:57.586997 30848 leader_election.cc:336] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.709s (SENT)
I20260709 13:14:57.584942 30883 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:57.498433   620 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.596349 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:57.596410 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:57.585160 31605 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.550319 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:57.576220 30882 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:14:57.515195   488 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.778982 31604 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:14:57.559434   589 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.000s
I20260709 13:14:57.554117 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:57.780359 31600 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:57.780550 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:57.781497 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:57.782250 31600 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:57.782747   640 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.187s	user 0.004s	sys 0.004s
I20260709 13:14:57.782320 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:57.626109   556 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:57.631954 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.575232   614 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.784062   589 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:57.784849 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:57.785231 30957 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:57.786801   589 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:57.596539 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:57.586799   610 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:57.789481   610 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.790887   610 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:57.653980   637 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:14:57.598690   608 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.584775   416 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.584946   532 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:57.796391 30949 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:57.555052   635 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:57.766182   632 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:57.797459   632 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.766530 30998 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:14:57.799708 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 200355us
I20260709 13:14:57.799993   638 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:57.800557   638 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.800949   638 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:57.802177 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:57.802932 30875 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:57.584030   408 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:14:57.574880   586 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:58.040014 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77126.6us
I20260709 13:14:57.766947 31602 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:57.767432 30879 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:14:57.768052   598 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:14:57.769042 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 191480us
W20260709 13:14:58.043596 30848 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.712s (SENT)
I20260709 13:14:58.044014 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:57.770007 30952 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:14:57.772962 31605 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:57.774027 30881 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:57.775331 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.775406 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.046150 30951 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:57.776840 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.777951 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:57.555341   539 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:14:57.907419   641 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.304s	user 0.018s	sys 0.000s
W20260709 13:14:57.768081 30997 leader_election.cc:336] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.794s (SENT)
I20260709 13:14:57.889655   642 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:57.965238 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.054181 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.000695 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.017160 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.063205 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.065430 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:58.006440 32692 consensus_meta.cc:287] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.007s
I20260709 13:14:57.928135   599 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.062548 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.074147 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.109795 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.110947 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.076530 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.042797   605 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:58.117887 30958 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:58.118372 30876 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.121520 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.122162 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.123896 30951 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:58.126087 31605 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:58.127715   644 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
W20260709 13:14:58.139730 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 553197us
I20260709 13:14:58.142251 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.158540 30876 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:14:58.164844   642 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.168723   590 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:58.176450 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 407) took 1257 ms. Trace:
I20260709 13:14:58.178277 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.185678 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1467) took 1083 ms. Trace:
I20260709 13:14:58.195447 30776 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 3 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.190203 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 331) took 1247 ms. Trace:
I20260709 13:14:58.107621   565 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.116885   593 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.071707   586 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:14:58.198187 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.203997 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.249693 30951 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:58.250613 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.257483 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.258424 30958 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
W20260709 13:14:58.259339   584 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.009s
I20260709 13:14:58.259883   440 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.260811   440 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.105446 32692 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.213960 31027 rpcz_store.cc:276] 0709 13:14:56.942540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.942712 (+   172us) service_pool.cc:224] Handling call
0709 13:14:56.948181 (+  5469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:56.981527 (+ 33346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:56.981560 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:56.991521 (+  9961us) log.cc:844] Serialized 26 byte log entry
0709 13:14:57.316709 (+325188us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.336327 (+ 19618us) log.cc:844] Serialized 14 byte log entry
0709 13:14:57.336528 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:57.336607 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:58.168173 (+831566us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b180045b200. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:14:58.187855 (+ 19682us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b180045b200. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:14:58.189967 (+  2112us) raft_consensus.cc:1685] finished
0709 13:14:58.189987 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.190123 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51514,"prepare.queue_time_us":22660,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3802,"raft.queue_time_us":89813,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13329,"spinlock_wait_cycles":63635456,"thread_start_us":295317,"threads_started":1,"wal-append.queue_time_us":347608}
I20260709 13:14:58.070006   416 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.072796   376 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
W20260709 13:14:58.145859   623 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.727s	user 0.005s	sys 0.021s
I20260709 13:14:58.212117 30957 rpcz_store.cc:276] 0709 13:14:56.919054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.113337 (+194283us) service_pool.cc:224] Handling call
0709 13:14:57.127152 (+ 13815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.785642 (+658490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.176063 (+390421us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54002909d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:58.176332 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513069952}
I20260709 13:14:58.216796 30882 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:58.191756 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.194643   619 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:58.245488 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.281044 30954 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:58.224000 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.213373 30877 rpcz_store.cc:276] 0709 13:14:57.102001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.103090 (+  1089us) service_pool.cc:224] Handling call
0709 13:14:58.185467 (+1082377us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54002aa154. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:58.185589 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75567360}
I20260709 13:14:58.261493 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.282367 30874 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.200433 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.266132 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.283571 30953 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:58.259502 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.283828 30879 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:14:58.269806 31604 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:58.116350   589 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:14:58.251624 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:58.210520 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.044s	sys 0.175s
W20260709 13:14:58.288908 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.045s	sys 0.175s
I20260709 13:14:58.215420   590 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:58.244158 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.286948 31603 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:58.196009   608 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.292626 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.308467 30958 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:58.215078   632 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.295631 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.295948 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:58.312970 31603 raft_consensus.cc:2410] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:14:58.313230 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:58.313495 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.297581   539 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.298971   586 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.291100   623 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.247934   556 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.303850 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.270964   408 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.291788 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.337680 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.338636 30954 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:58.146538   605 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.192231   635 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:58.310917 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.316207 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:58.248550   488 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:58.318827 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.320079 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1370) took 1452 ms. Trace:
I20260709 13:14:58.324184 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.355299 30955 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.329510 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36650 (request call id 85) took 1223 ms. Trace:
I20260709 13:14:58.330911 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.291816   379 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:14:58.333036   639 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.334898 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.336270 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1367) took 1468 ms. Trace:
I20260709 13:14:58.340807 30951 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 5.
I20260709 13:14:58.360924 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.344534 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.368750 31602 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:58.366117 30956 rpcz_store.cc:276] 0709 13:14:56.866856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.954662 (+ 87806us) service_pool.cc:224] Handling call
0709 13:14:58.335584 (+1380922us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54002b7854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:58.335707 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357887232}
I20260709 13:14:58.342365 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.287498   619 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:14:58.373307 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.374179 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.347409 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.338325   614 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.358103 30998 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:58.345118   308 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.304399   590 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.354909 32753 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.355561   408 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:58.362748 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 297803us
I20260709 13:14:58.363481 30878 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:58.143496   599 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.316901   608 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.344492 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:58.370718 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:58.422994 30848 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.764s (SENT)
W20260709 13:14:58.423187 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 78758.1us
I20260709 13:14:58.423962 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.371137 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.428342 30958 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:58.371649   603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.013s	sys 0.033s
I20260709 13:14:58.356894 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.378538 30879 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:58.276386   584 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.383224 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.386816 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.387223 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.387847 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:14:58.390499 31601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.097s	sys 0.206s
W20260709 13:14:58.437245 31601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.098s	sys 0.207s
I20260709 13:14:58.436208 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.392932 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.340236   556 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.366964   632 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:14:58.356106 31030 rpcz_store.cc:276] 0709 13:14:57.115255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.123731 (+  8476us) service_pool.cc:224] Handling call
0709 13:14:58.329184 (+1205453us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003778d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac60735 00007f273ac589fa 00007f273fc204c9 00007f273919cc54 00007f273919cbe2 00007f273919cb11 00007f273919ca8c 00007f273919bd42 00007f2738f9548c 00007f2738f948c6
0709 13:14:58.329404 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630156032}
I20260709 13:14:58.413100 31603 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:14:58.393684   591 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.163s	user 0.016s	sys 0.003s
W20260709 13:14:58.416929 30875 consensus_meta.cc:287] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.613s	user 0.015s	sys 0.005s
W20260709 13:14:58.395653   618 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.959s	user 0.015s	sys 0.004s
W20260709 13:14:58.418375 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 277941us
I20260709 13:14:58.419317 30998 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:58.451294 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.453919 30877 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.407430 31598 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:14:58.446841   610 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.655s	user 0.016s	sys 0.003s
W20260709 13:14:58.412925   638 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.031s
I20260709 13:14:58.409464   614 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:14:58.431806 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.412953   631 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:14:58.435024   603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.013s	sys 0.033s
I20260709 13:14:58.423456   440 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.455147 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.455440 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:58.441195   623 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:58.354849 30950 rpcz_store.cc:276] 0709 13:14:56.867665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.992672 (+125007us) service_pool.cc:224] Handling call
0709 13:14:57.444051 (+451379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:57.492588 (+ 48537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.319812 (+827224us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54001941d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:58.320005 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029967744}
I20260709 13:14:58.422442   634 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:14:58.436685   590 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.460561 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.461145 30878 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:14:58.461647 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 256141us
I20260709 13:14:58.481931 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:58.446810   539 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.470292 30958 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:14:58.462698 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adb189bd941147e0924cc38c9f01bd11 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:14:58.472616 30997 leader_election.cc:336] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.927s (SENT)
I20260709 13:14:58.475333 30877 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:58.430052 32753 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.448704 30875 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:58.436798   608 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.466199   614 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:58.479032 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.459923   635 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:58.499825   466 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:14:58.500093   635 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:58.472272   638 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.501108   635 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.502627   638 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:58.504763   556 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.492056   652 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:58.505649   652 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:58.506529   652 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.507085 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.507859 30875 raft_consensus.cc:2368] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3.
I20260709 13:14:58.508049 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 715) took 1004 ms. Trace:
I20260709 13:14:58.508874   605 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.508443 31601 rpcz_store.cc:276] 0709 13:14:57.503171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.503667 (+   496us) service_pool.cc:224] Handling call
0709 13:14:57.504033 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:57.511218 (+  7185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.511262 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:57.549754 (+ 38492us) log.cc:844] Serialized 26 byte log entry
0709 13:14:58.437885 (+888131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:58.437946 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.438049 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:58.507832 (+ 69783us) raft_consensus.cc:1685] finished
0709 13:14:58.507852 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.507990 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":932,"raft.queue_time_us":24180,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":10292,"thread_start_us":884104,"threads_started":1,"wal-append.queue_time_us":915917}
I20260709 13:14:58.481289   623 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.512005 30954 raft_consensus.cc:2393] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:14:58.512069   623 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.513958 32753 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:58.514667 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.487872   440 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:58.517040 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.517062 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:58.518158 31031 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:58.519409 31571 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.521727 30955 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:58.483748 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.458863   488 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:58.527397 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45551.6us
I20260709 13:14:58.529649   655 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.474300   308 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:58.531256   655 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.453181   591 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.533344 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1472) took 1210 ms. Trace:
I20260709 13:14:58.533538   408 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.534132   591 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.488122 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.534441 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:58.535499 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 72069.8us
I20260709 13:14:58.536893 31031 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:58.537314 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:14:58.537710   624 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.224s	user 0.002s	sys 0.011s
I20260709 13:14:58.538655 31598 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:58.480528   642 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.539453 31032 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:58.539616 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:58.540331 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:14:58.540679   379 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:58.540951 31026 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.541194   379 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:58.542259   379 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.544016 31027 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:58.544155   614 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.490540 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:58.545245   614 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:58.545691 31030 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:58.546274 31602 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:58.494202 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:14:58.476541   653 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:14:58.547452 31602 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:58.524686   657 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:58.549654 31029 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:14:58.549988 32726 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:58.535614 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.551152 30882 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:58.552038 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:58.552574 30882 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.495532   608 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.516109 30950 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.524290 30874 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:14:58.465435   416 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.613255 31602 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:14:58.524737 30958 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:58.524729 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:58.525214 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:58.527153   488 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.472034   631 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.614583   639 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:14:58.614732 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 91963.2us
I20260709 13:14:58.615091   631 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.541271 31031 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:14:58.491266 30848 leader_election.cc:336] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.688s (SENT)
W20260709 13:14:58.556950 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.616355 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.533706 30880 rpcz_store.cc:276] 0709 13:14:57.323014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.323273 (+   259us) service_pool.cc:224] Handling call
0709 13:14:57.340055 (+ 16782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.464753 (+124698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:57.464785 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:57.464855 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:57.464896 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.533083 (+1068187us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000d43d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:58.533128 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:58.533260 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286254336}
I20260709 13:14:58.617175 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:58.617568 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.617794   639 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:58.611936 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 83239.4us
I20260709 13:14:58.618209 30880 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:58.618695   639 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:58.614557 30957 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:14:58.619794   639 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.620472 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:58.561555 30955 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.507633   652 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.455260   619 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:58.612545 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.624449   619 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.626951   488 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.633131   631 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.634822 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.643450 30779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 349) took 8792 ms. Trace:
I20260709 13:14:58.645134 30874 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:14:58.636814 31025 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:58.638121 31026 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:58.534202   408 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:14:58.635270 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:58.667690   652 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.667825   651 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.668406   652 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.668668   651 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.670631   652 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.564152   584 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.611227   653 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.676290 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:58.676692 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 185438us
I20260709 13:14:58.677152 30874 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
W20260709 13:14:58.677614 30848 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.744s (SENT)
I20260709 13:14:58.678143 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.645434 30779 rpcz_store.cc:276] 0709 13:14:49.846122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:49.846452 (+   330us) service_pool.cc:224] Handling call
0709 13:14:58.638036 (+8791584us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:56.628226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:56.628866 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:56.628918 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:14:56.628938 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:56.629651 (+   713us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:56.629741 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:56.629771 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:14:56.630401 (+   630us) tablet.cc:701] Row locks acquired
0709 13:14:56.630453 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:14:56.630617 (+   164us) write_op.cc:270] Start()
0709 13:14:56.630765 (+   148us) write_op.cc:276] Timestamp: P: 1783602896630548 usec, L: 0
0709 13:14:56.630793 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:14:56.631458 (+   665us) log.cc:844] Serialized 2059 byte log entry
0709 13:14:56.824733 (+193275us) op_driver.cc:464] REPLICATION: finished
0709 13:14:56.986660 (+161927us) write_op.cc:301] APPLY: starting
0709 13:14:56.986810 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:56.987063 (+   253us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:56.987293 (+   230us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:56.988409 (+  1116us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:56.988785 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:14:56.988853 (+    68us) write_op.cc:312] APPLY: finished
0709 13:14:56.989292 (+   439us) log.cc:844] Serialized 47 byte log entry
0709 13:14:56.989543 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:56.989691 (+   148us) write_op.cc:454] Released schema lock
0709 13:14:56.989770 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:56.990253 (+   483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:56.990282 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5627,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":159151,"apply.run_cpu_time_us":3618,"apply.run_wall_time_us":4761,"num_ops":5,"prepare.queue_time_us":261990,"prepare.run_cpu_time_us":3692,"prepare.run_wall_time_us":32148,"replication_time_us":193767,"thread_start_us":296195,"threads_started":2}]]}
I20260709 13:14:58.682839 31031 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:58.666031   408 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.672567   539 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:14:58.703697 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68572.7us
I20260709 13:14:58.708667 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:14:58.681027   651 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.641819   416 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:58.712195 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 232250us
I20260709 13:14:58.712863   652 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:58.726874 30880 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:58.734879   587 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:58.735486   587 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.736239   532 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.737632   587 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.740025 32692 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:58.751703 30876 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:58.754906 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:58.758634   468 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.764915 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:58.768419 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 413) took 1788 ms (client timeout 1627 ms). Trace:
W20260709 13:14:58.768841 30952 rpcz_store.cc:269] 0709 13:14:56.979902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:56.996047 (+ 16145us) service_pool.cc:224] Handling call
0709 13:14:58.768250 (+1772203us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54001946d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:58.768348 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224769920}
I20260709 13:14:58.771275 31604 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:58.776520 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1383) took 1721 ms. Trace:
I20260709 13:14:58.777057 30949 rpcz_store.cc:276] 0709 13:14:57.055220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.096145 (+ 40925us) service_pool.cc:224] Handling call
0709 13:14:58.776248 (+1680103us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400255154. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:58.776441 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530386688}
I20260709 13:14:58.780169   622 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:58.767516   610 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:14:58.780741   622 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:14:58.781152   610 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:58.782066   610 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.781937   622 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.783684   610 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.691871   635 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:58.789297   635 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:58.789767   635 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.792297 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 639) took 1540 ms. Trace:
I20260709 13:14:58.792685 30996 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:58.792739 31597 rpcz_store.cc:276] 0709 13:14:57.251732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.251910 (+   178us) service_pool.cc:224] Handling call
0709 13:14:57.252227 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:57.421226 (+168999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.792023 (+1370797us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54004853d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:58.792209 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192720128}
I20260709 13:14:58.794570 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:58.784240   531 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:58.784442   589 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:58.797025   589 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:58.798079   589 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.800082   632 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.800735   632 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.804188 32753 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:58.804395 30998 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:58.804917 32753 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:58.805198   634 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:58.805372 32753 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:58.805665   634 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.806111   634 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.806402 32753 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.796288   531 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:58.803445   632 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:58.799701   589 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:58.824326   622 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:58.830480 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.832468   531 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:58.838515 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.841683 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 126188us
I20260709 13:14:58.842403 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:58.852809 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:58.857178 31602 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:14:58.859128 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 181550us
I20260709 13:14:58.709474   408 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:58.872280 30881 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:14:58.864987 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101805us
I20260709 13:14:58.865691   553 consensus_queue.cc:1059] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:14:58.866855 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.868054   657 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:14:58.868652 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 156957us
I20260709 13:14:58.868335 30776 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.710989   584 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.161s
W20260709 13:14:58.877388 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:58.840281   531 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:14:58.880580 30848 leader_election.cc:336] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.972s (SENT)
I20260709 13:14:58.710391 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:58.887303 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:58.926924 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:58.864159 31600 consensus_meta.cc:287] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.081s	user 0.010s	sys 0.022s
I20260709 13:14:58.714704   586 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:58.841085   603 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:58.681695   653 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:58.953801 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:58.954617 30776 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:58.987633 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 277324us
I20260709 13:14:58.873737   546 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.711182   590 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.181s
I20260709 13:14:58.879555   652 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:58.859241   488 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:14:59.003623   542 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.012104 30924 leader_election.cc:400] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3.
I20260709 13:14:58.862479   565 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:14:58.860055   639 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:14:59.021564 30997 leader_election.cc:400] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:14:59.022760 30924 leader_election.cc:403] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:14:58.858942   556 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:14:58.859897   440 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:14:58.946633   632 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:14:58.874239   638 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:14:59.039527 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:59.039362 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:59.042728 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:59.044127 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:14:58.952780   630 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.044893   630 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:58.996999 32692 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:58.988204 31600 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
W20260709 13:14:59.023191 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 142636us
I20260709 13:14:59.045919 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 723) took 1446 ms. Trace:
I20260709 13:14:59.046279 31600 rpcz_store.cc:276] 0709 13:14:57.599125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.781167 (+182042us) service_pool.cc:224] Handling call
0709 13:14:59.045836 (+1264669us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:14:59.047410 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.048024 31600 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:58.950706   591 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
W20260709 13:14:59.040387 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 165658us
W20260709 13:14:59.051304 30848 leader_election.cc:336] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.001s (SENT)
I20260709 13:14:59.013113   599 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.050427 30776 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 2 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.035935   590 consensus_queue.cc:1243] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:14:59.036688   539 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.055411 30878 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:59.039026 31597 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:14:59.065673 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:58.974308   531 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.069087 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47661.6us
I20260709 13:14:59.051064   584 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.068217   553 raft_consensus.cc:3055] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.018110   586 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.076319   655 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.077275   416 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.060484   632 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.078081 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.079057 30949 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:59.080044 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.050928 32761 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:14:59.081009   623 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.000s
W20260709 13:14:59.088234 30848 leader_election.cc:336] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.113s (SENT)
I20260709 13:14:59.203590 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:59.048902 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:59.125082 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.052042   634 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.022176   546 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.205013   605 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.069535   659 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:59.036507   542 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.131978   670 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:14:59.132896   660 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:14:59.134502 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.134330   408 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.210749 31600 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:14:59.135130   665 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:14:59.135306 30879 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:14:59.135470 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.136821   586 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:14:59.136955   662 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:14:59.140190   587 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:59.210975   622 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:14:59.143472   661 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:14:59.145023 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.052484   664 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:14:59.134567   539 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.146466   655 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:14:59.148006 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:59.148407   658 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:14:59.207226   623 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.112399   553 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:59.053277   635 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.153869 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 701) took 1382 ms. Trace:
W20260709 13:14:59.248299 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 372736us
I20260709 13:14:59.248383 31601 rpcz_store.cc:276] 0709 13:14:57.771373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.510469 (+739096us) service_pool.cc:224] Handling call
0709 13:14:58.510783 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.510995 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:14:58.705580 (+194585us) log.cc:844] Serialized 14 byte log entry
0709 13:14:59.153406 (+447826us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b1800388d80. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287
0709 13:14:59.153510 (+   104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:59.153559 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:59.153607 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.153676 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.153809 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17331,"prepare.queue_time_us":375476,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":61210,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":15860480,"thread_start_us":475757,"threads_started":3,"wal-append.queue_time_us":378565}
I20260709 13:14:59.249976 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.018180   668 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:14:59.171661 30882 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:14:59.185081 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:59.190814 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.251190 30882 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
W20260709 13:14:59.151737   667 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:14:59.189992 30953 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:59.052654   669 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:59.083005   590 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
W20260709 13:14:59.166535 31599 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.000s
I20260709 13:14:59.129498   674 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.204952   416 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.154186   568 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:14:59.155580   620 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:59.215932 31602 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:59.203979   651 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.289567 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.290408 30953 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:14:59.210852   659 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.124675 32692 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:14:59.205385   657 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:14:59.219909 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 131716us
I20260709 13:14:59.222836 31603 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:14:59.125368   440 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.218412   630 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.152119   652 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.223301   587 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:59.212934   605 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.245294 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 97370.5us
I20260709 13:14:59.247139 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.250574 30956 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:59.256301 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.256547 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:59.257557 31605 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:14:59.307116 30879 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
W20260709 13:14:59.253710 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 366920us
I20260709 13:14:59.245214   684 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.320631   587 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.260468 30949 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:59.321372 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 500) took 1055 ms. Trace:
I20260709 13:14:59.321723   587 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.321744 30880 rpcz_store.cc:276] 0709 13:14:58.266390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.728533 (+462143us) service_pool.cc:224] Handling call
0709 13:14:58.728824 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.946017 (+217193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.946441 (+   424us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:59.002073 (+ 55632us) log.cc:844] Serialized 26 byte log entry
0709 13:14:59.220379 (+218306us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:59.220439 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.220526 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.321151 (+100625us) raft_consensus.cc:1685] finished
0709 13:14:59.321173 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.321298 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171459,"raft.queue_time_us":158005,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":60658,"thread_start_us":177854,"threads_started":1,"wal-append.queue_time_us":235752}
I20260709 13:14:59.323529   531 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.323902 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:59.324440 30880 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:14:59.252913   622 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.327900   634 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:59.328138   542 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.328035   622 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.284761 30952 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:59.330181   622 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.240583   539 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.332275   539 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.294488 30878 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:59.333386 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:59.334115   684 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.334481 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.335225 30878 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:14:59.296008 30848 leader_election.cc:336] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.124s (SENT)
I20260709 13:14:59.261490   669 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:59.293557   568 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:14:59.322188   635 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.296850   468 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:14:59.297104   664 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:59.341614   568 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.342160   664 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.342634   619 consensus_meta.cc:287] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.000s
I20260709 13:14:59.342934   568 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.344347   673 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.344574   664 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.344764   673 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:59.345283 30878 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:59.346130   584 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3.
I20260709 13:14:59.312081 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.345284   546 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:59.309780 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.347575 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.260275 31599 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:14:59.312820   408 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.313663   632 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.348039 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 489) took 1305 ms. Trace:
I20260709 13:14:59.315830 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:59.348450 30883 rpcz_store.cc:276] 0709 13:14:58.042714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.043003 (+   289us) service_pool.cc:224] Handling call
0709 13:14:58.079186 (+ 36183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.461981 (+382795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.462000 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:58.492675 (+ 30675us) log.cc:844] Serialized 26 byte log entry
0709 13:14:58.691964 (+199289us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:14:58.692016 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.692105 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.347841 (+655736us) raft_consensus.cc:1685] finished
0709 13:14:59.347860 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.347983 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73410,"raft.queue_time_us":139181,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":378383,"threads_started":2,"wal-append.queue_time_us":488935}
W20260709 13:14:59.349699   610 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.001s
I20260709 13:14:59.343264 31598 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:14:59.349951 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:59.350234   610 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.350992   610 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.314009   605 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.351274 30997 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:59.317519 30879 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:14:59.351979 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55991.4us
I20260709 13:14:59.353199 30998 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:59.353287 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:59.319715   683 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:14:59.348462   632 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.354444   539 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:14:59.354538   632 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:14:59.355043   539 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.356762   632 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:59.316079 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.357065   539 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.357591   539 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.357954 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.359082   638 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:59.284454   676 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.293130 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:14:59.332300 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75823.4us
W20260709 13:14:59.309196 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 226634us
I20260709 13:14:59.345715   673 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.312371   675 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:14:59.316514   630 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.353472   635 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.297632   659 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.384434 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.320889   623 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.323061   593 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:59.386672   632 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.387009   593 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:59.387184   632 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.388185 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 95159.6us
I20260709 13:14:59.389937 30848 leader_election.cc:400] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 5.
I20260709 13:14:59.360867 30882 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:59.390558 30848 leader_election.cc:403] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:59.391510 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:14:59.387032 30996 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:59.372045 30880 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:14:59.377382 30883 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:14:59.301613 32692 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:14:59.378328 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.359611   638 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:59.295259   379 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:14:59.295475   416 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.343472   679 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:14:59.413719   416 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.414310 32761 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.414702 32761 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:59.301893   440 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.415489 32761 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.419157 30957 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:14:59.372622   584 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.341648   669 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.297843   687 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:14:59.389882 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.392887 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:59.318653 31596 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:14:59.385342   673 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:59.396731 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.367506   556 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.383957 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.367374   546 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.387923   593 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.399509   657 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.446521 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:59.388317   635 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.405197 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 494) took 1222 ms. Trace:
W20260709 13:14:59.455814 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 85383.4us
W20260709 13:14:59.456859 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.415480 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.411435 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:14:59.416929 31601 raft_consensus.cc:2410] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:14:59.421244 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.477990 30880 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:14:59.423480 30951 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
W20260709 13:14:59.437422 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52565.9us
I20260709 13:14:59.437989 30878 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 2: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:14:59.357993   539 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.436679 30879 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:14:59.438931 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.419891 32761 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.393309   610 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.397341 32692 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:14:59.417171   614 consensus_meta.cc:287] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.857s	user 0.007s	sys 0.006s
I20260709 13:14:59.443616 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:59.415627   634 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.421000   468 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.501523   632 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.448032 30877 rpcz_store.cc:276] 0709 13:14:58.182484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.725313 (+542829us) service_pool.cc:224] Handling call
0709 13:14:58.725639 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.887234 (+161595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.887264 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:58.953198 (+ 65934us) log.cc:844] Serialized 26 byte log entry
0709 13:14:59.162614 (+209416us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:59.162653 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.162720 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.404984 (+242264us) raft_consensus.cc:1685] finished
0709 13:14:59.405005 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.405141 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182406,"raft.queue_time_us":167978,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7854,"thread_start_us":135155,"threads_started":1,"wal-append.queue_time_us":222630}
W20260709 13:14:59.474895 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48273.6us
I20260709 13:14:59.475239 30956 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:14:59.406741   653 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.377214   676 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.364012   553 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.425516   622 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.425859   618 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.294517   674 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.483568 30998 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:14:59.474069   556 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.498569 30880 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:14:59.499032 30954 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:14:59.531991 30954 pending_rounds.cc:85] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 5
I20260709 13:14:59.532296 30954 pending_rounds.cc:107] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:14:59.532581 30954 raft_consensus.cc:2889] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:59.499635 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.503780 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:14:59.475685 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 124468us
I20260709 13:14:59.433859   584 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:14:59.507088 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.509347 31598 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:14:59.489115 32726 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.490159   440 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.518741   618 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.519207   686 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:14:59.520088   685 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:14:59.524876   681 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:14:59.527141   676 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.505327 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.440405   600 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:14:59.540686 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:59.509410   684 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.514487   468 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:59.514896   634 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:14:59.514065   638 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.593355 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.624568 30957 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
W20260709 13:14:59.626116 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 145519us
I20260709 13:14:59.626899 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:14:59.630228 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 113288us
I20260709 13:14:59.624035 31602 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:14:59.632849 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:59.633953 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.634377 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.635149 31602 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:14:59.560467 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1483) took 1059 ms. Trace:
I20260709 13:14:59.646492 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.647387 30877 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:14:59.636091 30876 rpcz_store.cc:276] 0709 13:14:58.500742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.753386 (+252644us) service_pool.cc:224] Handling call
0709 13:14:58.753675 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.862950 (+109275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.862977 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:58.886095 (+ 23118us) log.cc:844] Serialized 26 byte log entry
0709 13:14:59.259535 (+373440us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:14:59.259572 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.259701 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:59.560200 (+300499us) raft_consensus.cc:1685] finished
0709 13:14:59.560228 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:59.560394 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163133,"raft.queue_time_us":109405,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":21283,"thread_start_us":234353,"threads_started":1,"wal-append.queue_time_us":255038}
I20260709 13:14:59.684595 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:14:59.722947 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 100266us
W20260709 13:14:59.683609 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56812.2us
W20260709 13:14:59.686154 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.724968 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:14:59.554034   686 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:59.726737 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.543705 32726 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.724139 32753 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:14:59.725684 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.746269 31598 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:14:59.622128 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:59.646993   695 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:14:59.578105   440 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:14:59.558274   614 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:59.730347 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 189766us
I20260709 13:14:59.730132   599 raft_consensus.cc:2764] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:14:59.564536 32692 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.620571   539 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.736068   556 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.736303   634 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.731662   622 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 5.
I20260709 13:14:59.723569   676 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.739969   546 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:59.791337   546 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.791741   546 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:14:59.793512 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet adb189bd941147e0924cc38c9f01bd11 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:14:59.793949 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69046.8us
I20260709 13:14:59.794721   468 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.749850   630 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.683785   691 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.560029   590 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.796327   654 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:14:59.797030 32692 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.724133   653 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:59.722901   610 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:14:59.797899   610 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:59.798321   610 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:59.799018 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:14:59.790957   676 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.796634   691 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.796674   590 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.747394 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.787071 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:14:59.748059   686 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:14:59.853250 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.867813 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 143888us
I20260709 13:14:59.787892   635 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.782549 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.910766 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:14:59.876405   698 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.126s	user 0.009s	sys 0.000s
I20260709 13:14:59.887799   599 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:14:59.891503 31599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 699) took 2120 ms (client timeout 2214 ms). Trace:
I20260709 13:14:59.893692   488 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:59.898876 32726 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:14:59.899556 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.947450 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.901393 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:14:59.903556 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 700) took 2132 ms. Trace:
W20260709 13:14:59.948781 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 149845us
I20260709 13:14:59.905203 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:14:59.949783 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.815088   622 raft_consensus.cc:2764] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:14:59.910818 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:59.931743 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.940845 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:14:59.933979 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 147010us
I20260709 13:14:59.945852 30877 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:14:59.788841   614 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.947013   379 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:14:59.956610   679 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:59.957216   488 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:14:59.957540   590 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:14:59.957157   679 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.884264 31598 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:14:59.958190   488 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:14:59.958802 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:14:59.959414   679 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.960168 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:14:59.960737 31598 raft_consensus.cc:2376] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
I20260709 13:14:59.948084 31603 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:14:59.948980 31605 rpcz_store.cc:276] 0709 13:14:57.771108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.434002 (+662894us) service_pool.cc:224] Handling call
0709 13:14:58.446591 (+ 12589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:59.307490 (+860899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:59.903304 (+595814us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54007d50d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:14:59.903492 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864518016}
I20260709 13:14:59.883246   674 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:14:59.962342 30874 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:14:59.965170 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.934682 31600 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:14:59.967325 30883 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:59.946303 32761 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:14:59.947278 31599 rpcz_store.cc:269] 0709 13:14:57.770845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.781945 (+ 11100us) service_pool.cc:224] Handling call
0709 13:14:59.891221 (+2109276us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54007143d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:14:59.891394 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547636992}
I20260709 13:14:59.968679 31605 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:14:59.955544   652 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:59.969612   379 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.970909 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:14:59.972658 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:00.017966 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45408.6us
I20260709 13:14:59.973484 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:00.017462 30879 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
W20260709 13:15:00.022136 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.977618 30878 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
W20260709 13:14:59.946378   659 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.016s
I20260709 13:14:59.995698 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:14:59.993760 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:14:59.945624   568 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:15:00.001705 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:00.015245 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:59.974021   619 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:00.031176 30847 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:00.031952   654 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:00.032332   654 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.032634   654 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:59.996892   599 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:00.040218 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:00.043367 31605 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:00.017201   379 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:00.002230   652 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.068500   652 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.068997   379 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.070574   379 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:00.040261 30997 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:00.073519 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:00.074991 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:00.076628 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.051626 31600 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:15:00.052395   697 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:15:00.055989 31598 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:15:00.058233 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 108703us
I20260709 13:15:00.090571 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:00.092023 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.058892   599 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:14:59.994953   590 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:15:00.060933   614 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:14:59.998476 32761 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.038029   702 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.095021 32726 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.097179   556 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.134922 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:00.089952   684 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.089747 32753 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.139144 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:00.140189 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:00.140753 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.141785   618 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.141969 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:00.142382   618 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.142987   614 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.064906   676 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:15:00.042097   440 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:00.118440   610 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:15:00.156800   440 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.157358   440 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.039081   659 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.047721   622 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:00.066812   691 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.120371   546 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.162793   546 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.101943 32761 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:00.164649   659 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.166116 30958 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:00.123018 31600 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:15:00.167783   416 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:00.168355   416 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:00.169433   416 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.180665   416 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:00.180886 31596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 716) took 2677 ms (client timeout 2131 ms). Trace:
W20260709 13:15:00.181330 31596 rpcz_store.cc:269] 0709 13:14:57.503465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:57.506810 (+  3345us) service_pool.cc:224] Handling call
0709 13:15:00.180659 (+2673849us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400642dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:00.180776 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3603299200}
I20260709 13:15:00.183393 30882 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:00.093231 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.097440 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:00.098461   542 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.103677   590 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:00.105400 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:00.184377   542 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.184445 30883 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:00.184876 30882 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:00.184989   542 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.185433   633 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.118412 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:00.142897   618 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:00.184363 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 91220.7us
W20260709 13:15:00.185030 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 79735.2us
I20260709 13:15:00.190917 30847 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:00.145344 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.145808   631 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.064698 30877 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:15:00.147476 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:00.147892 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:00.192833 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47579.4us
I20260709 13:15:00.194913 31602 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:00.148206 32753 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.208148 32753 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.210253 32753 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.210781   659 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.211001   488 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.211241   659 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.211632   659 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.217016 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:00.152657 30874 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:00.219698   593 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.152302 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:00.221601 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 69403.4us
I20260709 13:15:00.184504   590 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:00.198190   622 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.198999 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:00.200129   691 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.200191 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:00.201969   440 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.203315   584 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.247002 31026 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.203938 30878 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:15:00.247903 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.248049 30950 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:00.248246 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.248647 31027 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:00.247015 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.250174   553 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.252112   591 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.252609   591 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:00.253576   591 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.254840 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.205695 32726 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.256135 32726 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:00.256697 32726 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.258358 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:00.258967 30951 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:00.259977 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:00.260582 30952 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:00.262602 30958 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.265128 30876 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:00.266098 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:00.205003   614 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:00.207108   684 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:00.271050 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.271869 31025 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:15:00.274323 32726 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.277997 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:00.195412 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48059us
I20260709 13:15:00.207607 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:00.278986 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 71448.7us
I20260709 13:15:00.217211   618 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.232509 30922 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.234869 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:00.280185 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47750.6us
I20260709 13:15:00.236847 32692 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:00.237610 32753 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:00.239209   630 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.242123   632 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:00.242383 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.287595 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.232236   635 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.230401   539 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.243791   669 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:00.244616 31028 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.245136 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.245257 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.245487   590 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.228448   622 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:00.246198 31029 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.278175 31600 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.255026   591 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.266391   600 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:00.279597 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:00.232175 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:00.235392   532 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.286821   605 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:00.288064 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:00.358665 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 70676.7us
W20260709 13:15:00.289280 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 61533.2us
I20260709 13:15:00.318079   618 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.228403   610 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:00.320744 30876 raft_consensus.cc:2368] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:15:00.246291 31032 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:15:00.353415 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 73880.6us
I20260709 13:15:00.367823 31032 pending_rounds.cc:85] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 7
I20260709 13:15:00.368112 31032 pending_rounds.cc:107] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:15:00.368379 31032 raft_consensus.cc:2889] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:00.369534 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.288017 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.285346   614 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.288028 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.371752 31030 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:00.358192 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.372571 31029 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:00.320333   539 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.233032   546 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:15:00.362540 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:00.318078   635 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.380059 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.381313 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:00.320554   669 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:00.281773   652 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.335278   622 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.377349 31602 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:00.356602 32753 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.378986 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.358163   605 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.375025   539 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.361637 32761 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:00.363411 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:00.385378   584 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.425369 30950 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:00.425559   584 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.417071   653 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:15:00.428041 32726 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.416086 32753 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:00.429427   440 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.429446 32753 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.318356   691 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:15:00.430876   546 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:00.384166   590 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.431443   546 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.434056   546 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.435683   556 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.384681   635 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.374739   614 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.417682 31029 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:00.330090   632 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.361538   532 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.414633 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.384611   308 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:00.321492   630 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.430066   440 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.363400   702 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.377031   639 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:00.360406   651 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:00.404619   676 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:00.443403 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.442046   709 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.421377   605 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.413034 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:00.440152 32761 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:00.476500 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 278884us
I20260709 13:15:00.499864 32761 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:00.502066   705 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:15:00.503679   706 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:15:00.503954   556 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:00.505393   556 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:00.508622 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.509330   532 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.403578   673 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:15:00.510712 31025 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:00.374748   618 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.442278   614 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.479425 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.412951   379 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:15:00.484781   651 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.487296   440 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:00.489799   542 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:00.474771   687 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.485415   584 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.485894   676 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:00.495712   709 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:00.515414 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 228993us
W20260709 13:15:00.536572 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.537016 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.537374 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.516646 31029 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:00.518148 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.539330 31024 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:00.540361 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.541028 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:00.541872 31032 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:00.547937 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.534538 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.548372 31602 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:00.549994 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:00.551332 31024 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:00.528162 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:00.567881 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.519809   308 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:15:00.568548 31032 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:15:00.569195   654 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.004s
I20260709 13:15:00.569715   654 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.570888 30877 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:00.575047 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.576407 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.578331 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:00.578889 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.579715 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:00.543948   676 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:00.583899 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.584704 31025 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:00.585824 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.587222 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.588572   710 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.589334   710 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.590153   532 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:00.590703   379 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:00.593209   630 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.593202 32761 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.595920   440 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.596472   440 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:00.597033   542 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.597633   542 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:00.597765   440 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:00.598929   542 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.599309   542 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.544287   539 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.530969   687 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.601610 31031 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:00.603196   721 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:00.604526 32761 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.605430   633 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:00.513309   639 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:00.587302   686 consensus_meta.cc:287] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.701s	user 0.004s	sys 0.004s
I20260709 13:15:00.599685   542 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.635731   308 consensus_queue.cc:1243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:00.637331   639 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.566457   556 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:00.563524   600 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:00.632424 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 177854us
I20260709 13:15:00.643507 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:00.597057   654 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.608927   687 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:00.660784 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:00.661748 30874 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:00.629140 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:00.636363   673 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:00.664613 30880 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:00.670186 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:00.672142 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.600745 32726 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:15:00.692279 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.657857 31026 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:00.679495 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:00.687116 30998 leader_election.cc:400] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:15:00.694236 30998 leader_election.cc:403] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:15:00.687656 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 466549us
I20260709 13:15:00.698683 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:00.650126   600 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.649221   556 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:00.608170   676 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:00.712008 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 348372us
W20260709 13:15:00.718017 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45973.5us
I20260709 13:15:00.668488 32761 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:00.752436   711 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:00.752676 32761 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:00.686633   634 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.753294 32761 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.753407   634 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.754274 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.754868 31029 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:15:00.737041   715 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:00.740842 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:00.744936   709 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.746081 31600 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:00.747169   605 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.748035   725 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:00.749397   632 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:00.751600   553 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
I20260709 13:15:00.751731 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:00.712648   639 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:15:00.642230   635 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.650987   686 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:00.796285 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:01.231542 31025 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:01.027652 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:01.232450 31031 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:01.225443 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:01.233579 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:01.234184 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.233948 31603 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:00.814558 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:01.025909 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:00.770450 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.236003 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 656295us
W20260709 13:15:01.236693 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.822610 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:01.237457 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:00.951316 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 272391us
I20260709 13:15:00.755698 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:00.698912   674 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:00.686851   654 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:00.765740 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 50424.3us
I20260709 13:15:01.001365 31028 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.235699 31605 raft_consensus.cc:2368] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:01.236922 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:01.240700 31026 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:01.240453 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:00.779150 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:01.240430 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:01.238246 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.687412   618 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:00.670454   710 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:00.676319   673 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:01.463490 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:01.701483 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 449) took 1023 ms. Trace:
I20260709 13:15:01.795250 30924 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:01.102519   590 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.670s	user 0.005s	sys 0.006s
I20260709 13:15:01.591970   676 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:01.437101   468 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.721771   556 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:00.907899 32753 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:00.758476   652 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:01.467355 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:01.462069 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2087) took 1554 ms. Trace:
W20260709 13:15:01.815234 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 578310us
I20260709 13:15:01.816426 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:00.990041   539 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:01.371418 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:01.712057 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:01.821859 30880 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:00.747169   488 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.001s
I20260709 13:15:01.714303 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 357) took 1110 ms. Trace:
I20260709 13:15:01.823987 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2255) took 1124 ms. Trace:
I20260709 13:15:01.824047 31026 rpcz_store.cc:276] 0709 13:15:00.604095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.751461 (+147366us) service_pool.cc:224] Handling call
0709 13:15:01.714171 (+962710us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:00.751828   718 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:15:00.992828   622 consensus_meta.cc:287] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 13:15:00.755617   634 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:01.438326   591 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.080s	user 0.012s	sys 0.000s
W20260709 13:15:01.046944   659 consensus_meta.cc:287] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.835s	user 0.007s	sys 0.003s
W20260709 13:15:01.102826   707 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.659s	user 0.003s	sys 0.002s
I20260709 13:15:01.701100   635 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:01.370833 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 659) took 1182 ms. Trace:
I20260709 13:15:00.811826   724 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.041s
I20260709 13:15:01.467329 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:01.708678 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 748) took 1106 ms. Trace:
I20260709 13:15:01.855288 31605 rpcz_store.cc:276] 0709 13:15:00.602316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.602469 (+   153us) service_pool.cc:224] Handling call
0709 13:15:01.025701 (+423232us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:01.708577 (+682876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49864064}
I20260709 13:15:01.856864 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:01.701460 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:01.616647 30776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 245) took 11533 ms (client timeout 15000 ms). Trace:
I20260709 13:15:01.707520   674 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.436700   657 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.776151 31604 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:15:01.776728 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 62794.5us
I20260709 13:15:01.777449 30879 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:01.867419 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 521) took 1069 ms. Trace:
I20260709 13:15:01.510426 30996 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:01.507552   639 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.778210   379 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.779838   679 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.144519   619 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.882258 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:01.780141   568 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:01.780427   633 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.781390   654 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:01.784623 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.786960 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.888808 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.889081 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:01.788302   416 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.464051 31598 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:01.788683   605 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:01.484534 31027 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:01.463999   308 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.735628   553 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:01.568112 31596 raft_consensus.cc:2368] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
W20260709 13:15:01.483398 30923 leader_election.cc:336] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.854s (SENT)
I20260709 13:15:01.409493 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:01.101604   723 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.794270 31601 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:00.980533   730 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.794878 31603 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.815157 30877 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:01.909631 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 522) took 1063 ms. Trace:
I20260709 13:15:01.910153 30877 rpcz_store.cc:276] 0709 13:15:00.846442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.032816 (+186374us) service_pool.cc:224] Handling call
0709 13:15:01.467194 (+434378us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:01.909497 (+442303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7178240}
I20260709 13:15:01.850673 31600 rpcz_store.cc:276] 0709 13:15:00.188494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.199855 (+ 11361us) service_pool.cc:224] Handling call
0709 13:15:01.243458 (+1043603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:01.823486 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:01.824497 31025 rpcz_store.cc:276] 0709 13:15:00.699600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.247914 (+548314us) service_pool.cc:224] Handling call
0709 13:15:01.823923 (+576009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:01.172771   546 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:00.929796   728 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.734200   600 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:01.815636 30881 rpcz_store.cc:276] 0709 13:14:59.907794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.916603 (+  8809us) service_pool.cc:224] Handling call
0709 13:14:59.939581 (+ 22978us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:59.979069 (+ 39488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:59.979100 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:00.026696 (+ 47596us) log.cc:844] Serialized 582 byte log entry
0709 13:15:00.375257 (+348561us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:00.375294 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.375371 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:01.461842 (+1086471us) raft_consensus.cc:1685] finished
0709 13:15:01.461870 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:01.462007 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6132,"thread_start_us":314881,"threads_started":1,"wal-append.queue_time_us":520009}
I20260709 13:15:01.794780 30780 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:01.789083   649 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:01.525233   697 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:01.782111   686 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:01.908519   586 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.483979   735 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:01.558518   699 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:01.378638 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:01.943070 31031 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.877425   657 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.831982   710 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:01.860545 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:01.887120   679 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.923631   546 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:01.861570 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:01.902382   723 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:01.860790 30880 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:01.867801 30879 rpcz_store.cc:276] 0709 13:15:00.797710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.798300 (+   590us) service_pool.cc:224] Handling call
0709 13:15:01.867359 (+1069059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43776}
I20260709 13:15:01.864985 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:01.823698   440 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:01.841617   677 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.876343 30951 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:01.845062   634 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.881296 31023 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:01.851058   591 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.821974   468 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.886554 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:01.992385 30958 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:01.866940   674 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:01.892443 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:01.846063   709 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:15:01.895093   416 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.899483 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:01.968729   710 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:01.869588 32692 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:01.847311   659 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:01.861573   749 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:01.908094 31029 consensus_meta.cc:287] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.003s
I20260709 13:15:01.919934   730 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:01.794872 30957 rpcz_store.cc:276] 0709 13:15:00.677893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.678960 (+  1067us) service_pool.cc:224] Handling call
0709 13:15:00.679349 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:00.679611 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:01.161244 (+481633us) log.cc:844] Serialized 14 byte log entry
0709 13:15:01.701000 (+539756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:01.701064 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:01.701118 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.701209 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:01.701402 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34034,"prepare.queue_time_us":688366,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":616483,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":416,"thread_start_us":380222,"threads_started":1,"wal-append.queue_time_us":284750}
I20260709 13:15:01.907079 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:02.018628 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 111653us
I20260709 13:15:02.020269 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:01.922883 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:01.999037   591 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:01.858907 30776 rpcz_store.cc:269] 0709 13:14:50.042126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.108003 (+ 65877us) service_pool.cc:224] Handling call
0709 13:15:01.575714 (+11467711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:59.438123 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:59.594998 (+156875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:59.603920 (+  8922us) write_op.cc:435] Acquired schema lock
0709 13:14:59.605447 (+  1527us) tablet.cc:662] Decoding operations
0709 13:14:59.609200 (+  3753us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:59.609254 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:59.609279 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:14:59.609660 (+   381us) tablet.cc:701] Row locks acquired
0709 13:14:59.609693 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:14:59.609864 (+   171us) write_op.cc:270] Start()
0709 13:14:59.609971 (+   107us) write_op.cc:276] Timestamp: P: 1783602899609786 usec, L: 0
0709 13:14:59.609990 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:14:59.615743 (+  5753us) log.cc:844] Serialized 1674 byte log entry
0709 13:15:00.546256 (+930513us) op_driver.cc:464] REPLICATION: finished
0709 13:15:01.367920 (+821664us) write_op.cc:301] APPLY: starting
0709 13:15:01.368030 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:01.368232 (+   202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:01.368383 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:01.369096 (+   713us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:01.369352 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:15:01.369417 (+    65us) write_op.cc:312] APPLY: finished
0709 13:15:01.369708 (+   291us) log.cc:844] Serialized 41 byte log entry
0709 13:15:01.369922 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:01.370045 (+   123us) write_op.cc:454] Released schema lock
0709 13:15:01.370115 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:01.465469 (+ 95354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:01.484088 (+ 18619us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1337674,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":816048,"apply.run_cpu_time_us":2630,"apply.run_wall_time_us":5897,"num_ops":4,"prepare.queue_time_us":228976,"prepare.run_cpu_time_us":51871,"prepare.run_wall_time_us":330817,"raft.queue_time_us":496344,"raft.run_cpu_time_us":32644,"raft.run_wall_time_us":492605,"replication_time_us":902810,"thread_start_us":851373,"threads_started":4,"wal-append.queue_time_us":253538}]]}
I20260709 13:15:01.933776 30780 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 3, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:01.810933   698 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.250s	user 0.005s	sys 0.007s
I20260709 13:15:01.883442   639 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.916316 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 662) took 1201 ms. Trace:
I20260709 13:15:01.917266   605 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:01.885877   379 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.189358 32761 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.887370   619 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.870752   673 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.942629   649 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:01.952600 30954 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:15:01.957274   725 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:15:01.956938   556 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:01.942094 31604 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:02.107515 31604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 663) took 1397 ms (client timeout 1570 ms). Trace:
I20260709 13:15:01.965891 31032 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:01.893965   568 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.040942   669 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:01.936563   733 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:15:02.108093 31604 rpcz_store.cc:269] 0709 13:15:00.710026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.710177 (+   151us) service_pool.cc:224] Handling call
0709 13:15:02.107424 (+1397247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:01.845603   539 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.970146 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 523) took 1038 ms. Trace:
I20260709 13:15:01.966244   586 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.972532   634 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.903707   308 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.970155   686 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.973618   679 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:01.974138   750 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:01.974915   631 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:01.897634   633 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.121820 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:01.977217   657 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:01.977288 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 746) took 1430 ms. Trace:
I20260709 13:15:01.911613   553 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.978065 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1512) took 1329 ms. Trace:
I20260709 13:15:02.131346 30876 rpcz_store.cc:276] 0709 13:15:00.649112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.649283 (+   171us) service_pool.cc:224] Handling call
0709 13:15:00.649695 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:00.650089 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:00.650128 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:00.651886 (+  1758us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.132039 (+480153us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b180021da80. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:01.506479 (+374440us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:01.506540 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.506636 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:01.977777 (+471141us) raft_consensus.cc:1685] finished
0709 13:15:01.977795 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:01.978007 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23233,"raft.queue_time_us":4054,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12594,"spinlock_wait_cycles":16016256,"thread_start_us":374188,"threads_started":1,"wal-append.queue_time_us":1200028}
W20260709 13:15:01.978966 31601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 657) took 2236 ms (client timeout 2862 ms). Trace:
I20260709 13:15:01.978472   546 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:01.970661 30883 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:01.969915 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2258) took 1016 ms. Trace:
I20260709 13:15:01.986155   723 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:01.973651   677 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.986874 31600 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:01.933674   724 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:01.941049   651 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.404s	user 0.010s	sys 0.002s
I20260709 13:15:01.990253 31031 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:02.172768 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2259) took 1184 ms. Trace:
I20260709 13:15:01.994222 31030 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:01.940239   751 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:02.003034 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 347) took 1741 ms (client timeout 1931 ms). Trace:
W20260709 13:15:02.005146 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 337) took 1753 ms (client timeout 1910 ms). Trace:
W20260709 13:15:02.176541 31027 rpcz_store.cc:269] 0709 13:15:00.252732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.254542 (+  1810us) service_pool.cc:224] Handling call
0709 13:15:01.993793 (+1739251us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003f57d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:01.994015 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2825696128}
W20260709 13:15:02.006868 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 523454us
W20260709 13:15:02.176960 31023 rpcz_store.cc:269] 0709 13:15:00.244208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.245010 (+   802us) service_pool.cc:224] Handling call
0709 13:15:01.996995 (+1751985us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540009e2d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:01.997110 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3468453760}
I20260709 13:15:02.175781   765 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.877915   652 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.944655 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 646) took 2583 ms. Trace:
I20260709 13:15:02.014130 31029 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:01.971634   744 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:01.842100   622 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:01.935717   728 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.021795 31025 raft_consensus.cc:2368] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4.
I20260709 13:15:01.927502 30881 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:02.210160 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2260) took 1108 ms. Trace:
W20260709 13:15:02.210719 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.023311 30780 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 4, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.032550 30958 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:02.210501 31025 rpcz_store.cc:276] 0709 13:15:01.102146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.918678 (+816532us) service_pool.cc:224] Handling call
0709 13:15:02.210097 (+291419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.035923 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 517) took 1302 ms. Trace:
I20260709 13:15:02.045641 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 518) took 1311 ms. Trace:
I20260709 13:15:02.212539 30780 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 2, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:02.050452 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 540104us
I20260709 13:15:02.118417   539 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:02.054252 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 230845us
I20260709 13:15:02.054502   763 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:02.055147 31569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.022s
W20260709 13:15:02.230993 31569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.006s	sys 0.022s
W20260709 13:15:02.232898 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.080323   753 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:01.989177 32753 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.083096   759 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.083326   766 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:02.091311 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:01.996060   440 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.016321   749 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:02.113237 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 222194us
I20260709 13:15:02.053176   618 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.049913   742 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.048209   726 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:02.114296 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1715) took 1540 ms. Trace:
I20260709 13:15:02.265550 31032 rpcz_store.cc:276] 0709 13:15:00.574250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.578580 (+  4330us) service_pool.cc:224] Handling call
0709 13:15:02.114100 (+1535520us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000c3fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:02.114233 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3187632896}
I20260709 13:15:02.111441 30880 rpcz_store.cc:276] 0709 13:15:00.931397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.711241 (+779844us) service_pool.cc:224] Handling call
0709 13:15:01.970093 (+258852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.115845 31605 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.016564 32692 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.119576 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.003338   735 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.280843   726 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.281560   735 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:02.124488 30997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.543s (SENT) [suppressed 24 similar messages]
I20260709 13:15:02.048394 31598 rpcz_store.cc:276] 0709 13:15:00.707199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.708653 (+  1454us) service_pool.cc:224] Handling call
0709 13:15:01.908749 (+1200096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.279686 31028 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:02.126891 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:02.111928   725 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:15:02.169708 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.170117 31026 rpcz_store.cc:276] 0709 13:15:00.953645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.844399 (+890754us) service_pool.cc:224] Handling call
0709 13:15:01.969857 (+125458us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:02.133137 31601 rpcz_store.cc:269] 0709 13:14:59.742381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.904914 (+162533us) service_pool.cc:224] Handling call
0709 13:15:01.978815 (+2073901us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400133654. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:01.978910 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4052849920}
I20260709 13:15:02.171324 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.173100 31031 rpcz_store.cc:276] 0709 13:15:00.988204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.378305 (+390101us) service_pool.cc:224] Handling call
0709 13:15:02.172713 (+794408us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:02.173979 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 337375us
I20260709 13:15:02.174914   770 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:02.178479 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.240957 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 448) took 1563 ms. Trace:
W20260709 13:15:02.296782 30923 leader_election.cc:336] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.902s (SENT)
I20260709 13:15:02.299708 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.121558   750 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.181612 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.184787 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:02.200568 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2248) took 1596 ms (client timeout 1984 ms). Trace:
I20260709 13:15:02.144631 31599 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:02.134567   669 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:02.121340 32726 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:02.163690   605 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.178791   651 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.206652   379 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.208369   634 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.163316   654 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.202564   765 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.122081   659 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.011957   710 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.211022 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.219630 30780 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.212200 30874 rpcz_store.cc:276] 0709 13:15:00.733608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.734076 (+   468us) service_pool.cc:224] Handling call
0709 13:15:00.734565 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:00.757912 (+ 23347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:00.757941 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.407857 (+649916us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.821932 (+414075us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:01.821971 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:01.822038 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.035556 (+213518us) raft_consensus.cc:1685] finished
0709 13:15:02.035586 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.035818 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22895,"raft.queue_time_us":43775,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":16905,"thread_start_us":269988,"threads_started":1,"wal-append.queue_time_us":408465}
I20260709 13:15:02.216579 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:02.227558 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.236161 31603 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:02.212756 30878 rpcz_store.cc:276] 0709 13:15:00.733929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.734969 (+  1040us) service_pool.cc:224] Handling call
0709 13:15:00.735265 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:00.735494 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:01.814355 (+1078861us) log.cc:844] Serialized 14 byte log entry
0709 13:15:02.045250 (+230895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:02.045302 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:02.045363 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.045433 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.045577 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1233588,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":37885,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":672997,"threads_started":2,"wal-append.queue_time_us":228403}
I20260709 13:15:02.180789   751 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.252763   759 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:02.250259 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 159067us
I20260709 13:15:02.125720   686 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.162319   631 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.218278   760 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.277899   632 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:02.259370   749 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.278949   539 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.285313   775 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.241603 32753 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:02.289631 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 162829us
W20260709 13:15:02.330809   764 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:02.180393   757 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:15:02.237628   709 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:02.295531 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:02.328989   649 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.315279   639 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.339370   728 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.296880 30883 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.201820   652 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.256233   723 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.298477 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.300971 31023 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:02.301116 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.426618 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1719) took 1851 ms. Trace:
I20260709 13:15:02.301514 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.426757 31026 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:02.301528 31029 rpcz_store.cc:269] 0709 13:15:00.604401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.755488 (+151087us) service_pool.cc:224] Handling call
0709 13:15:02.200499 (+1445011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.427098 31023 rpcz_store.cc:276] 0709 13:15:00.575481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.181342 (+1605861us) service_pool.cc:224] Handling call
0709 13:15:02.426557 (+245215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.428188 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.428932 31029 raft_consensus.cc:2376] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3. Re-sending same reply.
I20260709 13:15:02.430063 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.430935   767 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:02.370106 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 137905us
I20260709 13:15:02.432159   652 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.432241 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.433668 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:02.434437   539 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.434551 30847 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:02.303795 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.435276   586 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.315833 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.330981 31605 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:02.379336 31025 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:02.266712   679 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:02.377002 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.380358 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.437505 30878 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.381556 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.438328 30874 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.264845 30875 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.386341 30780 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.439517 30780 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.388394 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.426829 31028 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:02.440079 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.441279 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.401006 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1707) took 1893 ms. Trace:
I20260709 13:15:02.442175 31030 rpcz_store.cc:276] 0709 13:15:00.507573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.509631 (+  2058us) service_pool.cc:224] Handling call
0709 13:15:01.993958 (+1484327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.173605 (+179647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.400776 (+227171us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003f57d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:02.400935 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3412805376}
I20260709 13:15:02.402383 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.444017 31570 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.444597 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.445137 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:02.289628   468 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.448139   468 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:02.448740   468 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.449131   308 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.449357   468 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:02.449836   468 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:02.450191   468 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.451205   765 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.451481 31605 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:02.454140 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 753) took 1211 ms. Trace:
I20260709 13:15:02.447566 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:02.340835   687 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.666s	user 0.009s	sys 0.004s
I20260709 13:15:02.298976   618 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:02.408179 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 191708us
W20260709 13:15:02.345651   614 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.816s	user 0.012s	sys 0.001s
W20260709 13:15:02.317382   773 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:15:02.476969   674 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.475533 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.478951 31023 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.479219   674 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.325136 32692 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.409299 30881 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.480553 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:02.410566 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 113813us
I20260709 13:15:02.131043 31596 rpcz_store.cc:276] 0709 13:15:00.546675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.549152 (+  2477us) service_pool.cc:224] Handling call
0709 13:15:01.977090 (+1427938us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54005f1c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:01.977227 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856922496}
W20260709 13:15:02.481477 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.481688 31604 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:02.482164 31596 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:02.328526 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.483206 31598 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:02.483390   440 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.378655   605 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:02.414448 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.340416   633 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.378690 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 665) took 1136 ms. Trace:
I20260709 13:15:02.484556 31603 rpcz_store.cc:276] 0709 13:15:01.242008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.463185 (+221177us) service_pool.cc:224] Handling call
0709 13:15:02.378611 (+915426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.324460   553 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.331158   619 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.341162 32761 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:15:02.330619   622 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.299901   416 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.419364 31601 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.180250   724 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.413856 30949 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.247217   753 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.304064   750 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.494064 32761 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:02.490005 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:02.343719   591 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.324875 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.496151 32761 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.496321 30878 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:02.328330   730 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.496698 32761 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:02.118281   673 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.497225 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.497993 30878 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.497671 32761 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.498999 30878 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:02.422386 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.500362   753 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.408191   760 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.399632   379 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.397665   654 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.424760 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.451929   765 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.452105 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.528362 31025 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:02.452235 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.452571   679 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:02.453006   759 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.453363   751 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.425141   709 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.326072   556 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.452481   590 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:02.454535 31602 rpcz_store.cc:276] 0709 13:15:01.242362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.985623 (+743261us) service_pool.cc:224] Handling call
0709 13:15:01.985946 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.010450 (+ 24504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.010483 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.010953 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.036670 (+ 25717us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b1800362200. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:02.077995 (+ 41325us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:02.078036 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.084900 (+  6864us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5400670f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:02.084967 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.453905 (+368938us) raft_consensus.cc:1685] finished
0709 13:15:02.453927 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.454076 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1589,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":120,"spinlock_wait_cycles":57200384,"thread_start_us":41088,"threads_started":1,"wal-append.queue_time_us":149934}
I20260709 13:15:02.459077 30780 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.266963   766 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.412349   778 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:02.462147 31027 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:02.548871 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 95368.9us
I20260709 13:15:02.549165 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1721) took 1973 ms. Trace:
I20260709 13:15:02.549486 31027 rpcz_store.cc:276] 0709 13:15:00.576069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.325388 (+1749319us) service_pool.cc:224] Handling call
0709 13:15:02.549107 (+223719us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:02.550135 30848 leader_election.cc:336] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.610s (SENT)
I20260709 13:15:02.550357 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.550881 31027 raft_consensus.cc:2376] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4. Re-sending same reply.
W20260709 13:15:02.551038 30848 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.746s (SENT)
I20260709 13:15:02.551433 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.412933 32753 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.465816 30996 leader_election.cc:400] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:02.427359   772 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:02.464216   687 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.467639   782 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:02.301959   770 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.468665 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.564278 30876 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:02.528152   379 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.469230   631 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.460605   618 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.469285   614 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.470043 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.569038 31029 raft_consensus.cc:2376] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5. Re-sending same reply.
I20260709 13:15:02.471292 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.569907 31031 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.472162 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1510) took 2192 ms. Trace:
I20260709 13:15:02.472529 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.473016 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 661) took 1767 ms. Trace:
I20260709 13:15:02.474148   744 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.474511   546 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.475005   586 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:02.484040   605 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.576185 31599 rpcz_store.cc:276] 0709 13:15:00.705403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.708966 (+  3563us) service_pool.cc:224] Handling call
0709 13:15:00.740294 (+ 31328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.397972 (+1657678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.472756 (+ 74784us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400468cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:02.472951 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156923264}
I20260709 13:15:02.592857   614 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.592967   379 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.593137   777 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:02.488914 31023 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:02.409349 32726 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.501755 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.597271 30952 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:15:02.597321 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 46289.5us
I20260709 13:15:02.597940 31031 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:02.598301 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.408344   600 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.502411 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.502779 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.617112 31026 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 1.
I20260709 13:15:02.617182 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.407814   754 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:15:02.481698   677 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.412848   775 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.515965 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:02.523370 31601 raft_consensus.cc:2410] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:02.523958 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 113012us
I20260709 13:15:02.517911 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.530367 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:02.533113 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 98623.3us
I20260709 13:15:02.453516 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1718) took 1878 ms. Trace:
I20260709 13:15:02.541296 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.625739 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.542764 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.626044 30954 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:02.626662 31025 raft_consensus.cc:2376] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3. Re-sending same reply.
I20260709 13:15:02.454428   723 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.527983   765 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.418428   659 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.530129   679 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.552634 30996 leader_election.cc:403] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:02.637037 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 175944us
I20260709 13:15:02.637365 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.556180 30780 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:02.544627   542 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.886s	user 0.013s	sys 0.000s
I20260709 13:15:02.551662 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.566139 31030 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:02.449137   649 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:02.530185   654 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.576632 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:02.577051 30921 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44258 dropped due to backpressure: service queue is full with 50 items
I20260709 13:15:02.555331   778 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.585807   687 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.299644 30950 rpcz_store.cc:276] 0709 13:15:00.677446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.686614 (+  9168us) service_pool.cc:224] Handling call
0709 13:15:00.904097 (+217483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:00.980301 (+ 76204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:00.980354 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:01.553586 (+573232us) log.cc:844] Serialized 26 byte log entry
0709 13:15:01.981504 (+427918us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f2737b500ac 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b
0709 13:15:02.087989 (+106485us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:02.088043 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.088139 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:02.201241 (+113102us) raft_consensus.cc:1685] finished
0709 13:15:02.201273 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:02.238432 (+ 37159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7393,"raft.queue_time_us":14324,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1537,"spinlock_wait_cycles":17719040,"thread_start_us":261811,"threads_started":1,"wal-append.queue_time_us":445801}
I20260709 13:15:02.566844   782 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.587189   770 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.580828   586 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.656204   586 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.590803   468 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:02.660108 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.661401 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.572444   539 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:02.598723 30848 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.949s (SENT)
I20260709 13:15:02.662048 31599 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:02.662403 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.662735   539 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:02.663337 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64642.7us
I20260709 13:15:02.663520   775 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:02.664000 30848 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.990s (SENT)
I20260709 13:15:02.664125   775 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:02.664429 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.665355   744 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.610098   724 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.199724 31597 rpcz_store.cc:276] 0709 13:14:59.356525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:59.358093 (+  1568us) service_pool.cc:224] Handling call
0709 13:14:59.358428 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:59.556381 (+197953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:59.558662 (+  2281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:59.684759 (+126097us) log.cc:844] Serialized 26 byte log entry
0709 13:15:00.106821 (+422062us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:00.106890 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.244356 (+137466us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000104d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:00.244421 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:01.007024 (+762603us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:01.919847 (+912823us) raft_consensus.cc:1685] finished
0709 13:15:01.923072 (+  3225us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:01.936965 (+ 13893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12220,"raft.queue_time_us":25759,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":3801,"spinlock_wait_cycles":404881664,"thread_start_us":221237,"threads_started":1,"wal-append.queue_time_us":609117}
I20260709 13:15:02.612952 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.666571 31023 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.667408 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.667985 31023 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:02.669016 31023 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:02.669343   778 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.669546 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2251) took 2064 ms. Trace:
I20260709 13:15:02.641142   759 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:02.669880 31023 rpcz_store.cc:276] 0709 13:15:00.605190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.668560 (+2063370us) service_pool.cc:224] Handling call
0709 13:15:02.668856 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.669340 (+   484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.669495 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.671034 31023 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.572597   618 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.672358   687 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.503024 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.618444 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:02.626947 30847 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:02.625160 30879 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:15:02.671553 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2253) took 2065 ms. Trace:
I20260709 13:15:02.627351 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.674336 31023 rpcz_store.cc:276] 0709 13:15:00.605810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.670606 (+2064796us) service_pool.cc:224] Handling call
0709 13:15:02.670878 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.671360 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.671508 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.624135 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:02.628423 30951 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:02.626053 30957 raft_consensus.cc:2376] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4. Re-sending same reply.
I20260709 13:15:02.625537 31028 rpcz_store.cc:276] 0709 13:15:00.575227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.289262 (+1714035us) service_pool.cc:224] Handling call
0709 13:15:02.453438 (+164176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.632196 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:02.632818 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:02.633080 31024 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:02.634057 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:02.679523 30955 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.639146 30780 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:02.680205 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48111.7us
I20260709 13:15:02.681459 31603 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:02.640458 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.641666 31027 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:02.641619 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 157904us
I20260709 13:15:02.682497 31026 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:02.644547 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.682968 31030 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:02.645793 31029 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:02.683604 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.644891 30880 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.647080 30996 leader_election.cc:400] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:15:02.647011 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.638060 31601 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:02.636722   765 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:02.689132 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 62257.3us
I20260709 13:15:02.647616   649 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:02.688588 31031 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:02.690363 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2257) took 1783 ms. Trace:
I20260709 13:15:02.650156   787 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:02.651677   654 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.652232 30881 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:02.652345   686 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.720269 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:02.720906 31602 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:02.654656   760 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.566845   772 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:02.679546 30953 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:02.726177 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 43489.7us
I20260709 13:15:02.684952 31025 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:02.729738 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.614820   786 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.685284 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:02.759194 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 74002us
I20260709 13:15:02.573104 30875 rpcz_store.cc:276] 0709 13:15:00.279757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.282159 (+  2402us) service_pool.cc:224] Handling call
0709 13:15:00.330284 (+ 48125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.448781 (+2118497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.471912 (+ 23131us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540001f9d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:02.472092 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4384023808}
I20260709 13:15:02.768121 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.769196 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.644547 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.690671 31031 rpcz_store.cc:276] 0709 13:15:00.906637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.673581 (+1766944us) service_pool.cc:224] Handling call
0709 13:15:02.688297 (+ 14716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.690125 (+  1828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.690308 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.671520   723 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:02.708300 30780 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.710283 31029 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:15:02.869401 31029 pending_rounds.cc:85] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 4
I20260709 13:15:02.869688 31029 pending_rounds.cc:107] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:15:02.869930 31029 raft_consensus.cc:2889] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:02.691172 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2261) took 1254 ms. Trace:
W20260709 13:15:02.865010 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.722962 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.723845 31027 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:15:02.867892 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 109206us
I20260709 13:15:02.872342 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.717171 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:02.873479 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.863330 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:02.873996 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 156892us
I20260709 13:15:02.874187 31027 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:02.661896   468 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.731437 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:02.758428 30923 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.675s (SENT)
I20260709 13:15:02.874444 30881 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:02.874894 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.875344 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.875466 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:02.875743 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 117367us
I20260709 13:15:02.876552 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:02.877220 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:02.769788 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:02.771605 30880 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:02.688571 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.877526 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.878074 30879 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:02.643446   542 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.775123   766 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.643113   659 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.779138 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.785112 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.712828   770 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:02.889724 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:02.784649   761 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:02.797111 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:02.894282 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.894865 30883 raft_consensus.cc:2376] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5. Re-sending same reply.
I20260709 13:15:02.895632 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.800572 31598 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:02.800856   772 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:02.648536   591 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:15:02.720378   724 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:02.822458 31024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1717) took 2227 ms (client timeout 1933 ms). Trace:
I20260709 13:15:02.898098 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:02.672853   687 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.698828   759 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:15:02.787870   686 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:02.846004 30997 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.016s	sys 0.022s
W20260709 13:15:02.902130 30997 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.017s	sys 0.022s
I20260709 13:15:02.598824 30924 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51648 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1785)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1768)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1770)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1406)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1412)
I20260709 13:15:02.726708   778 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:15:02.730078   379 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:15:02.817000 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.867733 31028 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:02.870548 31026 rpcz_store.cc:276] 0709 13:15:01.436754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.622921 (+1186167us) service_pool.cc:224] Handling call
0709 13:15:02.691116 (+ 68195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.909490 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2272) took 1123 ms. Trace:
I20260709 13:15:02.909855 31028 rpcz_store.cc:276] 0709 13:15:01.786283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.681207 (+894924us) service_pool.cc:224] Handling call
0709 13:15:02.867439 (+186232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.909229 (+ 41790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.909434 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.880264 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.880824 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.910923 30881 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:02.881165 30955 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:02.883914 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:02.911859 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:02.862800   794 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:15:02.888571 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.802724   605 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.848057 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.896142 30883 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:02.922464 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.934069 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.934952 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:02.935642 30879 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:02.898551 31024 rpcz_store.cc:269] 0709 13:15:00.574962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.576178 (+  1216us) service_pool.cc:224] Handling call
0709 13:15:02.802003 (+2225825us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540007c954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:02.802172 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4728308480}
I20260709 13:15:02.929584 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:02.937091 31026 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:02.899330 31602 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
W20260709 13:15:02.902423 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 777895us
I20260709 13:15:02.939657 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.941375 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.869071   709 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.937740 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:02.905028 30882 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.907948 30958 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 2.
I20260709 13:15:02.883522   751 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:02.720651 31023 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:02.959227 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2266) took 1174 ms. Trace:
I20260709 13:15:02.959575 31023 rpcz_store.cc:276] 0709 13:15:01.784795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.675161 (+890366us) service_pool.cc:224] Handling call
0709 13:15:02.719631 (+ 44470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.958950 (+239319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.959168 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:02.900516   632 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:02.887666 31600 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:02.919227 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:02.944182 31570 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:02.918644   724 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:02.976842 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:02.977475   724 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.978073 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:02.978708 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.911109   600 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.979902 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.980321 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.980983 31598 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:02.981101   651 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.981354   728 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:02.981945   728 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:02.982057 32726 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.982884   728 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.955368 32753 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:02.983934   639 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:02.984782   779 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:02.985236   779 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.985385 32753 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:02.985671   779 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:02.986979 31030 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.909912   635 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:02.948117 30997 leader_election.cc:336] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.815s (SENT)
I20260709 13:15:02.920094   784 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:02.953933   586 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:02.924856 30923 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.664s (SENT)
I20260709 13:15:02.912824 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:02.902022   686 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:02.959388 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:03.047478 31601 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:03.048730 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:03.049755 31601 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:02.900558   770 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:02.966866 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:02.945766 30953 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:03.051121 31602 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:02.981050 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:03.051944 31603 raft_consensus.cc:2393] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:02.930580   778 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:02.991659 31032 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:02.991568 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:02.992916 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:03.062148 30874 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.062368 31604 raft_consensus.cc:2410] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:02.990123 30996 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:03.065267 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75208.2us
I20260709 13:15:03.066207 30996 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:02.928737   542 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:02.970718   710 consensus_meta.cc:287] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.002s
I20260709 13:15:02.890858   775 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:02.954869   767 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.930235   546 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:03.051469   686 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.016868 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:03.011322   744 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:03.017918 30882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 520) took 2239 ms (client timeout 1960 ms). Trace:
I20260709 13:15:03.065673   556 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:02.878578   649 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.027173 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:03.104668 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 77607.2us
I20260709 13:15:03.105453 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:03.044689 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 119858us
W20260709 13:15:03.108103 30923 leader_election.cc:336] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.723s (SENT)
I20260709 13:15:03.087594   634 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:03.051477 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:02.991461   591 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:02.930675 31596 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:03.059680 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:03.061005 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:02.902382   761 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.067296 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:03.118345 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 51140.8us
I20260709 13:15:03.005268 31599 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:03.015374 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:02.967644   750 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:02.987243   742 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.000s
W20260709 13:15:03.094980 30882 rpcz_store.cc:269] 0709 13:15:00.778547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.778713 (+   166us) service_pool.cc:224] Handling call
0709 13:15:01.409265 (+630552us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:03.017691 (+1608426us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000a05d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:03.017842 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309035648}
I20260709 13:15:03.098007   586 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:03.099677 31026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:15:03.090003   767 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:03.067227   778 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:03.109129 30923 leader_election.cc:336] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.750s (SENT)
I20260709 13:15:03.122648   746 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:03.089692   632 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.113492 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:03.126192 31026 raft_consensus.cc:606] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:03.126924 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 178823us
I20260709 13:15:03.103852   546 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:03.115945   591 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.089306   710 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:03.146551 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:03.052378 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 139628us
I20260709 13:15:03.112322   634 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.180853   634 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:03.150306 30875 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:03.150909 30997 leader_election.cc:336] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.817s (SENT)
I20260709 13:15:03.183945 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:03.162297 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:03.150790 30874 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:03.114696   556 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:03.128289 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:03.158878 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45461.6us
I20260709 13:15:03.189030 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:03.189749 30953 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:03.129770   787 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.197481 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:03.164341 31030 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:03.165518   379 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:03.165407 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 56298.5us
W20260709 13:15:03.204224 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 53375.3us
I20260709 13:15:03.204696 30923 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:03.202981 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 358) took 1082 ms. Trace:
I20260709 13:15:03.205924 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:03.152614   770 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.207756   600 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.168322   605 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:03.207492   379 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.208995   379 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:03.209940   379 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:03.210659   776 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:03.211203   796 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.160s	user 0.001s	sys 0.002s
I20260709 13:15:03.171641   687 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:03.172180   546 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.212281 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.173331   710 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:03.213668 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.174100 30956 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:03.174013 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.214864 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:03.178092   797 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:15:03.149580   632 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.152447   659 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:03.179489   778 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.215389 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.147853   726 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:03.151093   746 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.123822 32726 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:03.192420 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:03.192516 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:03.215847 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.193547 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:03.229619 30951 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:03.160625   591 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.147380   758 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.148193   742 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.216830 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 727) took 1639 ms. Trace:
I20260709 13:15:03.239818 31605 rpcz_store.cc:276] 0709 13:15:01.577440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.454820 (+877380us) service_pool.cc:224] Handling call
0709 13:15:02.459079 (+  4259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.459617 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.459648 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.465620 (+  5972us) log.cc:844] Serialized 26 byte log entry
0709 13:15:02.871627 (+406007us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:02.871664 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:02.871730 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.216612 (+344882us) raft_consensus.cc:1685] finished
0709 13:15:03.216632 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.216767 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7139,"raft.queue_time_us":78,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7070,"thread_start_us":327424,"threads_started":1,"wal-append.queue_time_us":388515}
I20260709 13:15:03.240818 30879 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:03.241997 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:03.242946 30879 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:03.225003 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 457) took 1287 ms. Trace:
I20260709 13:15:03.228194 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:03.224470 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.226111 30874 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:03.215710 30953 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:03.250504 30949 rpcz_store.cc:276] 0709 13:15:01.937266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:01.941634 (+  4368us) service_pool.cc:224] Handling call
0709 13:15:01.969893 (+ 28259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:02.489913 (+520020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.224733 (+734820us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400350f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:03.224926 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020592000}
I20260709 13:15:03.206137 31030 rpcz_store.cc:276] 0709 13:15:02.120511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.683437 (+562926us) service_pool.cc:224] Handling call
0709 13:15:02.986673 (+303236us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:02.986865 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.202638 (+215773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.202910 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2983296}
W20260709 13:15:03.253612 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.255025 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:03.237524 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.183542 32761 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:03.251933 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.234712 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:03.259711 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.263370 30953 raft_consensus.cc:2410] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:03.264503 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.265951 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.266880 30953 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:03.202104   744 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:03.224195   632 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.224893   778 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.268365 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:03.296823 31030 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.238751   659 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:03.293041 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:03.224722   750 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:03.293839 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 59199.5us
I20260709 13:15:03.306777 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:03.294667 32761 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:03.236110   784 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:03.270367   744 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:03.225284   746 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.235394   726 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.270488 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.272413 31604 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:03.307211   659 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.309038 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:03.219966   568 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:03.354599 31597 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:03.260825 32726 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.294118   796 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 13:15:03.358059 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:03.358825 31605 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:03.203910   779 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.224893 30950 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.311553 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 361) took 1190 ms. Trace:
I20260709 13:15:03.385314 31032 rpcz_store.cc:276] 0709 13:15:02.121598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.444328 (+322730us) service_pool.cc:224] Handling call
0709 13:15:03.311247 (+866919us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003791d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:03.311463 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247426304}
I20260709 13:15:03.345054   744 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.353966   659 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.294317   539 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.297433   767 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.300292 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.407464 30953 raft_consensus.cc:2410] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:03.350142 30949 raft_consensus.cc:2368] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4.
W20260709 13:15:03.356865 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.350979   709 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:03.299897   751 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.412767 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.413602 30953 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.277899 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:03.378897   726 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:03.419512 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 141748us
I20260709 13:15:03.421103 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:03.331110 31030 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:15:03.402249   749 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.985s	user 0.003s	sys 0.009s
I20260709 13:15:03.422776 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:03.430619   763 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:03.451476 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.401351 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:03.378304 32726 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.404012   539 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.489780   539 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.491181 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.355826   556 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:03.492014 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2103) took 1223 ms. Trace:
I20260709 13:15:03.492978 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.494134   782 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:03.390599   542 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:03.409161   709 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.495213   709 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:03.496162   766 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:03.496565   766 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:03.497350   766 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.498764   766 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.393972   710 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:15:03.500694 32753 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:03.501113 32753 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:03.501971 32753 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.503955 30952 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:02.645188 30921 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44258 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1409)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1785)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1389)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1402)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1398)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1399)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1390)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1403)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1413)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1768)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1770)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1774)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1404)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1405)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1406)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1407)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1408)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1411)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1412)
I20260709 13:15:03.384604   777 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:15:03.504961 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.506799 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.507100 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2105) took 1237 ms. Trace:
W20260709 13:15:03.487011   802 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:15:03.488644   568 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:03.510202   807 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:03.416281   751 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:03.453960   749 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.511302   751 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.512362   590 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:03.512800   590 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:03.513037   749 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:03.513579   590 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.515272   590 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.456709   600 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:03.507503 30952 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:03.507519 30881 rpcz_store.cc:276] 0709 13:15:02.269357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.956827 (+687470us) service_pool.cc:224] Handling call
0709 13:15:02.957132 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.957479 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.957507 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.969831 (+ 12324us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.355466 (+385635us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:03.355508 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.355617 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.506887 (+151270us) raft_consensus.cc:1685] finished
0709 13:15:03.506908 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.507040 (+   132us) inbound_call.cc:177] Queueing success response
0709 13:15:03.518760 (+ 11720us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b4800080358. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
Metrics: {"raft.queue_time_us":3211,"raft.run_cpu_time_us":2768,"raft.run_wall_time_us":552665,"spinlock_wait_cycles":21566336,"thread_start_us":304484,"threads_started":1,"wal-append.queue_time_us":472798}
I20260709 13:15:03.492420 30883 rpcz_store.cc:276] 0709 13:15:02.268777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.933622 (+664845us) service_pool.cc:224] Handling call
0709 13:15:02.933892 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.934188 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.934215 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.934600 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.263210 (+328610us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:03.263251 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.263319 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.491791 (+228472us) raft_consensus.cc:1685] finished
0709 13:15:03.491810 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.491952 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9735,"raft.queue_time_us":21107,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":15068,"thread_start_us":250280,"threads_started":1,"wal-append.queue_time_us":418484}
I20260709 13:15:03.558177 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:03.558177 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:03.559062 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:03.485430   679 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.840s	user 0.011s	sys 0.000s
I20260709 13:15:03.419929   776 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:03.409003   724 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
W20260709 13:15:03.523211 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:03.560187 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:03.485093 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 62406.9us
I20260709 13:15:03.565423 30883 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:03.567314 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.575403 30952 raft_consensus.cc:2410] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:03.560230 30874 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.501132   779 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:03.582553 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 316885us
I20260709 13:15:03.582798 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1390) took 1058 ms. Trace:
I20260709 13:15:03.589355 30951 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:03.590229 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1389) took 1066 ms. Trace:
I20260709 13:15:03.590561 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:03.578454   726 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:03.421280 32761 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.590673 30951 rpcz_store.cc:276] 0709 13:15:02.523893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.237265 (+713372us) service_pool.cc:224] Handling call
0709 13:15:03.590154 (+352889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.594164 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.569790   468 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:03.596462 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.576663 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:03.599884 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:03.583498 30952 rpcz_store.cc:276] 0709 13:15:02.524178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.567078 (+1042900us) service_pool.cc:224] Handling call
0709 13:15:03.582733 (+ 15655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.601604 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.599579 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:03.594885 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 241182us
I20260709 13:15:03.603396 30953 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:03.605763 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 470) took 1047 ms. Trace:
I20260709 13:15:03.604769 30847 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:03.602972 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:03.606189 30953 rpcz_store.cc:276] 0709 13:15:02.558367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.412435 (+854068us) service_pool.cc:224] Handling call
0709 13:15:03.605696 (+193261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.620622 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.621416 30953 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:03.621809 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 469) took 1068 ms. Trace:
I20260709 13:15:03.622108 30953 rpcz_store.cc:276] 0709 13:15:02.553756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.620359 (+1066603us) service_pool.cc:224] Handling call
0709 13:15:03.621756 (+  1397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.623055 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.619673 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 468) took 1073 ms. Trace:
I20260709 13:15:03.626972 30951 rpcz_store.cc:276] 0709 13:15:02.546435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.596215 (+1049780us) service_pool.cc:224] Handling call
0709 13:15:03.619594 (+ 23379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.627480 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:03.630190 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.631410 30951 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:03.631961 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1784) took 1108 ms. Trace:
I20260709 13:15:03.632400 30951 rpcz_store.cc:276] 0709 13:15:02.523505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.629886 (+1106381us) service_pool.cc:224] Handling call
0709 13:15:03.631878 (+  1992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.634742 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.637034 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.637967 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1775) took 1117 ms. Trace:
I20260709 13:15:03.638443 30951 rpcz_store.cc:276] 0709 13:15:02.521042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.636789 (+1115747us) service_pool.cc:224] Handling call
0709 13:15:03.637887 (+  1098us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.633349 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1400) took 1106 ms. Trace:
I20260709 13:15:03.641184 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.645241 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:03.645268 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:03.624892   546 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:03.625355   568 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.656812 31032 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.571338   679 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.635355   542 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:03.639294 30953 rpcz_store.cc:276] 0709 13:15:02.526934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.622763 (+1095829us) service_pool.cc:224] Handling call
0709 13:15:03.633283 (+ 10520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.652096 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:03.663502 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.664297 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1782) took 1141 ms. Trace:
I20260709 13:15:03.664654 30953 rpcz_store.cc:276] 0709 13:15:02.522940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.663259 (+1140319us) service_pool.cc:224] Handling call
0709 13:15:03.664242 (+   983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:03.665045 30874 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:03.665751 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.636148   651 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:03.640103   766 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.675457 30953 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:15:03.624660   633 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:15:03.650405   749 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:03.673508   723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.003s	sys 0.009s
W20260709 13:15:03.672029   686 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.003s
I20260709 13:15:03.640168   591 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:03.672729   787 raft_consensus.cc:2764] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:15:03.731142 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:03.669960   651 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.736836 30951 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:03.712612   546 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:03.637099   634 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:03.725777   723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.003s	sys 0.010s
I20260709 13:15:03.718768   749 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:03.722879   766 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:03.794715 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 237936us
I20260709 13:15:03.791728 31025 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:03.716172   761 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:03.810814 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.019s
I20260709 13:15:03.645453   600 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:03.814250 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.004s	sys 0.019s
W20260709 13:15:03.738736   805 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:15:03.795625 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:03.741142   651 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:03.825711 30955 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:03.826643 32726 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:03.829775   766 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.837782 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:03.838764 30883 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:03.839318   618 consensus_meta.cc:287] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.167s	user 0.005s	sys 0.005s
I20260709 13:15:03.782549   728 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:03.840528   813 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:15:03.840612   728 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.795317   749 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.843700 31026 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:03.844691 32753 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:03.741389   686 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.854612 30952 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:15:03.844331   546 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:03.737829   710 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:03.795217   765 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.106s	user 0.005s	sys 0.014s
I20260709 13:15:03.880230 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:03.881204 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:03.882078 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.036513 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 462) took 1535 ms. Trace:
W20260709 13:15:03.982517 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.038610 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:03.882246 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58747.1us
I20260709 13:15:04.034637 30949 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:04.040620 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.040776 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:04.041538 31030 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:03.966460 31032 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:04.038255 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1529) took 1159 ms. Trace:
I20260709 13:15:04.038504 30958 rpcz_store.cc:276] 0709 13:15:02.501283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.502836 (+  1553us) service_pool.cc:224] Handling call
0709 13:15:04.031711 (+1528875us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002b7d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.036452 (+  4741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539948928}
W20260709 13:15:03.835649 30875 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.000s
I20260709 13:15:03.969075 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1728) took 1564 ms. Trace:
I20260709 13:15:04.042764 30880 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:04.043805 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:04.035624 30950 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.004s
I20260709 13:15:04.043236 30878 rpcz_store.cc:276] 0709 13:15:02.879099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.176757 (+297658us) service_pool.cc:224] Handling call
0709 13:15:03.177085 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:03.177453 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:03.177498 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:03.177986 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.649202 (+471216us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:03.649255 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.649334 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.844357 (+195023us) raft_consensus.cc:1685] finished
0709 13:15:03.844380 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.038191 (+193811us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6759,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":17796,"thread_start_us":455464,"threads_started":1,"wal-append.queue_time_us":590418}
W20260709 13:15:03.885073 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.045511 31024 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:04.213819 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.433645 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.434871 31027 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:04.050889 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:03.906268 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:04.436069 31030 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:04.436198 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.436506 30881 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:04.437050 31027 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:04.437115 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:03.883736 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.438318 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.090467 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:04.439838 30951 raft_consensus.cc:2410] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:15:04.164508 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.043s
W20260709 13:15:04.282194 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 246103us
W20260709 13:15:04.441358 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.004s	sys 0.025s
W20260709 13:15:04.441749 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.004s	sys 0.025s
I20260709 13:15:04.119499 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.434931 30958 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:04.442788 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1415) took 1168 ms. Trace:
I20260709 13:15:04.443149 30958 rpcz_store.cc:276] 0709 13:15:03.274074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.043559 (+769485us) service_pool.cc:224] Handling call
0709 13:15:04.442723 (+399164us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:04.032831   659 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 13:15:04.457499 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1727) took 2053 ms. Trace:
I20260709 13:15:04.433758 31026 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:04.434468 31028 rpcz_store.cc:276] 0709 13:15:02.404186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.910616 (+506430us) service_pool.cc:224] Handling call
0709 13:15:02.959876 (+ 49260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.973798 (+ 13922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.973830 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.992429 (+ 18599us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.301364 (+308935us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:03.301419 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.301511 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:03.968743 (+667232us) raft_consensus.cc:1685] finished
0709 13:15:03.968772 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:03.968971 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5908,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":18947,"thread_start_us":235271,"threads_started":1,"wal-append.queue_time_us":537216}
W20260709 13:15:04.440668 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.014s	sys 0.046s
W20260709 13:15:04.459743 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 807644us
I20260709 13:15:04.438884 31024 raft_consensus.cc:2376] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5. Re-sending same reply.
I20260709 13:15:04.461530 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.462621 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.460562 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:04.463212   841 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:04.458866 31031 rpcz_store.cc:276] 0709 13:15:02.403932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.869000 (+465068us) service_pool.cc:224] Handling call
0709 13:15:02.891401 (+ 22401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:02.901074 (+  9673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:02.901101 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:02.901567 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:03.316428 (+414861us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b18004733e0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:03.667207 (+350779us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:03.667256 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:03.667324 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:04.433267 (+765943us) raft_consensus.cc:1685] finished
0709 13:15:04.433286 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:04.457429 (+ 24143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22362,"raft.queue_time_us":12059,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":26282,"spinlock_wait_cycles":15903104,"thread_start_us":350583,"threads_started":1,"wal-append.queue_time_us":1081834}
I20260709 13:15:04.442139 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:04.465399 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:04.462908 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 410707us
I20260709 13:15:04.465416 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.466346 31026 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:04.466591 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.466893 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:04.467151 31031 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:04.467998 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.468932 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.469944 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.470975 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.471467 31031 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:04.446250 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1419) took 1171 ms. Trace:
I20260709 13:15:04.450652 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:04.472498 30874 raft_consensus.cc:2368] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3.
W20260709 13:15:04.453107 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:03.959514   744 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:15:04.474159 30951 rpcz_store.cc:276] 0709 13:15:03.275270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.064493 (+789223us) service_pool.cc:224] Handling call
0709 13:15:04.446192 (+381699us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:04.458333 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.444108 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:04.475246 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:04.477427 30951 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
I20260709 13:15:04.477944 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1793) took 1251 ms. Trace:
I20260709 13:15:04.478307 30951 rpcz_store.cc:276] 0709 13:15:03.226675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.475035 (+1248360us) service_pool.cc:224] Handling call
0709 13:15:04.477895 (+  2860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:04.479205 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:04.479835 30951 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:04.480592 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1420) took 1205 ms. Trace:
I20260709 13:15:04.480964 30951 rpcz_store.cc:276] 0709 13:15:03.275574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.478980 (+1203406us) service_pool.cc:224] Handling call
0709 13:15:04.480540 (+  1560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:04.481848 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:04.479811 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.488266 30951 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:04.449950 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:04.484722   766 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:04.430624   817 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:15:03.906078   631 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.494438 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.076686   639 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:04.045948   634 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:04.428386   820 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:15:04.489192 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.432858   679 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:04.498591 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:04.501065 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.434418 30950 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:03.877664   618 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.489492 31026 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:04.429728   709 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.003s
I20260709 13:15:04.014847   635 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.883214   742 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:04.490608 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.491446 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.516490 31023 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:04.445611   778 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.126s	user 0.013s	sys 0.000s
I20260709 13:15:04.472139   633 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:04.343539   828 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
I20260709 13:15:04.495265 31028 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:04.170817   632 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.863s	user 0.010s	sys 0.001s
I20260709 13:15:04.368988   591 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:04.205566   728 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:04.491981   744 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:04.234658   539 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.737s	user 0.005s	sys 0.005s
I20260709 13:15:04.076355   787 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.503180 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:03.907354   822 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.473012   723 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.479889   803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.002s	sys 0.022s
I20260709 13:15:04.513778 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:04.305226   772 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.201s
I20260709 13:15:04.511508 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.516906 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.505636   631 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.063715   765 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.168639   749 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.520465   635 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.523288 30879 raft_consensus.cc:2410] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:04.526564   751 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:04.531081   633 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.502200   657 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.508914   836 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.531996 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:04.497838 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:04.511806   766 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:04.533188 30951 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:04.487861   659 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.520228   742 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.535444 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:04.700793 30879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2111) took 1473 ms (client timeout 1817 ms). Trace:
I20260709 13:15:04.701197 31028 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
W20260709 13:15:04.701436 30879 rpcz_store.cc:269] 0709 13:15:03.227506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.243595 (+ 16089us) service_pool.cc:224] Handling call
0709 13:15:04.700526 (+1456931us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003c64d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.700717 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2807623936}
I20260709 13:15:04.518296   835 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:04.521413 30950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 465) took 1984 ms (client timeout 1866 ms). Trace:
W20260709 13:15:04.717584 30950 rpcz_store.cc:269] 0709 13:15:02.534571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.215060 (+680489us) service_pool.cc:224] Handling call
0709 13:15:04.518641 (+1303581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:04.719360 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:04.720595 30950 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:04.541255 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.095091   651 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:04.518263   709 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:04.723160   651 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:04.533617   632 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.723737   709 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:04.724615   618 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:04.726042   632 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:04.525456 31031 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:04.728339 31031 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:04.728972   744 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:04.730885 31031 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:04.542979 31026 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:04.497996   639 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.650334 30957 raft_consensus.cc:2368] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:04.647356   767 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:04.643501   812 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.981s	user 0.000s	sys 0.012s
I20260709 13:15:04.649713   766 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:04.542013   803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.002s	sys 0.022s
I20260709 13:15:04.642292   468 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:04.652537   659 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:04.653344   686 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:04.653555   777 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:04.654114 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 156349us
I20260709 13:15:04.654937 30877 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:04.656752   765 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:04.657236 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.657374 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 476) took 1151 ms. Trace:
I20260709 13:15:04.658136   836 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:04.640530 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 173692us
W20260709 13:15:04.658901 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1403) took 2129 ms (client timeout 2304 ms). Trace:
W20260709 13:15:04.659993 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 466) took 2116 ms (client timeout 2131 ms). Trace:
I20260709 13:15:04.662539 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:04.665205   749 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:04.531757   619 raft_consensus.cc:2764] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:04.665266 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:04.542688   787 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:04.666280 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:04.666697   657 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:04.668294 31024 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:04.538988   539 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:04.671237   633 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:04.544035   728 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:04.585294 32753 consensus_meta.cc:287] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.000s
I20260709 13:15:04.672887 31029 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:04.673157   631 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:04.674445 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:04.674824   635 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:04.676790 30955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1778) took 2155 ms (client timeout 1583 ms). Trace:
I20260709 13:15:04.679062   763 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:04.680642 31597 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:04.683856 31599 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:04.685081 31603 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:04.685766 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:04.687395 31600 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:04.694295 30956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 464) took 2166 ms (client timeout 2165 ms). Trace:
W20260709 13:15:04.697889 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1788) took 1474 ms (client timeout 1865 ms). Trace:
W20260709 13:15:04.671696 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:04.699389   673 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:04.546154 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:04.706751 30954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 467) took 2162 ms (client timeout 1550 ms). Trace:
I20260709 13:15:04.543083   822 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:04.716756   844 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:15:04.723272 30958 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:04.542033   723 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:04.736423 31032 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:04.820535 30881 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:05.127308 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1543) took 1221 ms. Trace:
W20260709 13:15:05.127688 30952 rpcz_store.cc:269] 0709 13:15:02.529309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.602680 (+1073371us) service_pool.cc:224] Handling call
0709 13:15:04.658643 (+1055963us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54003ffcd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.658831 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561382656}
I20260709 13:15:05.128548 31023 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
W20260709 13:15:05.128785 30949 rpcz_store.cc:269] 0709 13:15:02.543453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.417046 (+873593us) service_pool.cc:224] Handling call
0709 13:15:04.659739 (+1242693us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b5400256a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.659881 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338679040}
I20260709 13:15:05.129346 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:04.936229 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 460328us
I20260709 13:15:05.130920 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:05.131023 30956 rpcz_store.cc:269] 0709 13:15:02.527893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.492707 (+964814us) service_pool.cc:224] Handling call
0709 13:15:04.694022 (+1201315us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400111f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.694202 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884224256}
W20260709 13:15:04.847929 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 335274us
I20260709 13:15:05.079921 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2106) took 2806 ms. Trace:
W20260709 13:15:04.847573 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 354439us
I20260709 13:15:05.132932 30880 rpcz_store.cc:276] 0709 13:15:02.273558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.021573 (+748015us) service_pool.cc:224] Handling call
0709 13:15:03.081689 (+ 60116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:04.432970 (+1351281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.079525 (+646555us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540039add4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:05.079826 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209635584}
W20260709 13:15:05.133437 30955 rpcz_store.cc:269] 0709 13:15:02.521855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.593847 (+1071992us) service_pool.cc:224] Handling call
0709 13:15:04.676531 (+1082684us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400350a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.676701 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527228800}
I20260709 13:15:05.135037 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.137001   723 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:04.731580   742 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:05.134235 30954 rpcz_store.cc:269] 0709 13:15:02.544566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.706501 (+2161935us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:04.706662 (+   161us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:05.136900 31602 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:05.138548 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:05.128038 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.140090 30955 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:05.140004 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:05.127665 30881 rpcz_store.cc:276] 0709 13:15:03.905831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.905981 (+   150us) service_pool.cc:224] Handling call
0709 13:15:05.127236 (+1221255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:04.949230   709 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.128233 30951 rpcz_store.cc:276] 0709 13:15:03.506423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.481638 (+975215us) service_pool.cc:224] Handling call
0709 13:15:04.657298 (+175660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.141165   709 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.143568   709 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:05.136092   673 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:05.136848 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.129972 31604 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:05.133841 30997 connection.cc:256] RPC call timeout handler was delayed by -1.2706003670000428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:15:05.135425 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:05.140647 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1414) took 1867 ms. Trace:
I20260709 13:15:05.130124 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1416) took 1855 ms. Trace:
I20260709 13:15:05.147459 30955 rpcz_store.cc:276] 0709 13:15:03.273727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.134755 (+1861028us) service_pool.cc:224] Handling call
0709 13:15:05.140588 (+  5833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.148511 30952 rpcz_store.cc:276] 0709 13:15:03.274382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.129054 (+1854672us) service_pool.cc:224] Handling call
0709 13:15:05.130070 (+  1016us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:04.984368 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.081867 30957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1395) took 2556 ms (client timeout 2069 ms). Trace:
W20260709 13:15:05.131974 30953 rpcz_store.cc:269] 0709 13:15:03.225260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.665487 (+440227us) service_pool.cc:224] Handling call
0709 13:15:04.697667 (+1032180us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b540002fb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:04.697809 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20391168}
I20260709 13:15:05.150173 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.457791   831 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:05.459514   831 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.458882 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:05.460696 30955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1786) took 2540 ms (client timeout 2905 ms). Trace:
I20260709 13:15:05.408849 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 369) took 1531 ms. Trace:
W20260709 13:15:05.513378 30955 rpcz_store.cc:269] 0709 13:15:02.920703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.149632 (+2228929us) service_pool.cc:224] Handling call
0709 13:15:05.460630 (+310998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:04.778667   468 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:05.270960 30878 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:05.236900 30877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1525) took 3024 ms (client timeout 3415 ms). Trace:
W20260709 13:15:05.462661 30957 rpcz_store.cc:269] 0709 13:15:02.525554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.259387 (+733833us) service_pool.cc:224] Handling call
0709 13:15:05.081525 (+1822138us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001e0d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.081768 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190194944}
W20260709 13:15:05.412494 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 280437us
I20260709 13:15:05.228293 31601 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:05.221663 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:05.517269 30923 leader_election.cc:336] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.006s (SENT)
I20260709 13:15:05.176460 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:05.465616 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:05.517714 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:05.517956 30874 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.518275 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:05.518882 30953 raft_consensus.cc:2376] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4. Re-sending same reply.
I20260709 13:15:05.172888 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.220274 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.295311 31602 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
W20260709 13:15:05.297489 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:05.519694 30923 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.187s (SENT)
I20260709 13:15:05.521431 30881 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:05.521752 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:05.374228 31604 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:05.522694 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:05.514938 30877 rpcz_store.cc:269] 0709 13:15:02.211961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:02.472259 (+260298us) service_pool.cc:224] Handling call
0709 13:15:05.236581 (+2764322us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400124dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.236797 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4786712320}
I20260709 13:15:05.517225 30879 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:15:04.887287 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 445031us
I20260709 13:15:05.524981 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:05.523295 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:05.513767 31029 rpcz_store.cc:276] 0709 13:15:03.877778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.880924 (+  3146us) service_pool.cc:224] Handling call
0709 13:15:05.408594 (+1527670us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002d4954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.408757 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545302272}
W20260709 13:15:05.527374 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.210202 31027 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:05.177450 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 116746us
I20260709 13:15:05.406008 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.351567 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.529945 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1413) took 2981 ms. Trace:
I20260709 13:15:05.529744 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:05.532639 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:05.533681 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:05.527876 31602 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:05.316717 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:05.529738 31571 leader_election.cc:400] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3.
I20260709 13:15:05.537207 31571 leader_election.cc:403] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:05.519831 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.538625 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:05.539073 30848 leader_election.cc:336] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.503s (SENT)
I20260709 13:15:05.540125 30953 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:05.539968 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:05.541045 31602 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:05.539425 30997 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.543s (SENT)
I20260709 13:15:05.542239 30949 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 2: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:05.543987 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1417) took 2269 ms (client timeout 2613 ms). Trace:
I20260709 13:15:05.544349 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:04.949414   618 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.434136 30875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.019s	sys 0.045s
I20260709 13:15:04.770467   639 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:04.872014   659 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.358078   847 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.573899 30874 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:05.043947   782 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:05.589030 30880 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:05.531191   651 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.215646   746 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.858s	user 0.014s	sys 0.000s
W20260709 13:15:05.544394 30949 rpcz_store.cc:269] 0709 13:15:03.274657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.197102 (+1922445us) service_pool.cc:224] Handling call
0709 13:15:05.543929 (+346827us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:05.550007 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.552640 30951 rpcz_store.cc:276] 0709 13:15:02.548542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.405655 (+2857113us) service_pool.cc:224] Handling call
0709 13:15:05.529784 (+124129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.549431   379 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:05.553840 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1789) took 2328 ms (client timeout 2654 ms). Trace:
W20260709 13:15:05.628715 30952 rpcz_store.cc:269] 0709 13:15:03.225575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.149641 (+1924066us) service_pool.cc:224] Handling call
0709 13:15:05.553747 (+404106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.556548   861 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.609604 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65309.3us
I20260709 13:15:05.185542   821 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.821044 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 474) took 1315 ms. Trace:
I20260709 13:15:05.146864   632 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.556810 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.358008   679 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:05.569008 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:05.545224 30954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1790) took 2319 ms (client timeout 2858 ms). Trace:
I20260709 13:15:05.576726   784 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:05.654808 30955 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:05.655987 31024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2297) took 1208 ms (client timeout 1584 ms). Trace:
I20260709 13:15:05.147588   634 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.145569   673 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:05.561738 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:05.663154 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 101477us
I20260709 13:15:05.617027   857 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:05.356176   842 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:05.474076   772 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.194841   777 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:05.439082 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:05.514155   780 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:05.576484 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1421) took 2300 ms (client timeout 1987 ms). Trace:
I20260709 13:15:05.578347 30996 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:05.572419 30998 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:05.546015 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:05.530593   750 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:05.574496 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:05.574704 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:05.729382 30958 rpcz_store.cc:269] 0709 13:15:03.277139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.443879 (+1166740us) service_pool.cc:224] Handling call
0709 13:15:05.576261 (+1132382us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540024ca54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.576410 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567611136}
I20260709 13:15:05.730151 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 686) took 1041 ms. Trace:
I20260709 13:15:05.730830 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:05.514406   724 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:05.514580   776 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:05.184442 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:05.568017 30875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.025s	sys 0.051s
I20260709 13:15:05.531828   728 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:05.547580 31604 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:05.762389 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 685) took 1073 ms. Trace:
I20260709 13:15:05.553170 31031 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:05.591040 31026 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:05.629786 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:05.608760 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 75051.5us
I20260709 13:15:05.630914 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:04.995424   840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.032s
I20260709 13:15:05.523936   542 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:15:05.523751   749 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:15:05.764398 30952 raft_consensus.cc:2376] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3. Re-sending same reply.
I20260709 13:15:05.768317 30951 raft_consensus.cc:2368] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:05.771381 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.543833   709 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:05.634163 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:05.608650   847 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:05.780604 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 146505us
I20260709 13:15:05.781351 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:05.126842   763 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:05.571626   546 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:05.631589 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.794435 30949 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:05.556921   710 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:05.637535 30874 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:05.795866 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:05.796481 30874 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:05.638604 30956 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:05.607699 31598 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:05.798439 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 769) took 1136 ms. Trace:
I20260709 13:15:05.798790 31598 rpcz_store.cc:276] 0709 13:15:04.662083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.662231 (+   148us) service_pool.cc:224] Handling call
0709 13:15:05.798377 (+1136146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:05.800974 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 259169us
I20260709 13:15:05.801180 31598 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:05.801501 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2132936259999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:15:05.801810 30848 connection.cc:256] RPC call timeout handler was delayed by -1.1846333940000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 13:15:05.802073 30848 connection.cc:256] RPC call timeout handler was delayed by -1.1405442829998265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 13:15:05.802431 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0383151610001278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2439s for a response
I20260709 13:15:05.575738   631 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.803295   631 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:05.805723   631 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:05.625373   651 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.655048   657 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:05.654652 30954 rpcz_store.cc:269] 0709 13:15:03.225858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.293407 (+2067549us) service_pool.cc:224] Handling call
0709 13:15:05.545153 (+251746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.808326 31023 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.589473   782 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:05.810098   782 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:05.557430 30882 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:05.812253 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 381) took 1924 ms. Trace:
I20260709 13:15:05.812803 31027 rpcz_store.cc:276] 0709 13:15:03.887899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.541046 (+653147us) service_pool.cc:224] Handling call
0709 13:15:05.811976 (+1270930us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54000c3fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.812164 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123296000}
I20260709 13:15:05.814215 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:05.815171 31027 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:05.656409 31024 rpcz_store.cc:269] 0709 13:15:04.447306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.462400 (+ 15094us) service_pool.cc:224] Handling call
0709 13:15:05.655799 (+1193399us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400146c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.655928 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470753152}
I20260709 13:15:05.545894 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.817124 30953 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
W20260709 13:15:05.665089   815 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:15:05.668840 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:05.820294 30880 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:05.820852 31598 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:15:05.821435 31598 pending_rounds.cc:85] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 4
I20260709 13:15:05.821758 31598 pending_rounds.cc:107] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:15:05.822086 31598 raft_consensus.cc:2889] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:05.669795 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2279) took 1779 ms (client timeout 1769 ms). Trace:
W20260709 13:15:05.824026 31032 rpcz_store.cc:269] 0709 13:15:03.889878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.043295 (+153417us) service_pool.cc:224] Handling call
0709 13:15:05.669619 (+1626324us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54003f5cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.669715 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675431680}
I20260709 13:15:05.826071 31032 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:05.827005 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:05.829972 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:05.574990   618 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.635139   746 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.833536   746 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:05.636981   861 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.834216   618 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:05.591470   659 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.836099   861 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:05.836773 31596 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:05.624069   835 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:15:05.730069 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:05.741016 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 162732us
I20260709 13:15:05.735822 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:05.678567 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:05.748116 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 175764us
I20260709 13:15:05.748413 31602 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.655129   679 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:05.733637   784 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:05.755033   686 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.762856 31604 rpcz_store.cc:276] 0709 13:15:04.688909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.547140 (+858231us) service_pool.cc:224] Handling call
0709 13:15:05.547378 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.762050 (+214672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.762315 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.658872 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:05.679445   742 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.001s
I20260709 13:15:05.638165 30950 rpcz_store.cc:276] 0709 13:15:03.505849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.718947 (+1213098us) service_pool.cc:224] Handling call
0709 13:15:04.804811 (+ 85864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.531304   765 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:15:05.772190 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:05.768821 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:05.666078   539 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:05.774050 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:05.732897   822 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:05.655823   632 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.758529   635 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:05.618573   848 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.730737 31601 rpcz_store.cc:276] 0709 13:15:04.689248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.728828 (+1039580us) service_pool.cc:224] Handling call
0709 13:15:05.729237 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:05.729651 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:05.729687 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:05.729752 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:05.729839 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.729918 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:05.730077 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.641192   821 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:05.769940   840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.015s	sys 0.041s
I20260709 13:15:05.734110   836 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:05.667044   634 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.728646   772 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.763181   724 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.759941   776 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:05.756438   780 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.010303 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.838047 31605 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:06.021162 30953 raft_consensus.cc:2368] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
W20260709 13:15:05.868913 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 85883us
I20260709 13:15:05.933398 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.009474 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.014338 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.007661 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:05.851392 31032 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:15:06.024513 31032 pending_rounds.cc:85] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 6
I20260709 13:15:06.024819 30954 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:05.764487   760 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.025712 30877 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:05.761186   853 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:06.008652 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.021982 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.023401 31031 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:15:05.870368 30878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1547) took 1359 ms (client timeout 1546 ms). Trace:
I20260709 13:15:06.051182 30956 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:06.052474 30953 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:15:05.944235 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.025035 30955 raft_consensus.cc:2410] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:06.021917 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:05.901924 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:06.025921 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.056188 31604 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:05.837623 31023 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:06.024744 31032 pending_rounds.cc:107] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 4.7
W20260709 13:15:06.022935 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.058290 31032 raft_consensus.cc:2889] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:05.880996 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:05.838868 30958 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:06.059346 31026 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:06.050983 30878 rpcz_store.cc:269] 0709 13:15:04.511392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.513197 (+  1805us) service_pool.cc:224] Handling call
0709 13:15:05.870092 (+1356895us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540023ffd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:05.870289 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595025280}
I20260709 13:15:06.051798 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1769) took 3532 ms. Trace:
I20260709 13:15:06.022079 30882 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
W20260709 13:15:06.067340 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45503.7us
I20260709 13:15:06.064541 30956 rpcz_store.cc:276] 0709 13:15:02.519367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.050571 (+3531204us) service_pool.cc:224] Handling call
0709 13:15:06.050876 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.051540 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.051725 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.068451 31602 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:06.069002 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 757) took 1044 ms. Trace:
W20260709 13:15:06.063961 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.002s	sys 0.018s
I20260709 13:15:06.070421 31601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:49066
W20260709 13:15:06.070664 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.002s	sys 0.018s
W20260709 13:15:05.914016   852 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:15:05.914779   865 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:15:05.868906 32761 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3.
W20260709 13:15:06.072093 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 280682us
I20260709 13:15:05.901759 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 774) took 1208 ms. Trace:
I20260709 13:15:06.073491 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.016076   787 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.075850 30957 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:06.068104 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:06.086113 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:05.794031 31600 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:05.923614   744 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:05.971972   779 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:06.128002 31604 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:15:06.124168 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 355427us
I20260709 13:15:05.839246 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 746) took 2647 ms. Trace:
I20260709 13:15:05.795246   854 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:05.911871   873 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.009307   847 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:05.878544   775 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.027277   742 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.144719   775 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.145398   772 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.146157   742 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.146085   857 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:06.120646 30954 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:06.147033   857 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.146860   873 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.147367 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1768) took 3628 ms. Trace:
I20260709 13:15:06.119874   539 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:06.146878   775 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.148165   539 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.085515 30953 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:06.124492 30998 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.149021   873 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.149575   873 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.076514 30956 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:15:06.150142   873 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:06.150290   539 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.150498 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1773) took 3630 ms. Trace:
I20260709 13:15:06.147809 30954 rpcz_store.cc:276] 0709 13:15:02.519087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.036803 (+3517716us) service_pool.cc:224] Handling call
0709 13:15:06.120474 (+ 83671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.147089 (+ 26615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.147304 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.150554   779 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.151058 30956 rpcz_store.cc:276] 0709 13:15:02.520493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.069050 (+3548557us) service_pool.cc:224] Handling call
0709 13:15:06.069438 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.150240 (+ 80802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.150443 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:06.151507   639 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.562s	user 0.001s	sys 0.005s
I20260709 13:15:06.127727 30955 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:06.128525 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:06.074782   860 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.408s	user 0.002s	sys 0.002s
I20260709 13:15:06.085721   619 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:05.922978   546 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.131528 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.175204 31604 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:06.072024 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 170184us
W20260709 13:15:06.142300   767 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.363s	user 0.008s	sys 0.005s
I20260709 13:15:06.182034 30951 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:06.183010 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.064271   686 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.023183   542 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:06.071450 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 940519us
W20260709 13:15:06.074827   851 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260709 13:15:05.837766   659 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.138935 31026 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:06.094260 31031 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:06.069270 31602 rpcz_store.cc:276] 0709 13:15:05.024433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.545816 (+521383us) service_pool.cc:224] Handling call
0709 13:15:06.068945 (+523129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.168946 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 687) took 1478 ms. Trace:
W20260709 13:15:06.143033 31025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.005s	sys 0.016s
I20260709 13:15:05.953481   831 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.065474   822 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.227923   822 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.152770   779 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.152963   724 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.071066 31601 raft_consensus.cc:606] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:06.232496 31601 raft_consensus.cc:614] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:06.070125   835 consensus_queue.cc:1243] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:06.152963   861 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.234633   861 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.235052   861 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:06.236835   863 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.575s	user 0.001s	sys 0.001s
I20260709 13:15:06.154928   632 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.136019   631 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.075018   841 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.238591   841 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.085007   635 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:06.240484   635 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:05.952955   709 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 13:15:05.875880   849 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:06.244032   849 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:06.074676   836 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:05.942930   870 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.209s
I20260709 13:15:06.143898   744 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.184919 31030 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:06.150530   873 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:06.127630 31599 rpcz_store.cc:276] 0709 13:15:04.692979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.184106 (+491127us) service_pool.cc:224] Handling call
0709 13:15:05.882395 (+698289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:05.972836   728 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.257905   873 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.259344   873 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:05.915454   777 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.171931   639 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:06.183836   846 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.010s	sys 0.000s
W20260709 13:15:06.265255   846 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.013s	sys 0.003s
I20260709 13:15:06.266819   639 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:05.881186   750 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:06.268042   750 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.268551   750 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.137774 31596 rpcz_store.cc:276] 0709 13:15:03.194227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.201854 (+  7627us) service_pool.cc:224] Handling call
0709 13:15:03.269938 (+ 68084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:05.837177 (+2567239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:05.838963 (+  1786us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54006b21d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:05.839173 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5852013952}
I20260709 13:15:06.184157   633 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:15:06.273105 31603 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:06.244949   849 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.248250   822 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:06.224977 31600 rpcz_store.cc:276] 0709 13:15:04.689562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.349073 (+659511us) service_pool.cc:224] Handling call
0709 13:15:06.168183 (+819110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.186208   723 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.274583   849 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.239156   763 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.243589   634 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.169679 31605 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:06.255573   542 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.251159 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:06.256119   776 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.248515   836 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:06.276671 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:06.276819   836 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:06.277806 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:06.279325   856 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:06.279973   850 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:06.280547   850 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:06.281481   850 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.274672   723 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.284107   723 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.283696   842 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.285115   842 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:06.285498   842 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.256299   829 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.279711   856 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:06.288570   856 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:06.226747   468 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
I20260709 13:15:06.289201   468 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.290942 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 758) took 1233 ms. Trace:
I20260709 13:15:06.291957 31604 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:06.288080   829 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.293679   841 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.294965   829 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.296182   744 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.250510   780 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.066896   848 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.291985   468 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:06.299175   821 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.300096 31597 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:06.301419 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 771) took 1638 ms. Trace:
I20260709 13:15:06.301846 31605 rpcz_store.cc:276] 0709 13:15:04.662699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.665990 (+  3291us) service_pool.cc:224] Handling call
0709 13:15:06.301233 (+1635243us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54007f30d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.301351 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629134720}
I20260709 13:15:06.302700   686 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.181896   619 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:06.297039   782 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.243487   861 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.326177   861 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:06.312099   766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.062s	sys 0.069s
I20260709 13:15:06.299611   848 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.334072   856 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.344152   856 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.160871 30882 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:06.013228 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2110) took 3351 ms. Trace:
W20260709 13:15:06.387449 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 260217us
I20260709 13:15:06.389308 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:06.390266 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:06.391301 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.068069 30880 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
W20260709 13:15:06.392059 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.012s	sys 0.022s
W20260709 13:15:06.392572 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.012s	sys 0.022s
I20260709 13:15:06.392894 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.393206 30881 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:06.394230 30876 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:06.184732 30950 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:06.404615 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.153923 30953 pending_rounds.cc:85] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 2
I20260709 13:15:06.409294 30953 pending_rounds.cc:107] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:06.409373 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.409868 30953 raft_consensus.cc:2889] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:06.159960 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1404) took 3630 ms. Trace:
I20260709 13:15:06.152407 30956 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:06.384682 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.023s	sys 0.033s
W20260709 13:15:06.412708 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.024s	sys 0.033s
I20260709 13:15:06.412876 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1406) took 3871 ms. Trace:
I20260709 13:15:06.413388 30956 rpcz_store.cc:276] 0709 13:15:02.540834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.151933 (+3611099us) service_pool.cc:224] Handling call
0709 13:15:06.152249 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.412250 (+260001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.412666 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.152354 30954 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [2.4-4.5]
I20260709 13:15:06.411084 30955 rpcz_store.cc:276] 0709 13:15:02.540179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.076964 (+3536785us) service_pool.cc:224] Handling call
0709 13:15:06.127406 (+ 50442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.159518 (+ 32112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.159753 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.416069 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1770) took 3892 ms. Trace:
I20260709 13:15:06.416603 30953 rpcz_store.cc:276] 0709 13:15:02.519651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.064958 (+3545307us) service_pool.cc:224] Handling call
0709 13:15:06.065249 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.411387 (+346138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.411704 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.417439 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1405) took 3876 ms. Trace:
I20260709 13:15:06.418112 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1408) took 3873 ms. Trace:
W20260709 13:15:06.418515 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.418641 30955 rpcz_store.cc:276] 0709 13:15:02.544584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.416648 (+3872064us) service_pool.cc:224] Handling call
0709 13:15:06.417226 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.417658 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.417698 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.417778 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:06.417852 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.417909 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.418027 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.419415 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1407) took 3878 ms. Trace:
I20260709 13:15:06.419931 30956 rpcz_store.cc:276] 0709 13:15:02.541079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.414691 (+3873612us) service_pool.cc:224] Handling call
0709 13:15:06.415466 (+   775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.418997 (+  3531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.419027 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.419089 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:06.419139 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.419208 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.419327 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.183859 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.132205 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.420805 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1777) took 3899 ms. Trace:
I20260709 13:15:06.475602   777 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.424070 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.476361   777 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:06.427604 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:06.476960   777 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.477345   635 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.477553 30878 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:06.291492 31598 rpcz_store.cc:276] 0709 13:15:05.057203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.018048 (+960845us) service_pool.cc:224] Handling call
0709 13:15:06.018452 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.233649 (+215197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.233698 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.233761 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:06.233813 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.290620 (+ 56807us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54007143d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:06.290685 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.290869 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494336384}
I20260709 13:15:06.429316 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9907b959044453b57011278bbecdff"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:15:06.478721 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.478921 31605 raft_consensus.cc:606] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.479435 31605 raft_consensus.cc:614] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:06.479818   744 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.476027 30950 rpcz_store.cc:276] 0709 13:15:02.521575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.075008 (+3553433us) service_pool.cc:224] Handling call
0709 13:15:06.168822 (+ 93814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.403383 (+234561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.420612 (+ 17229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.480691   744 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:06.427208 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 148265us
W20260709 13:15:06.476972 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 344721us
W20260709 13:15:06.483399 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.483855 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.428210 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.488065 30877 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:06.489001 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.489971   635 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:06.490142 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.494320 30997 leader_election.cc:400] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:06.494750 30997 leader_election.cc:403] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:06.417937 30954 rpcz_store.cc:276] 0709 13:15:02.540523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.151315 (+3610792us) service_pool.cc:224] Handling call
0709 13:15:06.151973 (+   658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:06.416232 (+264259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.417229 (+   997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.418720 30953 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:06.179431   679 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.441505 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.448570   849 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:06.448765 30956 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:06.181849   546 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.449592   780 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:06.182580   784 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.452809 30955 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:06.454764 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:06.334097   842 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.415336 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.465898   619 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.468340   878 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:15:06.467568 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.430951   379 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.482386 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 473) took 2976 ms. Trace:
I20260709 13:15:06.490305 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.388238 30875 rpcz_store.cc:276] 0709 13:15:02.661728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:03.085914 (+424186us) service_pool.cc:224] Handling call
0709 13:15:03.110367 (+ 24453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:03.126469 (+ 16102us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:04.473912 (+1347443us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.012280 (+1538368us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b1800072c40. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:15:06.012589 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.012802 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.012873 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.012943 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.013031 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.013168 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20762,"prepare.queue_time_us":240928,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":4825,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":22498,"spinlock_wait_cycles":13615488,"thread_start_us":1261224,"threads_started":1,"wal-append.queue_time_us":1169742}
I20260709 13:15:06.499692 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1410) took 3949 ms. Trace:
I20260709 13:15:06.511883 30879 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:06.512123 30874 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:06.500424 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.504878 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1412) took 3956 ms. Trace:
I20260709 13:15:06.503002 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1411) took 3955 ms. Trace:
I20260709 13:15:06.510876   379 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.512068 30953 rpcz_store.cc:276] 0709 13:15:02.547634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.417656 (+3870022us) service_pool.cc:224] Handling call
0709 13:15:06.418136 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.496198 (+ 78062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.496463 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.513396 30956 rpcz_store.cc:276] 0709 13:15:02.547977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.435733 (+3887756us) service_pool.cc:224] Handling call
0709 13:15:06.448363 (+ 12630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.499724 (+ 51361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.502920 (+  3196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.513161 30955 rpcz_store.cc:276] 0709 13:15:02.548273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.436595 (+3888322us) service_pool.cc:224] Handling call
0709 13:15:06.452155 (+ 15560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.503738 (+ 51583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.504812 (+  1074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.495519   635 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5.
I20260709 13:15:06.522228   679 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.522382   885 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.522866   710 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.522964   885 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:06.523695   710 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.519490 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.531399 30877 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:06.449656   876 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:15:06.524529   885 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.540730 30880 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:06.513267 30950 rpcz_store.cc:276] 0709 13:15:03.505542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.480973 (+2975431us) service_pool.cc:224] Handling call
0709 13:15:06.481470 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.481863 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.481895 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.481976 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.482058 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.482155 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.482318 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.547497 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.549124   881 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:06.549557 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 134603us
I20260709 13:15:06.550091 31601 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:06.550622 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.552590 30955 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:06.553107 31602 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:06.554265 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1435) took 1029 ms. Trace:
I20260709 13:15:06.554407 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.554673 30951 rpcz_store.cc:276] 0709 13:15:05.524928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.771565 (+246637us) service_pool.cc:224] Handling call
0709 13:15:06.553831 (+782266us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540008c5d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.554055 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362045824}
I20260709 13:15:06.555382 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 478) took 3047 ms. Trace:
I20260709 13:15:06.555825 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.556751 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:06.557116 30875 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:06.545930 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.558355   842 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:06.558451   881 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.559508   881 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.533762   849 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.555855 30956 rpcz_store.cc:276] 0709 13:15:03.507826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.525126 (+3017300us) service_pool.cc:224] Handling call
0709 13:15:06.538534 (+ 13408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.554992 (+ 16458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.555023 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.555082 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.555126 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.555187 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.555314 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.560796 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1430) took 1054 ms. Trace:
I20260709 13:15:06.561142 30958 rpcz_store.cc:276] 0709 13:15:05.505972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.730526 (+224554us) service_pool.cc:224] Handling call
0709 13:15:06.560408 (+829882us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400256554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.560613 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246201216}
I20260709 13:15:06.561919 30956 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:06.562072   849 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:06.555912 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 361370us
I20260709 13:15:06.550105 31596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:15:06.569010 31596 raft_consensus.cc:606] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.569252 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1745) took 1032 ms. Trace:
I20260709 13:15:06.569762 31023 rpcz_store.cc:276] 0709 13:15:05.536754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.536903 (+   149us) service_pool.cc:224] Handling call
0709 13:15:06.568861 (+1031958us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b54003782d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.569045 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181374208}
I20260709 13:15:06.571668 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 13:15:06.572556 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2277) took 2683 ms (client timeout 2006 ms). Trace:
W20260709 13:15:06.573074 31030 rpcz_store.cc:269] 0709 13:15:03.889283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.436878 (+547595us) service_pool.cc:224] Handling call
0709 13:15:06.572070 (+2135192us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400147654. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.572271 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4017922304}
I20260709 13:15:06.575104 31024 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:15:06.576408 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 82386.6us
I20260709 13:15:06.577446 31028 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:15:06.578533 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 510319us
I20260709 13:15:06.578943   546 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.579880 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:06.581382 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:06.582170   542 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.582934   542 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.583060 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:06.583362   542 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:06.585381 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1425) took 1080 ms. Trace:
I20260709 13:15:06.585925 30957 rpcz_store.cc:276] 0709 13:15:05.504528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.522454 (+ 17926us) service_pool.cc:224] Handling call
0709 13:15:06.565924 (+1043470us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54001e0854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.585172 (+ 19248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269763840}
I20260709 13:15:06.588696 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 759) took 1007 ms. Trace:
I20260709 13:15:06.562937 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 477) took 3056 ms. Trace:
I20260709 13:15:06.589227 31597 rpcz_store.cc:276] 0709 13:15:05.581479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.633117 (+ 51638us) service_pool.cc:224] Handling call
0709 13:15:06.588272 (+955155us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400323a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.588473 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":629312384}
I20260709 13:15:06.589349 30953 rpcz_store.cc:276] 0709 13:15:03.506696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.518049 (+3011353us) service_pool.cc:224] Handling call
0709 13:15:06.544398 (+ 26349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.559499 (+ 15101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.559530 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:06.559604 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:06.559650 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.559715 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.562884 (+  3169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:06.592648 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:06.563011   766 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.555588 30998 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.608270   766 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.609949 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.610716 31599 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:06.611807 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.613376   379 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.613396 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.615123 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.594880   542 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.619652   651 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.626358   836 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.627869 30958 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:06.628093 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.629022 31596 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:06.630574   546 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:06.633662 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.635124 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:06.635332   546 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:06.566334   635 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:06.636600   849 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:06.636893   635 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.636987   849 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:06.637337   635 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:06.638280 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:06.638240   849 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.639025 30880 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.639840   849 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:06.646797 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 91589.1us
I20260709 13:15:06.647078   861 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.647581   861 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.647975   861 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.603483   878 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:06.657519   878 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:06.658073   878 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.660166 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 384) took 2771 ms. Trace:
I20260709 13:15:06.660846 31028 rpcz_store.cc:276] 0709 13:15:03.888730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:04.703540 (+814810us) service_pool.cc:224] Handling call
0709 13:15:06.576557 (+1873017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.577993 (+  1436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.659739 (+ 81746us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400147650. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.660025 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4212209920}
I20260709 13:15:06.663460 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2301) took 1112 ms. Trace:
W20260709 13:15:06.664651 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 81726.2us
W20260709 13:15:06.665582 31603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 775) took 1972 ms (client timeout 1868 ms). Trace:
W20260709 13:15:06.666209 31603 rpcz_store.cc:269] 0709 13:15:04.693318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.139788 (+446470us) service_pool.cc:224] Handling call
0709 13:15:06.665049 (+1525261us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540042b8d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.665312 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2586039168}
W20260709 13:15:06.684523 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.671357 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:06.691987 30879 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:06.692181   850 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:06.681718 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:06.663530 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 83832.4us
I20260709 13:15:06.694151 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.694854 30958 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:06.682467 31570 connection.cc:256] RPC call timeout handler was delayed by -2.5332071069999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 13:15:06.696013 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 118575us
I20260709 13:15:06.697041 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.697695 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.698526 31597 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:06.611418   766 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.667708 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.702085 31603 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:06.664078 31024 rpcz_store.cc:276] 0709 13:15:05.551036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.816144 (+265108us) service_pool.cc:224] Handling call
0709 13:15:06.574349 (+758205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.575709 (+  1360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.663147 (+ 87438us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003782d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:06.663367 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742372096}
I20260709 13:15:06.621770 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.710000 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 760) took 1120 ms. Trace:
I20260709 13:15:06.621040 30951 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:06.710516 31604 rpcz_store.cc:276] 0709 13:15:05.588979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.176015 (+587036us) service_pool.cc:224] Handling call
0709 13:15:06.176311 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.292371 (+116060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.709354 (+416983us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400459cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:06.709761 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265535232}
W20260709 13:15:06.696369 31570 connection.cc:256] RPC call timeout handler was delayed by -2.1498071069997877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 13:15:06.711593 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0926382219997777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:15:06.712005 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0625071069998739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:15:06.712384 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0616071069998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 13:15:06.712767 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0337071069998274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
W20260709 13:15:06.713383 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0199585989998923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 13:15:06.714037 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9956115150000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
W20260709 13:15:06.736308 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9428071069999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2298s for a response
I20260709 13:15:06.714553 30957 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:06.715791 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 50024.4us
I20260709 13:15:06.669353 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.740648 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:06.710566 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.728199 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 77607.8us
W20260709 13:15:06.728524 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 125993us
I20260709 13:15:06.729024   763 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.732365   881 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.628897   885 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:06.736883 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9167328940000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:15:06.756815 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9147071630000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:15:06.757171 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9002569689998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 13:15:06.757432 31570 connection.cc:256] RPC call timeout handler was delayed by -1.8373071629998776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:15:06.757711 31570 connection.cc:256] RPC call timeout handler was delayed by -1.7392523849998724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
I20260709 13:15:06.731350   710 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.605374 31605 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:15:06.748261 30922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.002s	sys 0.014s
I20260709 13:15:06.749565 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:06.766108 30922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.002s	sys 0.015s
I20260709 13:15:06.736075 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:06.774045 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 77154.8us
I20260709 13:15:06.777000 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:06.782598   633 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.764905   766 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.781512 30878 raft_consensus.cc:2410] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:06.787189   766 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.799355   766 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.788635 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:06.805246 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:06.758534   777 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.811058 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.791400 30996 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.820307 31603 raft_consensus.cc:2410] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:06.822237   849 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:06.822722   849 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:06.823091   849 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.789281   633 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.828172 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1774) took 4027 ms. Trace:
I20260709 13:15:06.838743 30949 raft_consensus.cc:2410] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:06.842778 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.843783 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72197.2us
I20260709 13:15:06.843225   849 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.827376   542 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:06.849678 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 70300.8us
I20260709 13:15:06.849874   850 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:06.850589   542 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.851146 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:06.851866   850 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:06.852645 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:06.856129 30881 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:06.856818   744 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:06.857577 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 96670.8us
I20260709 13:15:06.858425 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.859133   686 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:06.855751 30958 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:06.860324 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:06.845093 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:06.859985   821 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.858407 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:06.843351 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:06.870157 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 104483us
I20260709 13:15:06.870460 30880 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:06.871388 30879 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:06.836488   633 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.878491 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.881299   784 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:06.849732   750 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.007s
I20260709 13:15:06.828673 30952 rpcz_store.cc:276] 0709 13:15:02.520776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.069612 (+3548836us) service_pool.cc:224] Handling call
0709 13:15:06.070579 (+   967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:06.070968 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:06.070998 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:06.071463 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:15:06.402894 (+331431us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:06.510123 (+107229us) log.cc:844] Serialized 14 byte log entry
0709 13:15:06.536073 (+ 25950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:06.541305 (+  5232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:06.545486 (+  4181us) raft_consensus.cc:1685] finished
0709 13:15:06.545500 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:06.548408 (+  2908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15907,"prepare.queue_time_us":141342,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":25666,"raft.queue_time_us":21219,"raft.run_cpu_time_us":586,"raft.run_wall_time_us":107214,"thread_start_us":379362,"threads_started":2,"wal-append.queue_time_us":220072}
I20260709 13:15:06.865100   821 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.876993 30950 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:06.881572   861 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.900490 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:06.900185 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.890064   744 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:06.910766   744 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.911239   744 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:06.911934   784 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:06.913192 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.914309   861 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:06.889732 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.915884 30958 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:06.916227 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 57972.8us
I20260709 13:15:06.916606 31599 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:06.917052 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.917793 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.918475 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.919229 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.920239   651 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.920308 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:06.920917   651 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:15:06.924767 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.890244   821 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:06.930356 30880 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:06.915887   766 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.932622   842 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.933112   842 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:06.933275 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:06.933547   842 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.933997   766 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.934531 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.936486 30881 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:06.937592 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 62484.9us
I20260709 13:15:06.935637 30951 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:06.942512 30957 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:06.949191   639 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:06.949649   639 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.950136   639 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:06.950289 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 63065.4us
I20260709 13:15:06.951088   857 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:06.951654   857 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:06.951898   892 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:06.952873   857 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.955072   784 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:06.955694 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.956737   784 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.958284   635 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:06.958877 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:06.960544 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.961452 30951 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:06.961599   780 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:06.962271 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:06.962327   780 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:06.963961   728 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:06.963873   780 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.964888   728 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:06.960580   635 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.950327   847 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:15:06.949702   861 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:06.969363 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:06.969720   379 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:06.970376 30951 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:06.970855   379 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.971352   379 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:06.948894   710 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:06.886161   878 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:06.928771   836 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:06.977587 30955 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:06.979948 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.937247 31597 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:06.947991 30952 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:07.013759 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:06.980504 30958 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:06.950096   651 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:06.980326 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:06.987862 30951 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:06.996758   777 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:06.998946   723 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.005s
I20260709 13:15:07.000664 30953 raft_consensus.cc:2410] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:06.896276   750 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.002036   639 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.003196 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:06.951682 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:06.969758   861 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.007460   878 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:07.008925 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:07.031293 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.068352 30998 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:07.055456 31599 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:07.064476   861 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.085815 30956 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:15:07.087613 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 78753.3us
I20260709 13:15:07.089695 30880 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.058143 31600 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:07.065532   777 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.070926   766 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.091926   780 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:07.098723   780 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:07.105371 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 153792us
I20260709 13:15:07.062127   723 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.104206   780 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.121986 30880 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:07.117789 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:07.123432 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.122162   850 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.134982 30847 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:07.109186 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.139387 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.144004   878 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:07.144908   878 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:07.142379   679 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.002s
I20260709 13:15:07.111477   777 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:07.158203   895 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:15:07.147553   878 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.141038   881 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.155515 31597 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.160493   836 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.183164 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 280660us
W20260709 13:15:07.186354 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 224133us
I20260709 13:15:07.166638   881 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.123034   379 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.151777   780 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.175930 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:07.195130 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 409106us
I20260709 13:15:07.201015 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 475) took 3685 ms. Trace:
W20260709 13:15:07.215121 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.215605 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.216045 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.195823   639 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:07.190128   876 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.219717 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1437) took 1452 ms. Trace:
I20260709 13:15:07.227384 30949 rpcz_store.cc:276] 0709 13:15:05.766899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.009261 (+242362us) service_pool.cc:224] Handling call
0709 13:15:07.207161 (+1197900us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54003fedd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:07.219657 (+ 12496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851604352}
I20260709 13:15:07.208599 30922 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.192693   881 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.225016 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:07.193790   848 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.241456   723 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.242869   886 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:07.246338   777 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:07.195940   686 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:07.242753   723 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:07.259083 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 134597us
W20260709 13:15:07.256402 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47879us
W20260709 13:15:07.261541 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 193266us
W20260709 13:15:07.264880 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.266235 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.218684   847 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:15:07.270131 30998 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:07.236228   750 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.230547 31600 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:07.277307 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.283680 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:07.284998 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.233717   836 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:07.281108 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 421663us
I20260709 13:15:07.242779   639 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:15:07.306243 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.308815 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:07.309108   899 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:15:07.310253 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.310873 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.312980   723 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:07.313107 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 121149us
I20260709 13:15:07.313484   723 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:07.313997 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:07.314525   723 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.317382   635 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:07.317983   635 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:07.318097   898 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:15:07.318977   635 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.319679 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.320950 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.321558   780 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.321988 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.324229 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.325117   856 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.325635 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:07.325932   856 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:07.326295   856 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:07.326797 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.328012   723 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.328289 30874 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:07.329384 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.329957   836 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.333719 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.274572   651 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:07.337183 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 103982us
I20260709 13:15:07.339660 30997 leader_election.cc:400] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:15:07.341351 30997 leader_election.cc:403] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:07.342244 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.311038   633 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.346709 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.299551   763 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.328083   909 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:07.311510 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:07.345156 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.362434 30883 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:07.364557 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 64100us
I20260709 13:15:07.346402   876 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:07.311522 31598 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 2.
W20260709 13:15:07.391300 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 92475.1us
W20260709 13:15:07.391608 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 77710.1us
I20260709 13:15:07.377542   847 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:07.395490 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 94145.3us
I20260709 13:15:07.396442 31604 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:07.343272   821 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.383661   651 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:07.392149 30923 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.072s (SENT) [suppressed 48 similar messages]
W20260709 13:15:07.400616 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 125144us
I20260709 13:15:07.406103 30877 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:07.406639 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.407653 31601 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.415391 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.416656 30883 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:07.401427   651 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:07.418540   686 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.418956   907 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:07.420404   907 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:07.420855   907 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:07.421744 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.421876   907 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.422959 30996 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.418578   651 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.428104   907 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.424247 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:07.430150 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1744) took 1894 ms (client timeout 2232 ms). Trace:
W20260709 13:15:07.430552 31029 rpcz_store.cc:269] 0709 13:15:05.535316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.535490 (+   174us) service_pool.cc:224] Handling call
0709 13:15:07.429787 (+1894297us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003764d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:07.429965 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650782080}
I20260709 13:15:07.431519   908 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.436372   908 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:07.436877   886 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:07.437408   886 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.437132   908 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:07.439527 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.428807   784 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.414428 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.381422   857 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:15:07.400035   909 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:07.451066 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:07.448498   842 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.002s
I20260709 13:15:07.405666   861 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.464311   876 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:07.493166 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 84732.6us
I20260709 13:15:07.498636 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.494562 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.472057 31597 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:07.395897   856 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:07.517678 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 107988us
I20260709 13:15:07.494175 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:07.503165   744 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.005s
I20260709 13:15:07.528293   922 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.529874   915 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:07.530741   915 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.533631   915 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.536538   782 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:07.538127   633 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.544018   921 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.544726   921 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.547312   921 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:07.548655   902 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:15:07.201506 30954 rpcz_store.cc:276] 0709 13:15:03.506166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.502926 (+2996760us) service_pool.cc:224] Handling call
0709 13:15:06.539407 (+ 36481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.559914 (+ 20507us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:06.737494 (+177580us) log.cc:844] Serialized 14 byte log entry
0709 13:15:07.190977 (+453483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:07.191027 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:07.191079 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.191212 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:07.191387 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31318,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":188,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4397,"thread_start_us":588609,"threads_started":2}
I20260709 13:15:07.555306   777 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:07.484598   842 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.561116   744 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.567978   927 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:07.600028 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.510792   763 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.575838   861 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.575968   782 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:07.576905 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 172621us
I20260709 13:15:07.502007   857 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.577225 31605 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:07.531397 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.578083   909 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.580235   821 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.581419   881 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.508140 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.582288 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.584462 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1798) took 1810 ms. Trace:
I20260709 13:15:07.575541   710 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:15:07.586547 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 140237us
I20260709 13:15:07.594376   542 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:07.596611   842 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:07.563247 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:07.599483 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 189841us
I20260709 13:15:07.569723 31597 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:15:07.613759 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.622987 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.598192   777 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:07.665429 31603 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:07.672025 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.518831   766 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.636663 30881 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:15:07.638068 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 50831.3us
I20260709 13:15:07.680822 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:07.668004 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.690611 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 187520us
I20260709 13:15:07.636219   782 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.685981 30953 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:07.686048 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.668360   542 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.686780 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:07.672405   750 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:07.686918   777 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.687793 30951 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:07.702847 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:07.665611 30955 rpcz_store.cc:276] 0709 13:15:05.774064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.553666 (+779602us) service_pool.cc:224] Handling call
0709 13:15:06.554146 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:07.010371 (+456225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.584184 (+573813us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54002b6e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:07.584393 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973013376}
I20260709 13:15:07.666280   763 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:07.660908   744 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:07.694408 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.705713 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:07.693403 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:07.677784   379 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.708638 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:07.675944   881 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.673964   651 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.691578   908 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.720412 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.635339   906 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:15:07.740784   750 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.708222   766 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.747352 31597 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:07.749778   542 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:07.706218   763 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:07.750645   784 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:07.751232   763 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.752512   763 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:07.713003 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:07.757138   885 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.757856   885 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.760242   842 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:07.761333   842 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.762221   651 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.764616   842 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:07.765488 30954 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:07.721299 31602 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:07.770377   782 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:07.771430 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 90719.8us
I20260709 13:15:07.743467   750 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.785568 31601 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:07.798272 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 107389us
W20260709 13:15:07.793599 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76762.6us
I20260709 13:15:07.806003   744 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:07.808257   861 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:07.809167   849 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:07.809230 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.788318   777 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:07.813834 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:07.816255 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 110414us
I20260709 13:15:07.827562 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.828392 31601 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.801502 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 482) took 1238 ms. Trace:
I20260709 13:15:07.831836 31602 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:07.811452   885 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:07.835264 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 128185us
I20260709 13:15:07.832957 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.838526 31604 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:07.839870   936 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.842818   936 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:07.844550 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.846674 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.847368 31599 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:07.853905   911 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:07.855075   936 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:07.856523 30882 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:07.857918 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.860430   919 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.859163   911 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:07.832345 30950 rpcz_store.cc:276] 0709 13:15:06.565519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:06.605803 (+ 40284us) service_pool.cc:224] Handling call
0709 13:15:06.781182 (+175379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:06.903004 (+121822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:07.784113 (+881109us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b5400350a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:07.801403 (+ 17290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188474752}
I20260709 13:15:07.861155   728 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:07.864473 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:07.863417   919 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:07.865283   919 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:07.865645 31599 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:07.868394 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:07.868310   919 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.869766   919 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:07.870496 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:07.871166 30954 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:07.878185   542 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:07.879900   876 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:07.881603   876 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:07.884146   766 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:07.886302   886 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.878243   849 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:15:07.919497 31601 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:15:07.929121 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44053.8us
I20260709 13:15:07.930107 30847 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:07.931252 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:07.926823 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.940166   744 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:07.942341   945 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:07.893554   876 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:15:07.933110   728 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:07.962404 30847 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:07.937160   679 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:07.961696 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:07.961966 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.971159 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:07.972487   911 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:07.973256 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:07.974503   911 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:07.974606 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:07.974967   686 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:07.975180   911 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:07.976013   639 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:07.975719   686 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.976593   639 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:07.977823   639 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.980315   686 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:07.980477   911 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.990211 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:07.993783   848 raft_consensus.cc:2764] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:07.995117   848 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:07.996124   922 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:07.996533   922 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:07.997430   922 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:07.945734   842 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:07.998471   922 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.989617   679 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:08.000928   686 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:08.001215   886 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.032742 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:08.037921   909 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:07.990218   728 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:08.095338 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.104584   948 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:15:08.038683   909 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:08.117585 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 117307us
I20260709 13:15:08.124157   946 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:08.124897   946 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:08.126040   946 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.127899   940 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:08.128554   940 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:08.129052   940 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.112391   744 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:08.162669 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 167743us
I20260709 13:15:08.114929   945 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:08.168975 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.169778 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:08.171386 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1573) took 1164 ms. Trace:
I20260709 13:15:08.171865 30881 rpcz_store.cc:276] 0709 13:15:07.003113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.003240 (+   127us) service_pool.cc:224] Handling call
0709 13:15:07.003649 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:07.691091 (+687442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:08.167001 (+475910us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54001270d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:08.167250 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455211776}
I20260709 13:15:08.171658   679 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.184532 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:08.172755   744 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:08.194499 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:08.175876   886 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:08.185840   782 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:08.202913 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 241078us
I20260709 13:15:08.187620   945 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:08.195356   710 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:08.195514   941 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.206188 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:08.195812   842 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.201381   780 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:08.203841 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 241545us
W20260709 13:15:08.259939 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.199007   763 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:15:08.266656 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 59239.4us
I20260709 13:15:08.201191   936 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:15:08.205507   679 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.207918   928 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:15:08.295014 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:08.312749 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 106634us
I20260709 13:15:08.266001   927 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.203997   686 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:15:08.199534   728 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:08.314432 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49651.9us
I20260709 13:15:08.207711   886 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:08.290270   947 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:15:08.278986   943 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:08.320120   927 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.320531   945 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:08.316193 30876 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:08.338178 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 76081.7us
I20260709 13:15:08.338488 30882 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:15:08.313908   885 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:08.338984 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.280153   848 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:15:08.315467   780 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:08.321857   619 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:15:08.315436   908 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:08.268595   782 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.338903 30882 pending_rounds.cc:85] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 6
I20260709 13:15:08.350080 30882 pending_rounds.cc:107] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:15:08.342876 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:08.350400 30882 raft_consensus.cc:2889] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:08.352301 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:08.267827   941 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:08.359526 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 71321.4us
I20260709 13:15:08.347261   861 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.372707 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:08.377866 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.384840 30881 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:08.385809 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:08.386397 30882 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.384735 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:08.388069 30878 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.384138 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.389065 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.389361 30949 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:08.390141 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.390777 30876 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:08.391672 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.392225 30876 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:08.393185   782 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.394791 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.352449   885 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:08.397022   951 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:15:08.375010   686 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:08.398169 30997 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:08.399688 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:08.400084 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:08.400751   686 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.400934 31024 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:08.401659   686 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:08.403019 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.403475 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.397368   885 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:08.413262 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.413424 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.415413   885 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.416069   885 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:08.416846 30878 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:08.420348   885 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:08.413506 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:08.421687   956 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:08.316100   744 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.422115 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:08.422909   885 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.423308   885 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.423638   885 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.364531   922 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:08.427206 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:08.433408 30880 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:08.427917 30883 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:08.438491 30952 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.445343 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:08.441740 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:08.454321 31605 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:08.425230   856 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.434489   782 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:08.435585   909 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.436760   922 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:08.364022   908 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.427517   861 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:08.491665 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.467566 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:08.492982 30952 raft_consensus.cc:2410] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:08.493219 31602 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.435209   763 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:15:08.434636   848 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:15:08.489034   780 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.456943   379 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:15:08.504691 31599 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:08.477355   782 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:08.478750 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.514739 31602 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:08.507678 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.489703   922 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.524646 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.525049   710 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:08.528157 30880 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:08.529624 30923 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.769s (SENT)
W20260709 13:15:08.530561 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.499202 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:08.543068 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.544998   941 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.546247 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:08.548167 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:08.549515 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 149893us
I20260709 13:15:08.518170   782 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.557665 30952 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:08.555881 31024 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:08.520164   878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.013s
I20260709 13:15:08.562747 31602 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:08.553155   886 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:08.560618   878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.005s	sys 0.013s
I20260709 13:15:08.598961 31596 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:08.568608   959 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:15:08.601168   958 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:15:08.601822   959 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:08.576560 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.602330 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.605160   959 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:08.630417   954 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.313s	user 0.004s	sys 0.000s
I20260709 13:15:08.641641   686 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:08.658803 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:08.659369 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.660535 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.661717 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.660882 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.663085 30958 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:08.660640 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.667224 30955 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:08.665973 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.662627 30952 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:08.672508 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:08.673739 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 154657us
I20260709 13:15:08.671023 31024 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:08.657637   932 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:08.682193 31029 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:08.683641 30923 leader_election.cc:336] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.820s (SENT)
I20260709 13:15:08.687044 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:08.661178   927 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.689869 31028 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:08.704041 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:08.705605 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:08.709041 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 496) took 1032 ms. Trace:
I20260709 13:15:08.709476 30954 rpcz_store.cc:276] 0709 13:15:07.676612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.690245 (+ 13633us) service_pool.cc:224] Handling call
0709 13:15:08.708851 (+1018606us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b5400256a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:08.708969 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125927808}
I20260709 13:15:08.710671   686 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:08.711858   906 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.712498   906 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:08.713292 30882 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:08.713948   906 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:08.715935   966 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:15:08.684767   932 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:08.717460   932 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:08.718837   932 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:08.700412 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.700815   782 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:08.701483   940 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:15:08.720288 30955 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:08.720590   940 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.721419 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:08.721616   861 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:08.721956   782 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:08.722169   958 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.722649   940 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.726594 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.727267 30880 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:15:08.727948 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 368337us
I20260709 13:15:08.728701 30883 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:08.702553   908 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.732200 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:08.733093   908 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.733711   908 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.733810   885 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.734894 30953 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:08.735993   861 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:08.737859 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:08.739233 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:08.740059 31029 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.740223 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:08.742022   908 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.722716   958 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.744349 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.736232 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:08.745505 30876 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:08.747174 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:08.747560   856 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:08.750607 31024 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:08.752847 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:08.753439   881 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:08.776569 30952 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:08.777891 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.778564 30958 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:08.781116 31026 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:08.776311   917 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:15:08.782959   881 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.788254 31030 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:08.826602 31028 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:08.890832 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:08.806368 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 53581.1us
I20260709 13:15:08.874405 31029 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:08.889286 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.811107 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.933486 30949 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:08.933717 30952 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:08.866432 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.934765 30955 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:07.838304 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:08.850013 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:08.925630 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.820722 30958 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:08.802346   881 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.802546   908 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:08.938503 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.305433 31028 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:09.305162   908 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.306325 31027 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:08.985239   763 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.307343   908 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.933193 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:09.307670   763 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:08.787498   782 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:08.827248   917 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.309636   917 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:09.309823   763 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:08.821853   922 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.312292 31603 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:09.312927   922 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:09.314164   961 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:09.314604   961 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:09.315306 30883 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:09.315481   961 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.316533   961 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.296008 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:08.851619   945 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.317426   945 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } }
I20260709 13:15:09.295469   906 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:09.318552   906 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:08.967541 30952 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
W20260709 13:15:08.973950 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 290334us
W20260709 13:15:09.338829 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:08.970157 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:09.352622 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.137914 30955 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:08.962679 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:09.354054 30954 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:09.127100 30949 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:08.995478 31030 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:09.188225 31023 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:09.029871 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:08.980926 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.360955 31029 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
W20260709 13:15:09.355906 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 650322us
I20260709 13:15:09.362576 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:09.270218 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.366250 31026 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
W20260709 13:15:09.210667   963 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.552s	user 0.001s	sys 0.002s
I20260709 13:15:09.368234 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:09.371757 30955 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:09.359082 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:09.372943 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77106.2us
W20260709 13:15:09.024984 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 85340.5us
W20260709 13:15:09.377737 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.379601 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:08.823019   886 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.383826 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:09.207736   958 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:09.346146   861 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.398082 31028 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:09.403559 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.424890 31026 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 2.
I20260709 13:15:09.430848 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:09.436236 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.437518 31029 raft_consensus.cc:2376] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6. Re-sending same reply.
W20260709 13:15:09.439502 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.378432   881 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:09.444586   945 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:09.395498   750 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:09.450134 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.422693   908 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.450150   861 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:09.428598   780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.015s	sys 0.012s
I20260709 13:15:09.457690   763 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.426537   965 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:09.463753   836 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:09.466938 30776 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:09.482263 30950 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:09.355547   635 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:15:09.389042   856 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 13:15:09.424065   886 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.462695 30780 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54998 (request call id 322) took 11007 ms. Trace:
I20260709 13:15:09.496399 31026 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:09.473295 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.427121   847 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.509346 30876 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:09.540987 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.556993 31028 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.488461 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.508025   917 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:09.496147   780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.015s	sys 0.013s
I20260709 13:15:09.559270 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.497105   750 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.336421   906 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.547655   907 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:09.290995   959 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.552843 31023 raft_consensus.cc:2376] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8. Re-sending same reply.
I20260709 13:15:09.570088 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.570684 31023 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:09.487180   885 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:09.541463   836 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:09.495393   619 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.494740 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.572888 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:09.548694 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 118226us
I20260709 13:15:09.446081   928 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:15:09.626819 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.627784 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:09.630329 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.557020 30776 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 4, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.600734 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.601876 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.633345 31029 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.541249   763 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.602728   780 raft_consensus.cc:2764] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:09.564540   917 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.554391   881 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.605544   907 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:09.567263   750 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:09.551168 30780 rpcz_store.cc:276] 0709 13:14:58.458183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.462980 (+  4797us) service_pool.cc:224] Handling call
0709 13:15:09.462481 (+10999501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:03.354389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:03.354959 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:03.354993 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:15:03.355011 (+    18us) tablet.cc:662] Decoding operations
0709 13:15:03.518424 (+163413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:03.518514 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:03.518543 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:15:03.719969 (+201426us) tablet.cc:701] Row locks acquired
0709 13:15:03.721168 (+  1199us) write_op.cc:260] PREPARE: finished
0709 13:15:03.742804 (+ 21636us) write_op.cc:270] Start()
0709 13:15:03.784840 (+ 42036us) write_op.cc:276] Timestamp: P: 1783602903740751 usec, L: 0
0709 13:15:03.790169 (+  5329us) op_driver.cc:348] REPLICATION: starting
0709 13:15:03.933869 (+143700us) log.cc:844] Serialized 4654 byte log entry
0709 13:15:05.608178 (+1674309us) op_driver.cc:464] REPLICATION: finished
0709 13:15:06.124835 (+516657us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f2737b500ac 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273e690ef0
0709 13:15:06.219887 (+ 95052us) write_op.cc:301] APPLY: starting
0709 13:15:06.219975 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:06.220221 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:06.220239 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:06.250000 (+ 29761us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:06.250316 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:15:06.250634 (+   318us) write_op.cc:312] APPLY: finished
0709 13:15:06.347020 (+ 96386us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b5400260054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5732a 00007f273abdcf14 00007f273abdcec3 00007f273abdce38 00007f273abdcdf3 00007f273abdc0dc 00007f273ac05e16 00007f273abedcbb 00007f273abd839d 00007f273abdbd75
0709 13:15:06.349016 (+  1996us) log.cc:844] Serialized 83 byte log entry
0709 13:15:06.349530 (+   514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:06.349684 (+   154us) write_op.cc:454] Released schema lock
0709 13:15:06.349735 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:06.350169 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:06.350192 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1603,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":595525,"apply.run_cpu_time_us":7337,"apply.run_wall_time_us":130251,"num_ops":11,"prepare.queue_time_us":352205,"prepare.run_cpu_time_us":54318,"prepare.run_wall_time_us":1423671,"raft.queue_time_us":969274,"raft.run_cpu_time_us":20036,"raft.run_wall_time_us":872433,"replication_time_us":1754667,"spinlock_wait_cycles":299773952,"thread_start_us":3163611,"threads_started":4,"wal-append.queue_time_us":526254,"wal-append.run_cpu_time_us":64981,"wal-append.run_wall_time_us":2995828}]]}
I20260709 13:15:09.611141   861 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:09.542428   908 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:09.637405 31032 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:09.623169 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:09.639008 31028 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:09.560705   847 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.636584   959 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:09.646497 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.667722 31030 raft_consensus.cc:2376] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8. Re-sending same reply.
I20260709 13:15:09.647006   886 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:09.613502   922 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.638473 31027 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:09.676301 30776 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 5 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.663230 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.674770 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.679198 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.652483   932 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:09.681376 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 748390us
I20260709 13:15:09.681408 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.681787   922 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.683435 31605 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:09.683882 31605 pending_rounds.cc:85] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 6
I20260709 13:15:09.684017   922 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:09.684141 31605 pending_rounds.cc:107] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:09.684566 31605 raft_consensus.cc:2889] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:09.687042 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.679466 31028 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:09.690466 31602 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:09.692309 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.687683 31032 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:09.637847   965 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:15:09.696344 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.722755 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.638227 31597 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:09.721184 31029 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:09.724918 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.725683 31029 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:09.724926 30776 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 5 to 7, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:09.722483 31024 raft_consensus.cc:2376] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
I20260709 13:15:09.723538 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.720762 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:09.767472 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:09.768306 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47680.6us
I20260709 13:15:09.769387 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.770165 31024 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.771140 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.771250 30776 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 4, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:09.743119 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:09.694473   784 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.652585   619 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.792169 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.681593 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.793025 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.802167 31032 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.795194 31026 raft_consensus.cc:2376] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
I20260709 13:15:09.790848 30776 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 4, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:09.808399 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.810678 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:09.720757 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 796) took 1299 ms. Trace:
I20260709 13:15:09.735332   876 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.810789 30776 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 5, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 5 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.790045   945 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:09.662135   836 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.800588 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.841073 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.810379   842 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.862679 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.863344 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.866050 31027 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:09.866235 31026 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:09.876200 30882 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.020s
I20260709 13:15:09.876544 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.872749 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:09.948812 30882 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.000s	sys 0.021s
I20260709 13:15:09.865007 30776 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:09.878189 31025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.018s	sys 0.035s
W20260709 13:15:09.950758 31025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.023s	sys 0.044s
I20260709 13:15:09.796969 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:09.952389 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 155471us
I20260709 13:15:09.953207 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:09.873858 31599 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:09.949008 31026 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:09.979678 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2332) took 1013 ms. Trace:
W20260709 13:15:09.981887 30956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.025s
I20260709 13:15:09.802579   784 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.980207 31026 rpcz_store.cc:276] 0709 13:15:08.966469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.872390 (+905921us) service_pool.cc:224] Handling call
0709 13:15:09.979601 (+107211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:09.982487 30956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.011s	sys 0.025s
I20260709 13:15:09.870970   922 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:09.988974 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 507) took 1431 ms. Trace:
W20260709 13:15:09.979542   782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.030s
I20260709 13:15:09.942800   958 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.990024 30776 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 3, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 3 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:09.981582 31596 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:09.992338 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:09.855904   876 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:09.989542 30954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.008s	sys 0.028s
I20260709 13:15:09.941778   849 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:09.816258 31598 rpcz_store.cc:276] 0709 13:15:08.421510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.438829 (+ 17319us) service_pool.cc:224] Handling call
0709 13:15:09.572326 (+1133497us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:09.696080 (+123754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17458432}
W20260709 13:15:09.997581   782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.030s
I20260709 13:15:09.978139   943 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:10.015960   943 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.016461   943 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:10.020463   984 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:15:09.996933   994 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:10.021806 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1764) took 1283 ms. Trace:
W20260709 13:15:10.002471 30954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.029s
I20260709 13:15:09.869786   842 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.978999   909 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:10.007560 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:10.007650 31028 raft_consensus.cc:2410] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:10.042115 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2324) took 1077 ms. Trace:
I20260709 13:15:10.042681 31028 rpcz_store.cc:276] 0709 13:15:08.964535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.978508 (+1013973us) service_pool.cc:224] Handling call
0709 13:15:10.042033 (+ 63525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.008448 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:09.839066   907 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.988227   836 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:10.009557 30776 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 4, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:10.012809 31031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.008s
I20260709 13:15:10.015441   876 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:09.996973 30956 rpcz_store.cc:276] 0709 13:15:08.557967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.558119 (+   152us) service_pool.cc:224] Handling call
0709 13:15:08.558530 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:08.562105 (+  3575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.562137 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:08.570860 (+  8723us) log.cc:844] Serialized 52 byte log entry
0709 13:15:08.829092 (+258232us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:09.311274 (+482182us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.423694 (+112420us) log.cc:844] Serialized 14 byte log entry
0709 13:15:09.988499 (+564805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.988596 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:09.988636 (+    40us) raft_consensus.cc:1685] finished
0709 13:15:09.988646 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:09.988905 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76018,"prepare.queue_time_us":237599,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":317034,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":13796,"thread_start_us":1162451,"threads_started":3,"wal-append.queue_time_us":412606}
I20260709 13:15:10.022233   856 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.037300   750 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:09.991910   997 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:09.984100 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:09.995975   763 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:10.044332 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.029s	sys 0.051s
I20260709 13:15:10.041887 31604 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
W20260709 13:15:10.064708 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.029s	sys 0.051s
I20260709 13:15:10.051504 31026 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:10.065048 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 624680us
W20260709 13:15:10.052968 31031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.013s	sys 0.008s
I20260709 13:15:10.010381   849 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.066136 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:10.056661 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.028s	sys 0.047s
W20260709 13:15:10.069272 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.028s	sys 0.047s
I20260709 13:15:10.022198 31025 rpcz_store.cc:276] 0709 13:15:08.738584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.743944 (+  5360us) service_pool.cc:224] Handling call
0709 13:15:08.744415 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.744856 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.744886 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.134272 (+389386us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b2c00074538. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:15:09.134711 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:15:09.951658 (+816947us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:09.951729 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:09.951848 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.021451 (+ 69603us) raft_consensus.cc:1685] finished
0709 13:15:10.021481 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.021731 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1585,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":120575744,"thread_start_us":816440,"threads_started":1,"wal-append.queue_time_us":867429}
I20260709 13:15:10.056651 30776 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.061456 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:10.066602 30922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.020s
W20260709 13:15:10.071954 30922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.008s	sys 0.020s
W20260709 13:15:10.072546 30958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.029s
W20260709 13:15:10.072883 30958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.000s	sys 0.029s
I20260709 13:15:10.054432   881 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.078227 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:10.008863   922 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.078989 31028 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:10.080055 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1766) took 1340 ms. Trace:
I20260709 13:15:10.080899 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:10.072276 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 698464us
I20260709 13:15:10.009657   958 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:10.075268 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.035s	sys 0.065s
I20260709 13:15:10.022181   994 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:15:10.079707 30776 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:10.082679 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:10.072297 30875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.011s
I20260709 13:15:10.126071 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:10.083034 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2319) took 1120 ms. Trace:
I20260709 13:15:10.127403 31028 rpcz_store.cc:276] 0709 13:15:08.963077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.077970 (+1114893us) service_pool.cc:224] Handling call
0709 13:15:10.082966 (+  4996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.128643 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:10.112533 31604 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:10.063757   876 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:15:10.109692 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.037s	sys 0.078s
W20260709 13:15:10.138763 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 785288us
I20260709 13:15:10.139535 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:10.140219 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:10.141111 31028 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:10.105315 30996 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:10.117816 31025 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:10.061198   856 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.113866 30776 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 2 to 3, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:10.072225   847 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:10.124583 30875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.010s	sys 0.011s
I20260709 13:15:10.152102 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:10.153527 30776 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 5, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 5 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.154314 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:10.155043 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.080448 31031 rpcz_store.cc:276] 0709 13:15:08.739305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.739511 (+   206us) service_pool.cc:224] Handling call
0709 13:15:08.739980 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:08.740515 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:08.740558 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.312234 (+571676us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b2c00074538. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:15:09.312647 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.066120 (+753473us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:10.066177 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.066273 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.066336 (+    63us) raft_consensus.cc:1685] finished
0709 13:15:10.066354 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.079996 (+ 13642us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2485,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":130097920,"thread_start_us":753072,"threads_started":1,"wal-append.queue_time_us":712588}
I20260709 13:15:10.111882   886 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.157284 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.160137 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.160254 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.161235 30956 raft_consensus.cc:2410] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:10.161757 30957 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:10.162714 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.163290 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.164357 30955 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:15:10.167032 31023 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:15:10.166869 30776 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 3 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:10.169538 30951 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:10.171474 31028 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:10.167874 31023 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:10.174067 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2323) took 1209 ms. Trace:
I20260709 13:15:10.172672 31025 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:10.137714   782 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:15:10.157945 30953 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:10.151250   981 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:10.144917   885 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:10.176489 30921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.005s	sys 0.035s
W20260709 13:15:10.181340 30921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.005s	sys 0.035s
W20260709 13:15:10.182199 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.182731 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2318) took 1212 ms. Trace:
I20260709 13:15:10.183211 31025 rpcz_store.cc:276] 0709 13:15:08.962840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.155962 (+1193122us) service_pool.cc:224] Handling call
0709 13:15:10.172385 (+ 16423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.175049 (+  2664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.175260 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.181705   881 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:10.185705   881 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.068447   997 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.188139 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1819) took 1219 ms. Trace:
I20260709 13:15:10.160465 31599 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:10.188587 30954 rpcz_store.cc:276] 0709 13:15:08.969031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.367998 (+398967us) service_pool.cc:224] Handling call
0709 13:15:09.399977 (+ 31979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.452034 (+ 52057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.452071 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.452585 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.022933 (+570348us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:10.022975 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.023041 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.187849 (+164808us) raft_consensus.cc:1685] finished
0709 13:15:10.187880 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.188063 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44687,"raft.queue_time_us":237850,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9663,"thread_start_us":569945,"threads_started":1,"wal-append.queue_time_us":692459}
I20260709 13:15:10.188931 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.165450   784 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.198174 31024 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:10.199847 31031 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:10.200006 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.201529 31024 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:10.202180 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2331) took 1236 ms. Trace:
I20260709 13:15:10.202487 31024 rpcz_store.cc:276] 0709 13:15:08.966216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.200475 (+1234259us) service_pool.cc:224] Handling call
0709 13:15:10.200751 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.201957 (+  1206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.202130 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:10.113914 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.000s	sys 0.030s
W20260709 13:15:10.203828 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.000s	sys 0.030s
I20260709 13:15:10.198479 31025 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:10.204453 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2330) took 1238 ms. Trace:
I20260709 13:15:10.176756 31023 rpcz_store.cc:276] 0709 13:15:08.964293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.569771 (+605478us) service_pool.cc:224] Handling call
0709 13:15:10.174005 (+604234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.204842 31025 rpcz_store.cc:276] 0709 13:15:08.965966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.184200 (+1218234us) service_pool.cc:224] Handling call
0709 13:15:10.198168 (+ 13968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.204192 (+  6024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.204388 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.208200 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2326) took 1233 ms. Trace:
I20260709 13:15:10.181960   981 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:10.196266   959 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 13:15:10.221668 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.223549 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:10.224262 30880 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:10.224445 30951 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:10.225421 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 231472us
I20260709 13:15:10.226549 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:10.208598 31028 rpcz_store.cc:276] 0709 13:15:08.964996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.158800 (+1193804us) service_pool.cc:224] Handling call
0709 13:15:10.171155 (+ 12355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.173275 (+  2120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.198762 (+ 25487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.197131 31597 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:15:10.103642 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.216161 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:10.227506 30923 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.967s (SENT)
I20260709 13:15:10.229449 31028 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:10.247306 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2320) took 1284 ms. Trace:
I20260709 13:15:10.248008 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:10.247692 31030 rpcz_store.cc:276] 0709 13:15:08.963345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.668566 (+705221us) service_pool.cc:224] Handling call
0709 13:15:10.215961 (+547395us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:10.247242 (+ 31281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376960}
I20260709 13:15:10.249670 31028 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:10.222074 31023 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:10.174201   886 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.244100 31025 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:10.245358 31032 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:10.209139   994 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:10.223075 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 506) took 1662 ms. Trace:
I20260709 13:15:10.188478  1000 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:15:10.260527 30949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.006s	sys 0.008s
I20260709 13:15:10.259306   842 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:10.264053   959 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.264609   856 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:10.243036  1006 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:10.259552   784 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:10.266660 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:10.223492   981 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:10.272130 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 67732us
I20260709 13:15:10.260507 30954 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:10.294196 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:10.325055 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:10.340371 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.340912 30951 raft_consensus.cc:2410] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:10.341158   784 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.334682   782 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:10.342428   782 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:10.343415   782 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.344638 30953 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:10.344767   782 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:10.325884 30957 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:15:10.345666   842 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:10.345961 30957 pending_rounds.cc:85] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 5
I20260709 13:15:10.346375 30957 pending_rounds.cc:107] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:10.346259   842 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.346689 30957 raft_consensus.cc:2889] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:10.334419  1000 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:10.295845 30880 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:15:10.348340   842 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.348413  1000 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.349133   842 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.349431   943 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:10.349637   842 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.350553 30874 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:10.350550  1000 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.353328 31027 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:10.277043 31023 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:10.276551 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:10.328094 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:10.221316   885 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:10.355645 30883 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:10.243628   847 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:10.290490 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.358253 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.362243 30955 raft_consensus.cc:2410] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:15:10.291407 30949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.007s	sys 0.012s
I20260709 13:15:10.362720 30951 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:10.291704 30881 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:10.293097 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:10.267453   994 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:10.293864  1008 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.246295   881 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:10.355654 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 79195.1us
I20260709 13:15:10.268993 31600 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:10.289069  1010 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:15:10.382797 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.383720 30955 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
W20260709 13:15:10.384524 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 318462us
I20260709 13:15:10.384826 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.385833 30955 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:10.378732 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:10.358254 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.387615 30956 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 2.
I20260709 13:15:10.301930 31028 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:10.363737 30879 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.373513 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:10.390457 30877 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
W20260709 13:15:10.358282 30923 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.987s (SENT)
I20260709 13:15:10.391368 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:10.372255 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:10.392197 30881 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:10.383034 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.393657 30951 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:10.340947 30876 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:10.267851  1007 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:10.356563   784 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.310420   763 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:10.310563   619 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.351559   943 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.363016  1000 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:10.406183 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:10.407147 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.427601 30955 raft_consensus.cc:2410] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:10.404891 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 156006us
I20260709 13:15:10.264634   922 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.361820   965 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:10.372789  1002 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.418172 30954 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:10.418839 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.410080 30958 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:10.402833 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:10.434437 30880 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.275357 30950 rpcz_store.cc:276] 0709 13:15:08.557611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:08.558430 (+   819us) service_pool.cc:224] Handling call
0709 13:15:09.309569 (+751139us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:09.482008 (+172439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.548508 (+ 66500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.219500 (+670992us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002b6950. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:10.219671 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398759040}
I20260709 13:15:10.382906   842 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:10.378372   847 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:10.410845   763 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:10.405570   780 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.404313  1007 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:10.409941  1005 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:10.443557 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 113053us
I20260709 13:15:10.403131 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:10.437602 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:10.380405   959 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.403426   881 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:10.480160 30954 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:10.447057 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:10.481630 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:10.426863   619 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.461385 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:10.373600  1006 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.429626  1014 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:10.429960   849 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.433061   965 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.483520 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:10.484977 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75355.9us
I20260709 13:15:10.418846   784 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:15:10.487993 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 135348us
I20260709 13:15:10.492904 31032 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:10.504593 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 104872us
I20260709 13:15:10.434832  1000 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.507176 31605 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:10.483994  1017 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:10.511363 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58853us
I20260709 13:15:10.399335  1008 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.460822   780 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:10.503873   965 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:10.488847  1003 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.505968 30880 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:10.542672 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:10.545164 30956 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:15:10.488643   821 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:15:10.512158  1014 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:10.553520  1014 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:10.556778   847 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.547616 30876 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:10.564340 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:10.565399 31599 raft_consensus.cc:2410] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:10.566367 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:10.488087   885 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:10.568034  1001 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:15:10.548044   763 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.545748 30956 pending_rounds.cc:85] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 2
I20260709 13:15:10.526250  1017 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:10.524106 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.569888 30956 pending_rounds.cc:107] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:15:10.570263 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1820) took 1600 ms. Trace:
W20260709 13:15:10.569855 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 91180us
I20260709 13:15:10.570284 30956 raft_consensus.cc:2889] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:10.570683 30958 rpcz_store.cc:276] 0709 13:15:08.969387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.366828 (+397441us) service_pool.cc:224] Handling call
0709 13:15:09.367376 (+   548us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:10.108528 (+741152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.108572 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:10.156024 (+ 47452us) log.cc:844] Serialized 608 byte log entry
0709 13:15:10.357311 (+201287us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:10.483685 (+126374us) log.cc:844] Serialized 14 byte log entry
0709 13:15:10.486950 (+  3265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.487039 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.570032 (+ 82993us) raft_consensus.cc:1685] finished
0709 13:15:10.570052 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.570201 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10040,"raft.queue_time_us":65581,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":25888,"thread_start_us":852828,"threads_started":2,"wal-append.queue_time_us":260434}
I20260709 13:15:10.443851  1002 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.590363 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:10.590377 31570 connection.cc:256] RPC call timeout handler was delayed by -1.1280997120002212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3234s for a response
I20260709 13:15:10.494004  1015 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:10.593072 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53883.6us
I20260709 13:15:10.595022 30958 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:10.494321   619 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.567639 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:10.500907  1004 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:10.571666   886 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.569664 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1593) took 1255 ms. Trace:
I20260709 13:15:10.640987  1008 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.641489   917 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.642040   917 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.642771  1006 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:10.642506   917 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.479851   994 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.644037 30879 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:10.644616   750 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.600827  1015 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.645360  1015 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.645687   780 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.648900 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:10.649602 31604 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:10.649647 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.480315  1005 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:10.575133   763 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:10.575273  1017 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:10.601539  1009 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:15:10.650436 30953 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:10.655609 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:10.656351 31023 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:10.594923 31026 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:10.665562 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.669965 30951 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:10.671306 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 388) took 1272 ms. Trace:
I20260709 13:15:10.601503 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.676831 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:10.676115 31026 rpcz_store.cc:276] 0709 13:15:09.398551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.108239 (+709688us) service_pool.cc:224] Handling call
0709 13:15:10.671223 (+562984us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:10.681212 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:10.600224   856 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.631026  1019 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.688974 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:10.690318 31023 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:10.631966  1004 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.600523   842 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:10.593495   999 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:10.710394 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 792) took 1331 ms. Trace:
I20260709 13:15:10.545919  1007 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.005174 30956 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:10.821089 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2321) took 1857 ms. Trace:
I20260709 13:15:10.725729 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:10.881397 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 309350us
I20260709 13:15:10.946799 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.027045 30996 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:11.046958 31031 rpcz_store.cc:276] 0709 13:15:08.963730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.158597 (+1194867us) service_pool.cc:224] Handling call
0709 13:15:10.199622 (+ 41025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.207864 (+  8242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.820862 (+612998us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54001f2050. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:10.821022 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54011264}
I20260709 13:15:11.048380 30957 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:11.013124 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 378911us
W20260709 13:15:10.827338 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.713843 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:11.050051 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.035699 30958 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:10.854349 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 253172us
W20260709 13:15:11.014487 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:10.904028 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 401921us
I20260709 13:15:11.031612 31603 rpcz_store.cc:276] 0709 13:15:09.379386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.379906 (+   520us) service_pool.cc:224] Handling call
0709 13:15:09.380225 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:09.428006 (+ 47781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.428052 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:09.498749 (+ 70697us) log.cc:844] Serialized 52 byte log entry
0709 13:15:10.040303 (+541554us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:10.040358 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.040433 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.710108 (+669675us) raft_consensus.cc:1685] finished
0709 13:15:10.710133 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.710297 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2279,"raft.queue_time_us":42450,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19577,"thread_start_us":479042,"threads_started":1,"wal-append.queue_time_us":675072}
I20260709 13:15:10.851547 30878 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:10.710258  1031 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:15:11.057592 31027 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:15:11.058019 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.055312 30878 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:11.077363 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:11.078881 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:11.070142 30874 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:15:10.978119   945 consensus_meta.cc:287] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.116s	user 0.012s	sys 0.000s
I20260709 13:15:11.080739 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:11.100232 30958 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:15:10.945009  1028 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:15:11.007597  1010 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.104315 31023 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:10.780957 30950 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 8 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:15:10.673389   861 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:10.981104   909 raft_consensus.cc:476] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:15:10.972093   908 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:10.820531  1032 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 13:15:10.821136  1024 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:15:10.712092 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.010614   997 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:11.066679 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:11.110014 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:11.110898 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:10.945670 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 811) took 1272 ms. Trace:
I20260709 13:15:11.112694 30957 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:15:11.112902 30997 leader_election.cc:336] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.575s (SENT)
I20260709 13:15:11.112833 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:11.156194 30847 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:10.923105  1015 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.114203  1022 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.104315  1007 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.101526   847 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.110526   763 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:10.722604   856 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.093924   842 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.115084  1002 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:10.742871   981 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:10.794757  1011 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.819028  1000 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:11.072192  1039 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.897222  1005 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.648515 30875 rpcz_store.cc:276] 0709 13:15:09.314000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.321527 (+  7527us) service_pool.cc:224] Handling call
0709 13:15:09.321883 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.355474 (+ 33591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.366394 (+ 10920us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.395684 (+ 29290us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.174788 (+779104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:10.176312 (+  1524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.192836 (+ 16524us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:10.569397 (+376561us) raft_consensus.cc:1685] finished
0709 13:15:10.569436 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:10.569595 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14428,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":20100,"thread_start_us":663914,"threads_started":1,"wal-append.queue_time_us":907059}
I20260709 13:15:11.162950   886 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:11.117112 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:11.118288 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 387) took 1737 ms. Trace:
I20260709 13:15:11.119638   994 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:11.120746  1047 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.004s
I20260709 13:15:11.120630   861 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.121739  1006 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:11.122335   961 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:11.125777   965 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 13:15:10.721659  1004 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:10.851872   959 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.822427   619 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.909050   958 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:10.751991   881 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:10.894205   906 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:11.136054 30848 connection.cc:256] RPC call timeout handler was delayed by -1.3485035690000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:15:10.697589   782 raft_consensus.cc:2764] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:15:11.076455  1003 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.219686 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1818) took 2251 ms. Trace:
I20260709 13:15:11.179831   847 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.105800   945 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.148278 31026 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.151402 31600 rpcz_store.cc:276] 0709 13:15:09.673605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.675914 (+  2309us) service_pool.cc:224] Handling call
0709 13:15:10.945313 (+1269399us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400541fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:10.945576 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870845824}
W20260709 13:15:11.162292 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 62717us
I20260709 13:15:11.229358 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:10.907416  1023 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.238s
I20260709 13:15:11.107574  1010 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:11.126940   917 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:11.168756 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 119777us
I20260709 13:15:11.184302 30951 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:11.186563 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.186653 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.149008   908 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:11.192298 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 79420.1us
I20260709 13:15:11.213697   886 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:11.194090 31024 rpcz_store.cc:276] 0709 13:15:09.380668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.203207 (+822539us) service_pool.cc:224] Handling call
0709 13:15:10.222773 (+ 19566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.275687 (+ 52914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.275721 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:10.291273 (+ 15552us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.528523 (+237250us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:10.665666 (+137143us) log.cc:844] Serialized 14 byte log entry
0709 13:15:10.668565 (+  2899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.668666 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.118031 (+449365us) raft_consensus.cc:1685] finished
0709 13:15:11.118057 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.118221 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27233,"prepare.queue_time_us":514078,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":52184,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":15639,"thread_start_us":223248,"threads_started":2,"wal-append.queue_time_us":248027}
I20260709 13:15:11.245838 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:11.246420 31024 raft_consensus.cc:2376] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4. Re-sending same reply.
I20260709 13:15:10.730053  1019 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.248852  1042 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:15:11.250363  1019 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:11.200726 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.251119 31604 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:15:11.251502  1044 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:15:11.202494 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 85449.9us
W20260709 13:15:11.252346  1012 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.927s	user 0.002s	sys 0.000s
W20260709 13:15:11.204970 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.252542  1046 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.156s
I20260709 13:15:11.206432 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:11.253381 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:11.253799 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47495.8us
I20260709 13:15:11.166884   943 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:15:11.259883 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 810) took 1587 ms. Trace:
I20260709 13:15:11.260026 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:11.215102 30848 connection.cc:256] RPC call timeout handler was delayed by -1.3449035690000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:15:11.167269  1043 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:15:11.108449 30878 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.220301 30949 rpcz_store.cc:276] 0709 13:15:08.968680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.364097 (+395417us) service_pool.cc:224] Handling call
0709 13:15:09.364531 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.362916 (+998385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.362946 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:10.398944 (+ 35998us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.485132 (+ 86188us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:10.487101 (+  1969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.487165 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.219375 (+732210us) raft_consensus.cc:1685] finished
0709 13:15:11.219403 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.219605 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17420,"raft.queue_time_us":93429,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":978456,"threads_started":2,"wal-append.queue_time_us":112479}
I20260709 13:15:11.263379 30881 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:11.200402  1040 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:11.148825 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 82242.1us
I20260709 13:15:11.209371  1000 raft_consensus.cc:2764] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:11.259888 31599 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:11.194621  1011 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.244601 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.236359 31603 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:11.248433  1030 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.250587  1036 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:11.254513 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:11.252372 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:11.255602 31026 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:11.258265 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.250095 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:11.260658 30879 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:11.261067 30848 connection.cc:256] RPC call timeout handler was delayed by -1.3098035689999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:15:11.364012 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2252035690000866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:15:11.364490 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2009035690000474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:15:11.364560 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:11.364904 30848 connection.cc:256] RPC call timeout handler was delayed by -1.1334035689999382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:15:11.365315 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0479035690000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:15:11.366990 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:11.250181  1013 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.746s	user 0.003s	sys 0.000s
I20260709 13:15:11.260285 31601 rpcz_store.cc:276] 0709 13:15:09.672892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.673037 (+   145us) service_pool.cc:224] Handling call
0709 13:15:09.693519 (+ 20482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:09.722936 (+ 29417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:09.722967 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:09.768951 (+ 45984us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.232239 (+463288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:10.232345 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.232438 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.251824 (+1019386us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:11.255018 (+  3194us) raft_consensus.cc:1685] finished
0709 13:15:11.255038 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.259809 (+  4771us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3682,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":47403,"spinlock_wait_cycles":10696960,"thread_start_us":413948,"threads_started":1,"wal-append.queue_time_us":523499}
W20260709 13:15:11.250303  1038 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:15:11.211086  1006 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.371222  1042 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.371598  1042 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:11.371991  1042 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.372668  1006 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:11.373553 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 583) took 1013 ms. Trace:
I20260709 13:15:11.373942 30883 rpcz_store.cc:276] 0709 13:15:10.360576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.360723 (+   147us) service_pool.cc:224] Handling call
0709 13:15:10.388178 (+ 27455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.406878 (+ 18700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.406909 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:10.411022 (+  4113us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.667205 (+256183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:10.667245 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:10.667309 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.373331 (+706022us) raft_consensus.cc:1685] finished
0709 13:15:11.373350 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.373498 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11590,"raft.queue_time_us":70928,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"thread_start_us":224084,"threads_started":1,"wal-append.queue_time_us":611906}
I20260709 13:15:11.214455   961 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.376794 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:11.377368   961 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:11.213792   965 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.377804  1043 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.378201  1043 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:11.378561  1043 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.379328   965 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:11.271082 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.272267 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:11.261003  1019 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:11.276700  1050 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:15:11.231420 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.278491 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.385449 30949 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:11.386485 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.278661   763 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:11.388434   763 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:11.278519   782 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:11.388811 30878 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.273315 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.390511 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.391229 30881 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:11.285604 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.287499 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.392297 30958 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:11.388820   763 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:11.288153 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.288523  1040 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.393517   763 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.297566 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.304358   881 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.394987   763 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.262879   908 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:11.398435   908 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:11.398941   908 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.399379 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:11.401414   908 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:11.309113 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 407) took 1277 ms. Trace:
I20260709 13:15:11.402283 31028 rpcz_store.cc:276] 0709 13:15:10.032027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.395708 (+363681us) service_pool.cc:224] Handling call
0709 13:15:10.396065 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.678414 (+282349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.678441 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.017764 (+339323us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.198135 (+180371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:11.198196 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.198290 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.308852 (+110562us) raft_consensus.cc:1685] finished
0709 13:15:11.308878 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.309042 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9150,"raft.queue_time_us":66246,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":12371,"thread_start_us":354860,"threads_started":2,"wal-append.queue_time_us":184093}
I20260709 13:15:11.404042 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.254632   909 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.404881   909 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.406940   909 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:11.260720   959 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:11.407485   959 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.407878   959 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:11.332669 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 79342.6us
I20260709 13:15:11.361124 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:11.360939 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 116400us
I20260709 13:15:11.413051 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.414649  1042 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.415062 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:11.360203 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.416139  1054 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.416651  1054 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:11.417064  1054 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.418110 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.419006 31600 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:11.390645 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.420651  1040 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:11.416091  1053 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.284126 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:11.420809 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.422865 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:11.383546 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.416180 31026 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:11.424727 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.425060 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.425486 31024 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:11.426263 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.426499 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.413064 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:11.427517 31026 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:11.420429 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.431358 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.204594  1039 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.428272 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.429028 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.429960 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.431010 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.436655 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:11.439069 30881 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:11.375697 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.432184 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.433588 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:11.580557 30878 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:11.427881 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51152us
I20260709 13:15:11.423952 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:11.440701 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 186244us
W20260709 13:15:11.503561 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 64150.5us
W20260709 13:15:11.551425 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.333606  1036 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.572021 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.325598  1030 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.315533  1000 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:11.577075 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 162057us
I20260709 13:15:11.572511 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.581786 30848 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:11.582438 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:11.581811 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.582706 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:11.587415 30874 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.583443 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.584201 30848 leader_election.cc:403] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:11.588006 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 335678us
I20260709 13:15:11.442608   958 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.584071 30881 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 3: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:11.438594   997 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:11.592027 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:11.587498 30878 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:11.643716 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1772) took 1957 ms. Trace:
I20260709 13:15:11.582878  1030 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.593852 31031 raft_consensus.cc:2410] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:11.595256 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.595506   917 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:11.576293   836 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:11.635416 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.598870 31605 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:11.591122 30922 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:11.637734 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:11.638515 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.582640  1036 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.645488 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 404) took 1910 ms. Trace:
I20260709 13:15:11.645555 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1442) took 1498 ms. Trace:
I20260709 13:15:11.693742 30952 rpcz_store.cc:276] 0709 13:15:10.147434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.154007 (+  6573us) service_pool.cc:224] Handling call
0709 13:15:11.645378 (+1491371us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54003ffcd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:11.645501 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807242112}
I20260709 13:15:11.592900 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:11.650698 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:11.694919 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1592) took 2340 ms. Trace:
I20260709 13:15:11.586621  1046 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.644156 31032 rpcz_store.cc:276] 0709 13:15:09.686128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.267977 (+581849us) service_pool.cc:224] Handling call
0709 13:15:10.268261 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:10.504466 (+236205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.643473 (+1139007us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54003778d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:11.643656 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516042624}
I20260709 13:15:11.659834 31598 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:11.660658   847 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:11.659859   856 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:11.661702 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1773) took 1974 ms. Trace:
I20260709 13:15:11.716430 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:11.672616 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 814) took 1565 ms. Trace:
I20260709 13:15:11.636055   886 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.573506 31597 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:11.677873 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1604) took 1170 ms. Trace:
I20260709 13:15:11.677774   917 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.225764  1003 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:11.685141 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47503.6us
I20260709 13:15:11.789263 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.791921 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.689427 30874 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:11.683645 30877 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:11.431353  1043 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.642361 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:11.598532  1002 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.704294 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.693691 31027 rpcz_store.cc:276] 0709 13:15:09.735189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.354061 (+618872us) service_pool.cc:224] Handling call
0709 13:15:11.014280 (+660219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.094241 (+ 79961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.645257 (+551016us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001f2f50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:11.645433 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728745856}
I20260709 13:15:11.695276 30882 rpcz_store.cc:276] 0709 13:15:09.313683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.320356 (+  6673us) service_pool.cc:224] Handling call
0709 13:15:09.320659 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:09.320878 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:09.949391 (+628513us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.249648 (+1300257us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:11.637134 (+387486us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b1800010f60. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287
0709 13:15:11.653222 (+ 16088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:11.653309 (+    87us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:11.653379 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.653468 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.653649 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":750937,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":79000,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":26628,"spinlock_wait_cycles":20355712,"thread_start_us":1172353,"threads_started":3,"wal-append.queue_time_us":490545}
I20260709 13:15:11.598294  1040 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:11.637126   928 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.583992   961 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
W20260709 13:15:11.714908 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 130280us
I20260709 13:15:11.743688 31605 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:11.635591   981 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:11.643401  1015 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:11.783643 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.712939   379 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:11.748158 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 164834us
I20260709 13:15:11.684891 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:11.654222   945 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:11.826357 30881 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:11.716724 31025 rpcz_store.cc:276] 0709 13:15:09.687471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.268429 (+580958us) service_pool.cc:224] Handling call
0709 13:15:10.306775 (+ 38346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.364906 (+ 58131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.364949 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:10.401084 (+ 36135us) log.cc:844] Serialized 26 byte log entry
0709 13:15:10.479066 (+ 77982us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:10.969117 (+490051us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.200301 (+231184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.644964 (+444663us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400347454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:11.645012 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.645055 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:11.661449 (+ 16394us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.661628 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":563309,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":173012,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3792,"spinlock_wait_cycles":132922240,"thread_start_us":759092,"threads_started":3,"wal-append.queue_time_us":124934}
I20260709 13:15:11.800860 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.583627  1000 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.784545 30880 rpcz_store.cc:276] 0709 13:15:10.507656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.547803 (+ 40147us) service_pool.cc:224] Handling call
0709 13:15:10.548131 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.023575 (+475444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.023617 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.045736 (+ 22119us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.220635 (+174899us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:11.220693 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.220771 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.677640 (+456869us) raft_consensus.cc:1685] finished
0709 13:15:11.677667 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.677801 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32024,"raft.queue_time_us":400060,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":280756,"threads_started":2,"wal-append.queue_time_us":332491}
I20260709 13:15:11.704197   999 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:11.704165   943 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:11.694450   836 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:11.716481  1017 consensus_meta.cc:287] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.996s	user 0.008s	sys 0.004s
I20260709 13:15:11.692082   997 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:11.704278  1046 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:11.682039  1039 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:11.823190 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:11.797621 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 155392us
I20260709 13:15:11.747288 31602 rpcz_store.cc:276] 0709 13:15:10.107520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.112825 (+  5305us) service_pool.cc:224] Handling call
0709 13:15:11.122329 (+1009504us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:11.122520 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.122868 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.122906 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.123365 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.209805 (+ 86440us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:11.258622 (+ 48817us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.259315 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.259455 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:11.672226 (+412771us) raft_consensus.cc:1685] finished
0709 13:15:11.672360 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:11.672542 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54902,"prepare.queue_time_us":383259,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":96440,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":19476,"spinlock_wait_cycles":8529280,"thread_start_us":128461,"threads_started":2,"wal-append.queue_time_us":316902}
I20260709 13:15:11.827302 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:11.827354 30883 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:11.810945  1023 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:11.803916   917 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:11.860893 30998 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:11.835491  1040 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:11.855006  1061 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.005s
I20260709 13:15:11.855376  1026 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:11.857990   906 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:11.837934 31600 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:11.862067 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:11.863678  1053 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:11.863998 31602 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:11.864444   965 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:11.816644  1002 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.837220   999 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:11.841974   836 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:11.976323  1073 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:11.886942 31029 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
W20260709 13:15:11.845742 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 253769us
I20260709 13:15:11.839550   379 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.993268   379 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:11.993791   959 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.006s
I20260709 13:15:11.994215   959 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.995332   379 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:11.893707 30997 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.846446   842 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:11.844825   943 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:11.997000   943 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.850455  1046 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:11.980006 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 388922us
W20260709 13:15:11.984611 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 122597us
I20260709 13:15:11.976888   961 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:15:11.861018   981 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:11.835291   945 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:11.859315  1030 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:11.992395   994 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.000s
I20260709 13:15:11.992619 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:11.856869  1003 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.002140 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:12.016607 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 123046us
I20260709 13:15:12.023305 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.985985  1053 consensus_queue.cc:1243] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:11.989984   784 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.991400  1023 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:12.028119 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:11.989116   999 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:11.847360  1017 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:11.989326  1073 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:12.032015 30879 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:12.030876  1039 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.032621   928 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:15:12.032572   909 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:15:12.016752  1011 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.020565   861 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.040320 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.040946 30882 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:12.019392   635 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:12.042479 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 49917.7us
I20260709 13:15:12.043467 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:12.046438 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1605) took 1456 ms. Trace:
I20260709 13:15:11.987313  1074 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:15:12.070245 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.074126 30877 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:12.031702   981 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:12.076211 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 248512us
W20260709 13:15:12.044986  1004 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.000s
W20260709 13:15:12.078476 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76416.2us
W20260709 13:15:12.076757 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.077329 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:12.053961 30876 rpcz_store.cc:276] 0709 13:15:10.590490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.591380 (+   890us) service_pool.cc:224] Handling call
0709 13:15:10.631360 (+ 39980us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:10.907859 (+276499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.907914 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:11.105444 (+197530us) log.cc:844] Serialized 582 byte log entry
0709 13:15:11.224016 (+118572us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:11.224077 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.224175 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.046212 (+822037us) raft_consensus.cc:1685] finished
0709 13:15:12.046234 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.046368 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":351765,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":316868,"threads_started":2,"wal-append.queue_time_us":174668}
I20260709 13:15:12.044117  1023 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:12.070273   959 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:12.073562   928 consensus_queue.cc:1243] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:12.053344  1077 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:12.075239 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 283380us
W20260709 13:15:12.086234  1054 consensus_meta.cc:287] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260709 13:15:12.081295   961 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:12.085628  1005 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:12.087980  1007 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.006s
I20260709 13:15:12.033396   784 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.054085   836 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.045184  1036 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:12.094906   619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.013s
I20260709 13:15:12.121381   945 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.030140   997 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.124614  1000 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.092470   379 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:12.113492 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:12.116454 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.116860 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.118877  1075 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.121933  1033 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:15:12.129356 31604 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:12.100322  1077 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:12.085979  1004 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:12.134833  1064 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:15:12.167199  1079 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:12.168524 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.176301 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:12.170044 31605 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:12.172524 30847 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:12.135296  1075 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.100112   961 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.124626  1002 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:12.134397   379 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:12.095803  1054 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.138768  1033 consensus_queue.cc:1243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:15:12.165844 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 137807us
I20260709 13:15:12.222064 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.223184 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:12.224236 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:12.225203 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.138200   994 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.171341   917 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.161995  1005 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.171063  1046 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.214831   945 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:12.215588 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.226970 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.179893   782 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.215656 30953 raft_consensus.cc:2368] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5.
I20260709 13:15:12.164541  1000 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:12.228503 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 51219.6us
I20260709 13:15:12.227743  1053 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.234361  1094 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:12.234457 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:12.237342 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.220274   379 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.187043  1075 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:12.228585  1084 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:12.243283 30874 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:12.243841 30880 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:12.221887  1050 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:12.245597   782 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.229368   908 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:12.175916  1007 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:15:12.267076   908 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:12.267560   908 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:12.268092  1007 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.268620  1007 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:12.269503  1007 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.270758 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1458) took 1935 ms. Trace:
I20260709 13:15:12.246148 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.226459  1051 raft_consensus.cc:2764] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:15:12.271569 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.273458   782 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.287014 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:12.281971 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.285063 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:12.290385 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45641.8us
I20260709 13:15:12.252703  1017 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:12.255122  1004 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.257123  1046 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.258335   836 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:12.260246   763 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.865s	user 0.002s	sys 0.009s
I20260709 13:15:12.240739   994 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:15:12.230934   945 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:12.261291   917 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.231458  1000 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:12.264638   958 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.001s
I20260709 13:15:12.266112   961 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:12.280076  1026 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:12.273222 30923 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.271167 30955 rpcz_store.cc:276] 0709 13:15:10.335760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.428248 (+ 92488us) service_pool.cc:224] Handling call
0709 13:15:10.428580 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:10.735030 (+306450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:10.735072 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:10.746834 (+ 11762us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.327794 (+580960us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:11.639789 (+311995us) log.cc:844] Serialized 14 byte log entry
0709 13:15:11.640137 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.766214 (+126077us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400255654. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:11.766289 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.270433 (+504144us) raft_consensus.cc:1685] finished
0709 13:15:12.270544 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.270696 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":510431,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1948,"raft.queue_time_us":6160,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":88373,"spinlock_wait_cycles":615913344,"thread_start_us":536629,"threads_started":2,"wal-append.queue_time_us":547358}
I20260709 13:15:12.248800 30997 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:12.399899 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 151198us
I20260709 13:15:12.400492  1051 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.401281 30997 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.295893 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.404230 30881 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:12.294915 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:12.297539 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:12.405058 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 107566us
I20260709 13:15:12.139312  1073 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.361407 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.311286 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:12.278957  1040 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.276683  1043 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:12.388861 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 151963us
W20260709 13:15:12.274583  1062 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.461s	user 0.002s	sys 0.000s
I20260709 13:15:12.300242  1002 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:12.236972  1005 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.226586   928 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.277526  1042 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.280898  1087 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.280300  1050 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:12.421209  1050 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.238072  1094 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.425993  1094 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.426222 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2173) took 1097 ms. Trace:
I20260709 13:15:12.426604 30879 rpcz_store.cc:276] 0709 13:15:11.329357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.364201 (+ 34844us) service_pool.cc:224] Handling call
0709 13:15:12.425997 (+1061796us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540005a0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:12.426130 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532862208}
I20260709 13:15:12.427843  1005 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.430871 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.431528 31596 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.436050 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.437757 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:12.439823  1091 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.192s	user 0.003s	sys 0.000s
I20260709 13:15:12.442245   379 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:12.444317 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 396) took 2985 ms (client timeout 1970 ms). Trace:
W20260709 13:15:12.444692 31029 rpcz_store.cc:269] 0709 13:15:09.459022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.770869 (+311847us) service_pool.cc:224] Handling call
0709 13:15:12.444143 (+2673274us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000c49d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:12.444250 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4537394560}
I20260709 13:15:12.445040   928 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.445550   928 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.447065 31030 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:15:12.414901   763 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.449787   635 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.398005 30949 raft_consensus.cc:2410] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:12.277935  1036 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.407078 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:12.451498 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44471.9us
I20260709 13:15:12.295307 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.174264  1023 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.409823 30876 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.454071 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.454733 31599 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:12.382556  1046 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.456375 31029 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:12.456125  1046 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.381848   886 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.458146   886 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.459030  1046 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:12.413403 30922 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 2.004s (SENT) [suppressed 17 similar messages]
W20260709 13:15:12.460415 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47045.1us
I20260709 13:15:12.460804   886 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.382221   945 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:12.413437 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 140302us
I20260709 13:15:12.464273 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:12.465200 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 230803us
I20260709 13:15:12.465751 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.361892   782 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:15:12.388523  1000 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.398074   917 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.417611 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2172) took 1114 ms. Trace:
I20260709 13:15:12.397825   958 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.419231 30997 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.228255  1077 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.410352   961 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:12.402611  1054 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:12.424180  1071 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
I20260709 13:15:12.491086   961 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.491671   961 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:12.416890  1002 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.492573  1002 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.468083 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.418356  1051 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:15:12.497231 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:12.499310   836 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.499378 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 731) took 1065 ms. Trace:
I20260709 13:15:12.500092   836 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:12.501542   836 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:12.500022 31598 rpcz_store.cc:276] 0709 13:15:11.434413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.832837 (+398424us) service_pool.cc:224] Handling call
0709 13:15:11.984082 (+151245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.030930 (+ 46848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.033171 (+  2241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.085991 (+ 52820us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.365553 (+279562us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:12.380322 (+ 14769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.389945 (+  9623us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.499078 (+109133us) raft_consensus.cc:1685] finished
0709 13:15:12.499104 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.499285 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3335,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4605,"thread_start_us":168614,"threads_started":1,"wal-append.queue_time_us":355498}
I20260709 13:15:12.502045   836 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:12.502954   836 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.504141 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.505273 30950 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:12.506470 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.507145 30950 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.508471 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.509300   886 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:12.511026   886 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.511261   784 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.511960   917 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.514595   917 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.490417 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.469543 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.418265  1053 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.272114  1030 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.469940 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:12.471607 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:12.472652 30878 rpcz_store.cc:276] 0709 13:15:11.303312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.835735 (+532423us) service_pool.cc:224] Handling call
0709 13:15:11.847866 (+ 12131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:11.848091 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:12.093714 (+245623us) log.cc:844] Serialized 14 byte log entry
0709 13:15:12.417130 (+323416us) log.cc:844] Serialized 14 byte log entry
0709 13:15:12.417317 (+   187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:12.417358 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:12.417396 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.417443 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.417554 (+   111us) inbound_call.cc:177] Queueing success response
0709 13:15:12.448512 (+ 30958us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18003ae640. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d557 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
Metrics: {"mutex_wait_us":43297,"prepare.queue_time_us":195871,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":55275,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":8098,"spinlock_wait_cycles":14247168,"thread_start_us":516010,"threads_started":3,"wal-append.queue_time_us":141629}
W20260709 13:15:12.527482 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 61554.5us
I20260709 13:15:12.484984 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.412174   856 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:15:12.488375   928 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.408355  1026 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.489519 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.490402 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1824) took 2049 ms. Trace:
I20260709 13:15:12.503145 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.469758   999 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.471982  1004 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:12.468181 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.470266   997 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:12.514855 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2174) took 1105 ms. Trace:
I20260709 13:15:12.519783 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:12.469326 30847 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:12.471012   635 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.480224 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.472172  1005 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.491053   379 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.530668  1006 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:12.523097 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 53625us
I20260709 13:15:12.532588 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.521076  1029 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.602815 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.606895 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:12.532301 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 120412us
I20260709 13:15:12.527937   994 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.608932 31026 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:12.609011 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:12.611666 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.614248 30954 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.615484 30880 rpcz_store.cc:276] 0709 13:15:11.409410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.835491 (+426081us) service_pool.cc:224] Handling call
0709 13:15:11.850915 (+ 15424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.249885 (+398970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.514604 (+264719us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54001266d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:12.514791 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903014144}
I20260709 13:15:12.616456 30956 rpcz_store.cc:276] 0709 13:15:10.441125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.083201 (+642076us) service_pool.cc:224] Handling call
0709 13:15:11.107250 (+ 24049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:11.109101 (+  1851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:11.109129 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:11.144439 (+ 35310us) log.cc:844] Serialized 26 byte log entry
0709 13:15:11.361929 (+217490us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:11.361973 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:11.362039 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:12.273884 (+911845us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:12.490032 (+216148us) raft_consensus.cc:1685] finished
0709 13:15:12.490059 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:12.490328 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12884,"raft.queue_time_us":2004,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":31558,"spinlock_wait_cycles":8995072,"thread_start_us":180194,"threads_started":1,"wal-append.queue_time_us":472177}
I20260709 13:15:12.553875 31023 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:12.526476   782 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:12.644311 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 175030us
W20260709 13:15:12.661729 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 52789.6us
W20260709 13:15:12.661746 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52885.7us
I20260709 13:15:12.666829 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.667718 30875 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:12.670878 30922 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:12.671870 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 521) took 2042 ms (client timeout 2219 ms). Trace:
W20260709 13:15:12.673571 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 62028.5us
W20260709 13:15:12.675499 30951 rpcz_store.cc:269] 0709 13:15:10.629592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.688661 (+ 59069us) service_pool.cc:224] Handling call
0709 13:15:12.665933 (+1977272us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54002909d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:12.671799 (+  5866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136827136}
I20260709 13:15:12.677855 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.595606   908 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.684612 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:12.685473 30956 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:12.685563 31596 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:12.601455  1006 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:12.686549 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.592651 30950 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:12.695811 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.696759 31029 raft_consensus.cc:2410] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:12.697564 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.614022   997 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.687132 30956 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.690176 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.680994 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:12.661653   886 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:12.706238 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.709861 31605 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:12.708603 30951 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:12.712090 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:12.712800 30951 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:12.713801 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.690554 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:12.686959 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.715910 31602 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:12.612496  1004 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:12.669176  1046 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:12.670105   379 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:12.718927 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.729878 31024 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:12.730978 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.731453 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.732088 31029 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:12.732192 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.719563 30951 raft_consensus.cc:2393] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:12.733213 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:12.733814 31026 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.726770 30954 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:12.668553 31599 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:12.688025  1029 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.728387 30881 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.673223  1042 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.588404   945 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.584884   961 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.591842  1050 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.698729  1003 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:12.728282 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.757429 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:12.738952 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:12.740571 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.759666 31029 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 3: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:12.742810 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.675863   763 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:15:12.727737  1004 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:12.705919  1095 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:12.746737 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:12.746877 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.729981  1046 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:12.695518  1006 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.708914   997 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:12.756721 30877 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:12.759370 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.695640  1005 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:15:12.717545  1017 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.789938 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.770304 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.761457 30951 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.675527   782 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.750985 30876 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:12.775597 31031 raft_consensus.cc:2393] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:12.766353 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47352us
I20260709 13:15:12.771721 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.772522  1010 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.782187 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:12.782444  1098 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.784152 30883 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:12.788057 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:12.748354 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.788798 30880 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:12.758929  1029 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.792181  1017 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.793073   999 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:12.778575  1046 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:12.806335 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.801514 30847 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:12.819064 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:12.808290 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.820502 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.775266  1097 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:15:12.809496 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.790536 31602 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:12.769097  1042 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.811700   763 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.828539 31024 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:12.830380 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:12.830821 31026 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:12.876447 30956 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:12.878229 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:12.881136 30881 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:12.831059 31029 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:12.832367   961 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:12.832362  1030 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.835877 31598 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:12.838059 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:12.847954 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 408) took 2815 ms. Trace:
I20260709 13:15:12.852705  1053 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:12.849439 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1828) took 1564 ms. Trace:
I20260709 13:15:12.897990 30953 rpcz_store.cc:276] 0709 13:15:11.284848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.285332 (+   484us) service_pool.cc:224] Handling call
0709 13:15:12.849210 (+1563878us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400112e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:12.849373 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833065856}
I20260709 13:15:12.852697 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2165) took 1551 ms. Trace:
I20260709 13:15:12.827657  1003 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:12.854817   945 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.856436 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1831) took 1568 ms. Trace:
I20260709 13:15:12.907902 30949 rpcz_store.cc:276] 0709 13:15:11.288357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.387543 (+ 99186us) service_pool.cc:224] Handling call
0709 13:15:12.856243 (+1468700us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54002b7854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:12.856373 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294409088}
I20260709 13:15:12.857688 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.857998 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:12.909879 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51968.8us
I20260709 13:15:12.829712   999 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.859422   886 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:12.860363   635 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:12.865952  1026 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:12.866739 30880 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:15:12.868312 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:12.869560 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:12.989622 30876 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:12.869905   908 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:12.869834  1019 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:12.816490  1010 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:12.873238 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45179.8us
I20260709 13:15:12.873502 30877 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:13.014379 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:13.014680 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:13.015712 30951 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:13.016008 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:12.874219 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:13.016978 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:12.885465 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.887233 31029 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:13.017823 30951 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 3: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:12.881364 30957 pending_rounds.cc:85] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 5
I20260709 13:15:13.018306 30957 pending_rounds.cc:107] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:13.018581 30957 raft_consensus.cc:2889] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:12.824774 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.889246 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:12.826892  1007 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:12.826756  1098 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.895430 31030 rpcz_store.cc:276] 0709 13:15:10.032409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:10.418186 (+385777us) service_pool.cc:224] Handling call
0709 13:15:12.446725 (+2028539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.447425 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.847668 (+400243us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000c49d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:12.847866 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4664480640}
I20260709 13:15:12.815270 30950 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:12.817716  1000 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.899365 31026 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:15:12.901321 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:12.900069 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:12.899351 30874 rpcz_store.cc:276] 0709 13:15:11.301342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.815048 (+513706us) service_pool.cc:224] Handling call
0709 13:15:11.883716 (+ 68668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.249825 (+366109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.852426 (+602601us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54000a0fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:12.852611 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826491136}
I20260709 13:15:12.925875 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.928783 30996 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:12.933985 30953 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:12.935633   999 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:12.930564  1005 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:12.940786 31600 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:12.884270   958 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:12.925595   784 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:12.888509   959 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:15:13.216907  1005 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:13.217176   959 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:13.217566  1019 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.218035  1019 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:13.217986  1005 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.217206 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:12.877552   763 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.013253   886 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.220392 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.222128 30955 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:13.193872   635 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:13.154590 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 286337us
W20260709 13:15:13.156507 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 282227us
W20260709 13:15:13.153462  1104 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:15:13.154176 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 139974us
I20260709 13:15:13.215606  1098 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:12.994158  1023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.013s
I20260709 13:15:13.069682   994 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:13.131383 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:13.179572 31570 connection.cc:256] RPC call timeout handler was delayed by -1.2798336500000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:15:13.262245 31602 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:13.262351 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.223435  1054 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:13.099653  1077 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:13.018785 30951 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:13.103148 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:13.137972   782 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:13.070472   836 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:13.071030  1070 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.245s	user 0.005s	sys 0.000s
I20260709 13:15:13.277863 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:13.024255  1075 consensus_meta.cc:287] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.003s
W20260709 13:15:13.062476  1002 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.008s
I20260709 13:15:13.067703   961 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.189874 30848 leader_election.cc:400] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5.
I20260709 13:15:13.282179 31602 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:13.201718 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:13.157742  1042 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.157812  1029 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:13.212335 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 283647us
I20260709 13:15:13.213397 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.292462 30876 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:13.211585 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 311588us
I20260709 13:15:13.214807 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.210233 31599 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:13.217792   959 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:12.985291 31031 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:15:13.161805  1101 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:15:13.226898   784 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:13.235371  1102 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:15:13.195163  1083 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:13.197091  1007 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.238260 30922 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:13.198357  1017 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:13.244359  1105 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:15:13.244765 30880 raft_consensus.cc:1217] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.4->[4.5-6.7]   Dedup: 4.5->[4.6-6.7]
I20260709 13:15:13.246265 30877 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:15:13.248976  1106 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.435s	user 0.002s	sys 0.000s
I20260709 13:15:13.219673  1000 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:13.146621   885 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.259589 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.219102  1019 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.222589   908 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:13.255411 31600 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:13.282481 30848 leader_election.cc:403] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:13.347812 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 158164us
I20260709 13:15:13.299244  1004 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.289377 31604 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:13.293285 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:13.300418 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:13.304318 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 88298.7us
I20260709 13:15:13.274950  1077 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.237010   886 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.279752   994 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:13.314046 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:13.315645 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77488.3us
I20260709 13:15:13.281853   961 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:13.317759 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:13.436681 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 55150.2us
I20260709 13:15:13.283346 31598 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:13.255923   635 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.298237 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.282051  1046 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.298585  1054 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:13.273573  1119 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:15:13.321928 30880 pending_rounds.cc:85] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 5
I20260709 13:15:13.287967  1002 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.279603 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.287747  1075 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.318326  1007 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:13.409587   999 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:13.456467  1075 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.457294 30952 raft_consensus.cc:2368] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:13.360496   908 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.457659  1046 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.458016   908 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.458470 30878 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:13.438364   881 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.410095   784 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.459686   881 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.461345  1003 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:13.461818  1003 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:13.462133   881 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.446580  1030 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.321959  1083 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:13.461385   886 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.464996  1083 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:13.321431   836 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:13.462807  1003 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.467960   836 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.468456   836 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.437551 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:13.438915  1006 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.649s	user 0.001s	sys 0.011s
I20260709 13:15:13.454932   994 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.448431 30880 pending_rounds.cc:107] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:13.449064 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:13.449359 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 156195us
W20260709 13:15:13.410261  1125 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:15:13.434679  1090 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:15:13.453953 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.411386   959 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:13.437150 30953 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:13.360954  1043 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5.
I20260709 13:15:13.439325 30922 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:13.463224  1030 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.433106  1042 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:15:13.439929  1077 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.489374 30880 raft_consensus.cc:2889] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.598093 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:13.444751  1019 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:13.560209 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 314142us
I20260709 13:15:13.468797  1003 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.593549 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:13.593760 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 154503us
I20260709 13:15:13.626783 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:13.488696 30882 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:15:13.594821 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:13.596072 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1784) took 1151 ms. Trace:
I20260709 13:15:13.546831 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:13.596524   881 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:13.361268  1131 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.212s
I20260709 13:15:13.608453 30923 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:13.630859 31027 rpcz_store.cc:276] 0709 13:15:12.444890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.445011 (+   121us) service_pool.cc:224] Handling call
0709 13:15:12.445386 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:12.445803 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:12.445830 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:12.446433 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:15:12.750922 (+304489us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:12.750961 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.751035 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.163902 (+412867us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4800042b58. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
0709 13:15:13.595713 (+431811us) raft_consensus.cc:1685] finished
0709 13:15:13.595736 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.596019 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30047,"raft.queue_time_us":4816,"raft.run_cpu_time_us":3596,"raft.run_wall_time_us":698613,"spinlock_wait_cycles":5623040,"thread_start_us":304107,"threads_started":1,"wal-append.queue_time_us":479735}
I20260709 13:15:13.628750 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:13.637456 30922 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:13.608371   959 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:13.540385  1006 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.642611   959 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:13.643054   959 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.644381  1006 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:13.469705   821 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.417685  1098 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:13.474179  1130 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:15:13.473462  1110 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 13:15:13.649690  1010 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.636s	user 0.004s	sys 0.004s
I20260709 13:15:13.608259   763 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.650255 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:13.557330  1124 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:15:13.472782  1107 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:15:13.614543 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:13.472149  1023 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:13.556919   909 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:13.552069  1126 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.616082 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.687669 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:13.690527 31605 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:13.597791 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 732) took 2162 ms. Trace:
I20260709 13:15:13.599488  1119 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.651835  1017 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:13.691730 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:13.708287  1017 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.708930  1017 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.709668 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:13.710796 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:13.711293 31605 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.689453 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:13.662683   881 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.712481 30951 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.714504   881 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.688398  1126 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:13.698058 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.701865 30996 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:13.702167 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1845) took 1178 ms. Trace:
I20260709 13:15:13.720898 30958 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:13.611088 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.651052 31028 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:13.722886 30958 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:13.653692 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58978us
W20260709 13:15:13.654911 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46544.6us
I20260709 13:15:13.724810 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:13.725639 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.725975 30951 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:13.726459 30874 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:13.726492 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:13.592319 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 292946us
I20260709 13:15:13.725123 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:13.661480 31601 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:15:13.673750  1109 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:13.278743  1051 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:13.676043   635 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:13.662256  1125 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:15:13.546398   961 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.679107  1004 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.666384  1010 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.639456  1046 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:13.679867 31599 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:13.682258   908 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.732813   379 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:13.732008  1040 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:13.720012 30957 rpcz_store.cc:276] 0709 13:15:12.523631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.880755 (+357124us) service_pool.cc:224] Handling call
0709 13:15:12.881121 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:13.100877 (+219756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.100922 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:13.101656 (+   734us) log.cc:844] Serialized 52 byte log entry
0709 13:15:13.279050 (+177394us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:13.279136 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.279327 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.701936 (+422609us) raft_consensus.cc:1685] finished
0709 13:15:13.701957 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.702103 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124291,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":24939,"thread_start_us":136871,"threads_started":1,"wal-append.queue_time_us":340957}
I20260709 13:15:13.752353  1135 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:13.728161 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:13.728477 31601 pending_rounds.cc:85] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 4
I20260709 13:15:13.813670 31601 pending_rounds.cc:107] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:15:13.814028 31601 raft_consensus.cc:2889] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:13.702328   906 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:15:13.732203 31031 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:13.830504 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:13.737599 30951 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:13.735554 31602 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:13.740232 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.556392  1129 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
W20260709 13:15:13.702845   997 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.913s	user 0.011s	sys 0.000s
I20260709 13:15:13.772387 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:13.661581   886 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.779239 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 602) took 1069 ms. Trace:
I20260709 13:15:13.787889 31605 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:13.800961   961 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.719139   909 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:13.695112  1002 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:13.739008  1109 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.646927  1007 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.647693   821 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.810254 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 145988us
I20260709 13:15:13.728878 30958 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:13.665994  1054 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.834031 30953 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:13.832006 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 103911us
I20260709 13:15:13.836618 30883 rpcz_store.cc:276] 0709 13:15:12.709727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.709838 (+   111us) service_pool.cc:224] Handling call
0709 13:15:13.779005 (+1069167us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b54002aba54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:13.779159 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18794880}
I20260709 13:15:13.685819 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:13.822965 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 97866.8us
I20260709 13:15:13.858855 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:13.808549  1023 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:13.803231  1046 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:13.776818   784 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:15:13.850731 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:13.813308  1135 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:13.831264  1097 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.887885 31602 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:13.864624 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:13.888355 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1796) took 1066 ms. Trace:
I20260709 13:15:13.888841 31032 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:13.834384  1126 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:13.815018  1136 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:13.837764  1131 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:13.881191 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:13.862835  1128 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:13.844442   997 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.888759 31026 rpcz_store.cc:276] 0709 13:15:12.821539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.199530 (+377991us) service_pool.cc:224] Handling call
0709 13:15:13.199873 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.327724 (+127851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.327778 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:13.327821 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:13.327860 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.888121 (+560261us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400146754. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:13.888168 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.888291 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293466368}
I20260709 13:15:13.902967 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:13.874931  1037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.582s	user 0.008s	sys 0.007s
I20260709 13:15:13.860813   821 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.860299   763 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.849058  1109 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:13.923476 30877 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:13.830196  1040 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:13.930305 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 49180.3us
I20260709 13:15:13.958900 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:13.869117  1023 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:13.939074 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:13.937140 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:13.906973   856 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:13.967449 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.964179 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:13.931579  1128 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:13.965252  1112 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:15:13.969699 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.970364 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:13.976766 30957 raft_consensus.cc:2410] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:15:13.938421  1037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.677s	user 0.008s	sys 0.007s
I20260709 13:15:13.972432 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:13.979974 31032 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.979103 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:13.980859 30875 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:13.935357   886 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:13.985992 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:13.974503 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.973031 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:13.975556 31596 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:13.975693  1128 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:13.897011   619 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:15:13.907801  1074 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:15:14.217087   997 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:13.973683 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:14.218225  1140 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:15:14.218393 30874 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:13.987546 31026 raft_consensus.cc:2376] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4. Re-sending same reply.
I20260709 13:15:14.224844 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.225690 31026 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:13.990926 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:13.989542 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:13.998400 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:13.925645   928 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:14.234489   928 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:14.234913   928 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:14.235839   928 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:14.237092   928 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:14.127104   908 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:14.240528  1017 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:15:14.241093  1017 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.708176 31597 rpcz_store.cc:276] 0709 13:15:11.434975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.830064 (+395089us) service_pool.cc:224] Handling call
0709 13:15:11.863127 (+ 33063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:12.018406 (+155279us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:12.023052 (+  4646us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:12.594579 (+571527us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b2c00047358. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:15:12.595047 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:15:12.771059 (+176012us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:12.898596 (+127537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:12.908844 (+ 10248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:13.248410 (+339566us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:13.525151 (+276741us) raft_consensus.cc:1685] finished
0709 13:15:13.546696 (+ 21545us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:13.594622 (+ 47926us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440,"raft.queue_time_us":25359,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5297,"spinlock_wait_cycles":14227712,"thread_start_us":141671,"threads_started":1,"wal-append.queue_time_us":180958}
I20260709 13:15:14.243919 30875 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:14.074805 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:14.246847 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.247303 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1471) took 1578 ms. Trace:
W20260709 13:15:14.127507 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 81025.7us
I20260709 13:15:14.127631  1098 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:14.213187  1007 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.193547  1129 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:13.972410   379 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:15:13.976114  1119 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:14.049203 31032 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:13.972276  1002 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:15:14.140940  1040 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.113371 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:14.259704  1154 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:14.073233 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.084201 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 382343us
I20260709 13:15:14.089077  1077 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.935209  1131 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:14.273948   959 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:15:14.083493  1075 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:14.140709  1145 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:15:13.966110  1023 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:13.977448  1004 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:15:13.983322 30882 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:14.126327  1134 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:13.975384  1135 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.125725  1146 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:13.932317   836 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.286510 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2355) took 1533 ms. Trace:
I20260709 13:15:13.960784  1046 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:13.886682   909 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:13.908257  1097 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:14.193606  1030 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.232391 30874 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:14.233443  1150 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:15:14.139197 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 138945us
I20260709 13:15:14.325567 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:14.119938 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 809) took 1461 ms. Trace:
I20260709 13:15:14.327191 31603 rpcz_store.cc:276] 0709 13:15:12.659200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.659396 (+   196us) service_pool.cc:224] Handling call
0709 13:15:12.687586 (+ 28190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:12.687857 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:12.898343 (+210486us) log.cc:844] Serialized 14 byte log entry
0709 13:15:13.707627 (+809284us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b18003b9740. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a
0709 13:15:13.891165 (+183538us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.119577 (+228412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.119623 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:14.119661 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.119727 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.119876 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35405,"prepare.queue_time_us":753760,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1962,"raft.queue_time_us":263810,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":43505,"spinlock_wait_cycles":3273600,"thread_start_us":744217,"threads_started":4,"wal-append.queue_time_us":336307}
I20260709 13:15:14.247694 30954 rpcz_store.cc:276] 0709 13:15:12.668559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.061998 (+1393439us) service_pool.cc:224] Handling call
0709 13:15:14.247237 (+185239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:14.257675 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:14.265302 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 275842us
I20260709 13:15:14.330693 31026 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 3.
I20260709 13:15:14.265877 30951 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:14.267244 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.212431 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1473) took 1543 ms. Trace:
I20260709 13:15:14.269810 30996 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:14.260373   908 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.274034  1111 log.cc:927] Time spent T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:15:14.062225   945 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:15:14.269964  1007 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.295630 30950 raft_consensus.cc:2368] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4.
I20260709 13:15:13.968063   856 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.274603   959 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.295434  1134 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.300976 31025 rpcz_store.cc:276] 0709 13:15:12.752990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.906229 (+153239us) service_pool.cc:224] Handling call
0709 13:15:12.984888 (+ 78659us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.012915 (+ 28027us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:13.156966 (+144051us) log.cc:844] Serialized 14 byte log entry
0709 13:15:13.260148 (+103182us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.263531 (+  3383us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.263734 (+   203us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:13.468425 (+204691us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b18000b05c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:14.285616 (+817191us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18000b05c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:15:14.285876 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.286134 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.286224 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.286272 (+    48us) raft_consensus.cc:1685] finished
0709 13:15:14.286289 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.286442 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158419,"prepare.queue_time_us":266832,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":40278,"raft.run_cpu_time_us":1055,"raft.run_wall_time_us":63852,"spinlock_wait_cycles":9866752,"thread_start_us":119196,"threads_started":2,"wal-append.queue_time_us":122716}
W20260709 13:15:14.314970  1143 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:15:14.332113 30949 rpcz_store.cc:276] 0709 13:15:12.669085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.930191 (+261106us) service_pool.cc:224] Handling call
0709 13:15:12.985023 (+ 54832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.716840 (+731817us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:13.716870 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.717335 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.842700 (+125365us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:13.842759 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.200137 (+357378us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b54001e0854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:14.200199 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.200259 (+    60us) raft_consensus.cc:1685] finished
0709 13:15:14.200272 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.212358 (+ 12086us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1291,"raft.queue_time_us":1079,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":16085,"spinlock_wait_cycles":1682024704,"thread_start_us":124910,"threads_started":1,"wal-append.queue_time_us":240519}
I20260709 13:15:14.349740  1054 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:14.363920 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.315372  1159 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.320443  1135 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:14.382513 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.282248  1075 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:14.384397 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 481502us
I20260709 13:15:14.432633 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:14.276554  1154 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:14.433574  1075 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:14.435278  1154 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:14.349623  1160 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:15:14.332736  1119 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:14.361229  1019 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
I20260709 13:15:14.360409  1002 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:14.421538  1166 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:15:14.422477 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.371834  1007 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:14.423372  1158 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:15:14.427667  1149 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 13:15:14.428481  1161 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:15:14.429560   959 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:14.483551 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 379247us
I20260709 13:15:14.372467   856 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.453181   763 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:14.453655 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:14.486276 31026 raft_consensus.cc:2376] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4. Re-sending same reply.
I20260709 13:15:14.451650  1119 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:14.487610 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:14.388468  1134 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:14.457679 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:14.478134  1139 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:14.493050 31570 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:14.458434 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 188750us
W20260709 13:15:14.458931 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 133495us
I20260709 13:15:14.496109 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:14.498044 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:14.498759 30958 raft_consensus.cc:2368] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:14.499442 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:14.499963 30958 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:14.500383 30848 leader_election.cc:400] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:14.500685 30848 leader_election.cc:403] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:14.501077 30957 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:15:14.501382 30957 pending_rounds.cc:85] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 2
I20260709 13:15:14.501511 30957 pending_rounds.cc:107] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:15:14.501659 30957 raft_consensus.cc:2889] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:14.304541  1146 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:14.475972 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1834) took 2166 ms (client timeout 1633 ms). Trace:
I20260709 13:15:14.360924   908 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:14.508769 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:14.509326 30957 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:14.464293  1073 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.484619 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:14.451598  1085 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:14.537892  1158 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:15:14.503482 30952 rpcz_store.cc:269] 0709 13:15:12.294483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.294631 (+   148us) service_pool.cc:224] Handling call
0709 13:15:14.460342 (+2165711us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400350a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:14.460518 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420042624}
I20260709 13:15:14.505228 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:14.511612 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1794) took 1693 ms. Trace:
I20260709 13:15:14.512308 30954 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:14.562096 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:14.515190 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:14.515493 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:14.563951 30957 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:14.564826 30957 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:14.489074 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:14.537325 31570 connection.cc:256] RPC call timeout handler was delayed by -2.3287848899999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:15:14.565488 31570 connection.cc:256] RPC call timeout handler was delayed by -2.3107848899999226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 13:15:14.419917  1159 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.541158  1167 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:14.541278  1040 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:14.537719 31025 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:14.507640  1154 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:14.506995   959 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:14.489984  1017 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.545789 30958 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:14.548841 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:14.553071 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.556385 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 71878.1us
I20260709 13:15:14.558634 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:14.567838 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:14.535876 31601 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:14.506732  1019 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:15:14.566030 31570 leader_election.cc:336] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.545s (SENT)
I20260709 13:15:14.589725 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:14.519634  1129 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:14.590379 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 820) took 1726 ms. Trace:
I20260709 13:15:14.562240 31030 rpcz_store.cc:276] 0709 13:15:12.818588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.198588 (+380000us) service_pool.cc:224] Handling call
0709 13:15:13.198937 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:13.212092 (+ 13155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.212121 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:13.212658 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 13:15:13.415176 (+202518us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:13.695099 (+279923us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800042b58. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
0709 13:15:14.498146 (+803047us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.503702 (+  5556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.503817 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.503870 (+    53us) raft_consensus.cc:1685] finished
0709 13:15:14.511377 (+  7507us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.511538 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":962298,"prepare.queue_time_us":1005801,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":22036,"raft.run_cpu_time_us":1651,"raft.run_wall_time_us":487236,"spinlock_wait_cycles":4690688,"thread_start_us":244966,"threads_started":2,"wal-append.queue_time_us":380538}
W20260709 13:15:14.588420 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 83265.1us
I20260709 13:15:14.594201 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.606833 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:14.607089 31026 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:14.607213 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:14.607184 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.608101 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.608915 31026 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:14.608959 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:14.520169  1152 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:15:14.610383 31603 raft_consensus.cc:2368] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:14.603938 31600 rpcz_store.cc:276] 0709 13:15:12.863949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.220904 (+356955us) service_pool.cc:224] Handling call
0709 13:15:13.221199 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.255278 (+ 34079us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:13.486935 (+231657us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.278090 (+791155us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.278410 (+   320us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.296269 (+ 17859us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.296476 (+   207us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:14.296520 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.296602 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.590070 (+293468us) raft_consensus.cc:1685] finished
0709 13:15:14.590100 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.590296 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58017,"prepare.queue_time_us":318958,"prepare.run_cpu_time_us":216,"prepare.run_wall_time_us":1511,"raft.queue_time_us":72032,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":13377,"thread_start_us":611508,"threads_started":2,"wal-append.queue_time_us":278605}
I20260709 13:15:14.566607  1075 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:14.568550  1077 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.591178  1097 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:14.618081   907 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:14.618360 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:14.621192 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:14.569473  1094 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:14.626178 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:14.624245 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:14.596937   959 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.630183 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.632015 30949 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:14.628079 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:14.609831 31030 raft_consensus.cc:2376] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5. Re-sending same reply.
W20260709 13:15:14.633195 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 97879.8us
W20260709 13:15:14.631168 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 59843.1us
I20260709 13:15:14.596889  1087 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:14.614049   836 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.633396 30949 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
W20260709 13:15:14.682484 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47250.6us
W20260709 13:15:14.710177 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 144168us
I20260709 13:15:14.740685 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:14.742276 31570 leader_election.cc:336] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.677s (SENT)
W20260709 13:15:14.742995 31570 connection.cc:256] RPC call timeout handler was delayed by -2.2405848899998091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:15:14.743265 31570 connection.cc:256] RPC call timeout handler was delayed by -2.2153848899999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:15:14.743559 31570 connection.cc:256] RPC call timeout handler was delayed by -2.180284889999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:15:14.743907 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9453848900000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.227s for a response
W20260709 13:15:14.744253 31570 connection.cc:256] RPC call timeout handler was delayed by -1.8166848899998058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2413s for a response
W20260709 13:15:14.744573 31570 connection.cc:256] RPC call timeout handler was delayed by -1.6960848899998382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25470000000000004s for a response
I20260709 13:15:14.625360 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:14.744879 31570 connection.cc:256] RPC call timeout handler was delayed by -1.6456848899999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26030000000000003s for a response
I20260709 13:15:14.748744 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:14.626001  1017 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:14.629982   635 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:14.636009   784 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:14.764889 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1619) took 1552 ms. Trace:
I20260709 13:15:14.770008 30880 rpcz_store.cc:276] 0709 13:15:13.212679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.212793 (+   114us) service_pool.cc:224] Handling call
0709 13:15:13.244413 (+ 31620us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:13.598834 (+354421us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:13.865629 (+266795us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.271379 (+405750us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:14.275686 (+  4307us) log.cc:844] Serialized 520 byte log entry
0709 13:15:14.276834 (+  1148us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:14.276899 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.277005 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.764562 (+487557us) raft_consensus.cc:1685] finished
0709 13:15:14.764593 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:14.764803 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10709,"prepare.queue_time_us":331127,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":104392,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":10211,"thread_start_us":571199,"threads_started":3,"wal-append.queue_time_us":392562}
I20260709 13:15:14.614567  1023 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:14.752585 31570 connection.cc:256] RPC call timeout handler was delayed by -1.627684889999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26230000000000003s for a response
I20260709 13:15:14.642405   959 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:14.708791  1077 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:14.710121  1129 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:14.751641  1003 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.136s	user 0.008s	sys 0.005s
I20260709 13:15:14.779726 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.709367  1075 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:14.798702 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 164160us
I20260709 13:15:14.803032 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:14.753582  1046 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:14.818259 30956 raft_consensus.cc:2410] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:14.824894 31032 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:14.827373  1046 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.769783   784 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:14.828400  1075 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.818414  1129 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.780158  1040 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:14.641132  1097 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.183s
I20260709 13:15:14.704452  1094 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.840852 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:14.835865  1003 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.829149   635 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:14.824892  1057 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:14.771500  1017 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.808534  1007 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.848295  1046 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.836222   784 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:14.749883  1151 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:15:14.824950  1050 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.829082  1077 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:14.836090  1114 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:14.750329  1167 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:15:14.844731 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:14.843603   763 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:14.868288 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:14.843386  1154 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:14.842864   836 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:14.855052  1169 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:14.860230  1163 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:15:14.839807  1131 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:14.870270  1146 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.854995  1040 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:14.886747 31597 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:14.855633  1003 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:14.858429   635 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:14.871579  1057 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:14.944509  1057 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.945194   856 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:14.903141 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 304565us
I20260709 13:15:14.883567  1114 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:14.951305  1114 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.952908  1114 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:14.954668 31600 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:14.921252  1003 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:14.916622 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 116136us
I20260709 13:15:14.923265  1094 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.915098  1040 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:14.909546  1168 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:15:14.927986  1077 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:14.929193   635 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:14.929118  1129 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:14.891682  1169 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:14.930188  1023 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.899678   836 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:14.932341  1051 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.000s	user 0.008s	sys 0.004s
I20260709 13:15:14.892417  1154 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:14.937237 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 422) took 3684 ms (client timeout 2009 ms). Trace:
W20260709 13:15:14.938712  1118 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.603s	user 0.011s	sys 0.001s
W20260709 13:15:14.940402  1128 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.866s	user 0.013s	sys 0.000s
W20260709 13:15:14.940505 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:14.940393  1109 consensus_meta.cc:287] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.968s	user 0.011s	sys 0.000s
I20260709 13:15:14.942588   909 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:14.943404   821 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.001s
W20260709 13:15:14.921072  1180 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:15:14.956509 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 178980us
I20260709 13:15:14.985765 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:14.893350 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:14.959168 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:14.960287 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1842) took 2486 ms. Trace:
W20260709 13:15:14.966357 31028 rpcz_store.cc:269] 0709 13:15:11.253087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:11.403748 (+150661us) service_pool.cc:224] Handling call
0709 13:15:14.937009 (+3533261us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54003791d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:14.937154 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5104352512}
I20260709 13:15:14.988517 30955 rpcz_store.cc:276] 0709 13:15:12.470852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.613247 (+142395us) service_pool.cc:224] Handling call
0709 13:15:12.613621 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.225827 (+612206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.956897 (+1731070us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b5400112954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:14.957145 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398846336}
I20260709 13:15:14.989132 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:14.989799 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:14.910894  1159 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:14.958058   379 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:14.983745 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 115664us
W20260709 13:15:14.979467  1135 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:15:14.991919 30847 leader_election.cc:400] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6.
I20260709 13:15:14.991962 31028 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:14.994117  1050 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:14.966560  1169 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:14.994928 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:14.998456 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2362) took 1104 ms. Trace:
I20260709 13:15:15.004711 31028 rpcz_store.cc:276] 0709 13:15:13.894373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.989007 (+1094634us) service_pool.cc:224] Handling call
0709 13:15:14.989412 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:14.998197 (+  8785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.998400 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.005458 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:15.005798 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:14.999799 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:15.007004 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:15.006614 30874 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.006110 30955 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:15.007632 30954 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:15.008286 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:15.008426 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:15.001325   379 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.010999 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:14.984845  1109 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.011981   379 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:15.013101  1017 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:15.013823  1109 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:15.013980 30881 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:15.014287 31596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 813) took 2318 ms (client timeout 2028 ms). Trace:
I20260709 13:15:15.015053 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:14.988297   821 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:15.016700 31603 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:15.016822 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:14.995195 31598 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:15.021907 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:15.020994 30954 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:15.022032 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:15.025866 30883 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:15.057346 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:14.996295  1190 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:15.025796  1006 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.984064  1128 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:15.085909 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 74982.9us
W20260709 13:15:15.014755 31596 rpcz_store.cc:269] 0709 13:15:12.696331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.707796 (+ 11465us) service_pool.cc:224] Handling call
0709 13:15:15.014056 (+2306260us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400459cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:15.014198 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666026240}
W20260709 13:15:15.085225   928 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.848s	user 0.012s	sys 0.000s
I20260709 13:15:15.085466  1073 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.091954 31028 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:15.092238 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:15.093009 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:15.093132 31604 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:15.000649   763 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:15.096279 30876 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:15.019021  1192 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:15.091300  1073 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.079391  1006 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.126597 30953 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:15:15.857950 30874 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.850s	user 0.007s	sys 0.002s
W20260709 13:15:15.858335 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1482) took 1889 ms (client timeout 1685 ms). Trace:
I20260709 13:15:15.858374 30874 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:15.139070 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1616) took 2467 ms. Trace:
W20260709 13:15:15.858970 30951 rpcz_store.cc:269] 0709 13:15:13.969347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.969477 (+   130us) service_pool.cc:224] Handling call
0709 13:15:15.858129 (+1888652us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400112454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:15.858257 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665928576}
I20260709 13:15:15.859545 30878 rpcz_store.cc:276] 0709 13:15:12.671701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:12.673866 (+  2165us) service_pool.cc:224] Handling call
0709 13:15:12.706344 (+ 32478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.458898 (+752554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.138807 (+1679909us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540005aad4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:15.139009 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729231232}
I20260709 13:15:15.094542 31597 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:15.861577 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 762) took 1241 ms. Trace:
I20260709 13:15:15.089926   784 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:15.862015 31597 rpcz_store.cc:276] 0709 13:15:14.619961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.816827 (+196866us) service_pool.cc:224] Handling call
0709 13:15:15.861501 (+1044674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.863235 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:15.863950 31597 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:15.147145   961 consensus_meta.cc:287] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.300s	user 0.011s	sys 0.003s
I20260709 13:15:15.310648  1051 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:15.124034  1177 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 13:15:15.234107  1200 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:15:15.872362 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.233889  1134 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.720s	user 0.008s	sys 0.003s
I20260709 13:15:15.490422   917 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.874183   917 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.874773  1003 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:15.875377  1003 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.879902  1003 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:15.138662  1109 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.184073   959 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:15.865942 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 426) took 1961 ms (client timeout 1902 ms). Trace:
I20260709 13:15:15.231251  1023 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.109230  1057 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.125402 30881 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:15.866644 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 773632us
I20260709 13:15:15.156627  1097 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:15.097188   836 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:15.188638 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 175805us
I20260709 13:15:15.628583   928 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.868449 30949 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:15.124907  1040 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:15.873507   821 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:15.876235 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1802) took 2280 ms. Trace:
I20260709 13:15:15.876761   917 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:15.799585 30922 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.011s	sys 0.017s
W20260709 13:15:15.908094 30922 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.012s	sys 0.018s
W20260709 13:15:15.908402 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 756709us
I20260709 13:15:15.882194 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 760) took 1263 ms. Trace:
I20260709 13:15:15.864842   784 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:15.893762 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 326301us
I20260709 13:15:15.910027 31600 rpcz_store.cc:276] 0709 13:15:14.619239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.627799 (+  8560us) service_pool.cc:224] Handling call
0709 13:15:15.881977 (+1254178us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54000104d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:15.882133 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739190144}
I20260709 13:15:15.896755  1003 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:15.898499 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:15.900171  1154 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:15.301769  1128 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:15.514727 31604 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:15.911159 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:15.895413 31025 rpcz_store.cc:269] 0709 13:15:13.904385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.381221 (+476836us) service_pool.cc:224] Handling call
0709 13:15:15.865742 (+1484521us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400378cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:15.865869 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183647488}
I20260709 13:15:15.916174 31600 raft_consensus.cc:2410] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:15.916492 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:15.917402 31604 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9.
I20260709 13:15:15.918385 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:15.919051 31604 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:15.920662 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:15.921334 31604 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:15.921890 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 842) took 1053 ms. Trace:
I20260709 13:15:15.922283 31604 rpcz_store.cc:276] 0709 13:15:14.868332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.920363 (+1052031us) service_pool.cc:224] Handling call
0709 13:15:15.921827 (+  1464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.923377 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:15.924381 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:15.924974 31025 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.925184 31604 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:15.910812 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:15.907294 31031 rpcz_store.cc:276] 0709 13:15:13.595577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.595755 (+   178us) service_pool.cc:224] Handling call
0709 13:15:13.610310 (+ 14555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.830969 (+220659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:15.875974 (+2045005us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400347e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:15.876177 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254076672}
I20260709 13:15:15.873509  1134 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:15.586234  1119 consensus_meta.cc:287] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.078s	user 0.008s	sys 0.004s
I20260709 13:15:15.914583 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:15.900458  1097 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:15.925531 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:15.930615 31600 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.930532 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:15.931254 31031 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:15.898522  1109 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.926072 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:15.901942  1023 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.937218 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:15.915153  1057 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:15.935154 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:15.940071 31604 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:15.906917   928 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:15.943396 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:15.943850 31600 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:15.930591  1128 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:15.944060 31604 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:15.929598 31597 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:15.946587 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 759) took 1327 ms. Trace:
I20260709 13:15:15.934055   784 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:15.948918 30996 leader_election.cc:400] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9.
I20260709 13:15:15.947661 31604 rpcz_store.cc:276] 0709 13:15:14.618902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.943147 (+1324245us) service_pool.cc:224] Handling call
0709 13:15:15.946535 (+  3388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.949349 30996 leader_election.cc:403] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:15:15.950388 31604 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:15.950352 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:15.952023 31604 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:15.936184  1192 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:15:15.932418  1119 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:15.938963   961 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:15:15.948964  1057 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:15.953145  1087 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:15.935077  1003 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:15.956799   784 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:15.955826  1154 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:15.971796  1114 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.018s	user 0.009s	sys 0.005s
I20260709 13:15:15.972594  1073 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:15:15.974848 31031 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:15.984339 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:15.985316 31031 raft_consensus.cc:2393] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:15.991453 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:15.994835 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.021843  1207 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:16.022485  1207 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.024103 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.024451 31027 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:16.024739 31031 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:16.024937  1208 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:16.025074 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2364) took 2130 ms. Trace:
I20260709 13:15:16.025704 31027 rpcz_store.cc:276] 0709 13:15:13.894955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.016620 (+2121665us) service_pool.cc:224] Handling call
0709 13:15:16.024090 (+  7470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.024837 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.025019 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:15.974454  1154 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:16.026911  1208 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.033774 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1629) took 2194 ms. Trace:
W20260709 13:15:16.047405 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 432) took 2076 ms (client timeout 1793 ms). Trace:
W20260709 13:15:16.052066 31032 rpcz_store.cc:269] 0709 13:15:13.970815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.264372 (+293557us) service_pool.cc:224] Handling call
0709 13:15:16.047231 (+1782859us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54000c44d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:16.047338 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133385088}
I20260709 13:15:16.041486 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:16.051896 30882 rpcz_store.cc:276] 0709 13:15:13.839893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.841026 (+  1133us) service_pool.cc:224] Handling call
0709 13:15:13.841395 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.983201 (+141806us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:14.469475 (+486274us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.991714 (+522239us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.992372 (+   658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:14.992433 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:14.992480 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.033455 (+1040975us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003412d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:16.033518 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.033679 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182839,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":5975,"raft.queue_time_us":20585,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":61267,"spinlock_wait_cycles":325608704,"thread_start_us":497684,"threads_started":3,"wal-append.queue_time_us":282415,"wal-append.run_cpu_time_us":3166,"wal-append.run_wall_time_us":1250758}
I20260709 13:15:16.053956 31031 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.046651 31025 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:16.054750 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2370) took 1036 ms. Trace:
I20260709 13:15:16.055016 31025 rpcz_store.cc:276] 0709 13:15:15.018104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.916050 (+897946us) service_pool.cc:224] Handling call
0709 13:15:16.054703 (+138653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.048008 31596 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:15.985998   959 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:16.025532  1203 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:16.078068 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2190) took 2105 ms. Trace:
I20260709 13:15:16.078195  1054 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.078811  1054 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.067613  1134 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.073731  1023 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.081285   886 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.081807   886 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.073865   619 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:16.082937   619 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:16.050550  1154 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.083860   619 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.084888   619 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.075448 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1622) took 2627 ms. Trace:
I20260709 13:15:16.086129 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2368) took 1088 ms. Trace:
I20260709 13:15:16.075380   928 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.086498 30877 rpcz_store.cc:276] 0709 13:15:13.447988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.449155 (+  1167us) service_pool.cc:224] Handling call
0709 13:15:13.460120 (+ 10965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.955475 (+495355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.075197 (+2119722us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540043c454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:16.075384 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065110784}
W20260709 13:15:16.047427  1202 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:15:16.073105 31597 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:16.088550 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:16.088968  1169 consensus_meta.cc:287] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.001s
I20260709 13:15:16.069989   908 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:16.081310  1054 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.089466  1169 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:16.089707 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.090775 31030 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:16.091526 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:16.092061 31030 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:16.077121 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.092999 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 755) took 1523 ms. Trace:
I20260709 13:15:16.000375   917 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:16.093304 31605 rpcz_store.cc:276] 0709 13:15:14.569380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.570876 (+  1496us) service_pool.cc:224] Handling call
0709 13:15:16.076974 (+1506098us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:16.092944 (+ 15970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46383872}
I20260709 13:15:16.093537   917 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.094456 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.071521 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:16.095963 30955 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:16.062256 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.096310 31602 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:16.097432 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.098414 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.098832 30949 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:16.098958 31032 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
W20260709 13:15:16.067196 31601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 749) took 2329 ms (client timeout 1627 ms). Trace:
I20260709 13:15:16.100814 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.102491 31025 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:16.099758 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.101773 31030 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:16.101718 31601 rpcz_store.cc:269] 0709 13:15:13.737688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.830207 (+ 92519us) service_pool.cc:224] Handling call
0709 13:15:16.066995 (+2236788us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54007201d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:16.067126 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437682432}
I20260709 13:15:16.107291 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.086612 31028 rpcz_store.cc:276] 0709 13:15:14.997875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.005565 (+  7690us) service_pool.cc:224] Handling call
0709 13:15:16.085964 (+1080399us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b540009f1d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:16.086071 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196673408}
I20260709 13:15:16.078478 30879 rpcz_store.cc:276] 0709 13:15:13.973094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.975015 (+  1921us) service_pool.cc:224] Handling call
0709 13:15:13.985842 (+ 10827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:14.364894 (+379052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.364938 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:14.460244 (+ 95306us) log.cc:844] Serialized 26 byte log entry
0709 13:15:14.634308 (+174064us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:14.634368 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.077698 (+1443330us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000f9454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:16.077757 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.077797 (+    40us) raft_consensus.cc:1685] finished
0709 13:15:16.077811 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.078012 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":620,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4922,"spinlock_wait_cycles":870576512,"thread_start_us":143894,"threads_started":1,"wal-append.queue_time_us":388685,"wal-append.run_cpu_time_us":1714,"wal-append.run_wall_time_us":1067639}
I20260709 13:15:16.108803 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:16.095652 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:16.110728 31598 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.950s	user 0.007s	sys 0.003s
I20260709 13:15:16.111212 31598 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:16.111944 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 761) took 1492 ms. Trace:
I20260709 13:15:16.112275 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.112341 31598 rpcz_store.cc:276] 0709 13:15:14.619575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.861513 (+241938us) service_pool.cc:224] Handling call
0709 13:15:16.111872 (+1250359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.113675 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:16.124349 31030 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:16.124537 31028 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:16.125398 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 435) took 2147 ms. Trace:
I20260709 13:15:16.125909 31030 rpcz_store.cc:276] 0709 13:15:13.977710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.123847 (+2146137us) service_pool.cc:224] Handling call
0709 13:15:16.124165 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.125067 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.125325 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.128995 31031 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:16.055749  1132 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 2.180s	user 0.010s	sys 0.005s
I20260709 13:15:16.131018 31601 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:16.117730  1129 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:16.137029 31602 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:16.070490   909 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.083s	user 0.009s	sys 0.000s
W20260709 13:15:16.152026 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50449.8us
I20260709 13:15:16.051005   836 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.091619  1169 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:16.144454 31025 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:16.156214 31026 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:16.156481 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 433) took 2181 ms. Trace:
I20260709 13:15:16.156893 31025 rpcz_store.cc:276] 0709 13:15:13.975228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.125126 (+2149898us) service_pool.cc:224] Handling call
0709 13:15:16.144281 (+ 19155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.156208 (+ 11927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.156420 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.077219  1208 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.057574  1004 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.160605   917 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.161047  1004 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.161929   917 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.162463   917 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.163422  1004 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.108616   886 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.147650 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:16.147805 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.164784 30879 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:16.117375 30952 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:16.151707 31602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 756) took 1555 ms (client timeout 2066 ms). Trace:
W20260709 13:15:16.166002 31602 rpcz_store.cc:269] 0709 13:15:14.596763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.612232 (+ 15469us) service_pool.cc:224] Handling call
0709 13:15:16.071333 (+1459101us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:16.151647 (+ 80314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8042880}
I20260709 13:15:16.138731 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 436) took 2160 ms. Trace:
I20260709 13:15:16.166923 31028 rpcz_store.cc:276] 0709 13:15:13.978007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.123847 (+2145840us) service_pool.cc:224] Handling call
0709 13:15:16.124235 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.138432 (+ 14197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.138661 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:16.170578 31031 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.126991 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.067061  1210 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.160322  1077 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:16.063596  1003 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:16.152808 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:16.172027 31030 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:16.184108 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:16.185858 31027 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:16.063859   784 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:16.201072 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 265978us
I20260709 13:15:16.201879 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:16.173589  1169 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:16.208904 31027 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:16.195951   886 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:16.225057 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.228010 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:16.231462 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.232837 30882 raft_consensus.cc:2410] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:16.234890 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:16.158546   836 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.235963 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.240491 30877 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:16.240790 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.237615 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.197126  1004 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:15:16.244946 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:16.215010 31031 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:16.240818 31028 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:16.231415  1094 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.257659 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2356) took 3479 ms. Trace:
I20260709 13:15:16.233991  1219 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.234563  1211 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.262547 31031 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:16.258095 31029 rpcz_store.cc:276] 0709 13:15:12.820027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.086477 (+266450us) service_pool.cc:224] Handling call
0709 13:15:13.100316 (+ 13839us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:13.209466 (+109150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.209512 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:13.210205 (+   693us) log.cc:844] Serialized 52 byte log entry
0709 13:15:13.361425 (+151220us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:14.558032 (+1196607us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.561135 (+  3103us) log.cc:844] Serialized 14 byte log entry
0709 13:15:14.588090 (+ 26955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:14.588185 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.896335 (+308150us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b1800321280. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:15.014828 (+118493us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b1800321280. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:16.048519 (+1033691us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:16.257432 (+208913us) raft_consensus.cc:1685] finished
0709 13:15:16.257462 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.257598 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1069220,"prepare.queue_time_us":1060001,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":84,"raft.queue_time_us":139672,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":25548,"spinlock_wait_cycles":29521280,"thread_start_us":285219,"threads_started":2,"wal-append.queue_time_us":522820}
I20260709 13:15:16.236604  1215 raft_consensus.cc:2764] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:16.179736  1210 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.255345 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.265609 30875 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:16.210371  1169 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:16.262494 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 78466.2us
I20260709 13:15:16.238174   886 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:16.266390 30949 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:16.263841 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:16.267109 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:16.269500 30877 raft_consensus.cc:2376] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7. Re-sending same reply.
I20260709 13:15:16.272677 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:16.272043 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:16.260393  1156 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.257879  1220 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:16.295961 30879 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.277880  1215 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.267611   917 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.276458  1152 raft_consensus.cc:2764] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:16.261983  1094 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.317159  1004 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.317713  1004 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:16.317970  1213 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:15:16.321426  1004 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:16.325613  1218 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:16.325759   836 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:16.328390 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50001.1us
I20260709 13:15:16.330453 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:16.334653 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:16.342108 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2369) took 1340 ms. Trace:
W20260709 13:15:16.342249 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 70262.5us
I20260709 13:15:16.309253  1220 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:16.344254 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:16.342842 31028 rpcz_store.cc:276] 0709 13:15:15.002197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.167706 (+1165509us) service_pool.cc:224] Handling call
0709 13:15:16.168311 (+   605us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:16.168840 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.168869 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:16.169945 (+  1076us) log.cc:844] Serialized 608 byte log entry
0709 13:15:16.240692 (+ 70747us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:16.275568 (+ 34876us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.341298 (+ 65730us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.341769 (+   471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.341855 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.341898 (+    43us) raft_consensus.cc:1685] finished
0709 13:15:16.341909 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.342047 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6544,"prepare.queue_time_us":64153,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":2830,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":4732,"thread_start_us":107560,"threads_started":2,"wal-append.queue_time_us":108734}
I20260709 13:15:16.350014 30881 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:16.350761 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:16.314571 30879 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:16.338503 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:16.308068  1051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36650 (request call id 89) took 15936 ms. Trace:
I20260709 13:15:16.315339  1224 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.268051  1211 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.340101   836 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.266675  1219 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:16.349496   886 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.353642  1215 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:15:16.354991  1233 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.360314  1233 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:16.360699  1233 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.360728  1006 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:16.355094  1151 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:15:16.354883  1228 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:16.364367  1094 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.336817  1087 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9.
I20260709 13:15:16.349378  1156 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:16.340528  1152 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:16.424857 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.425136 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:16.517210 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 178780us
I20260709 13:15:16.443022 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 845) took 1317 ms. Trace:
I20260709 13:15:16.431092  1211 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.364316  1228 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:16.555734  1223 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:15:16.358124  1215 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:16.629341  1215 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:16.607563 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:16.609303 31596 rpcz_store.cc:276] 0709 13:15:15.125334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.047216 (+921882us) service_pool.cc:224] Handling call
0709 13:15:16.047589 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.047860 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:16.152357 (+104497us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.442176 (+289819us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.442580 (+   404us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:16.442647 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:16.442710 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.442797 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.442949 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7257,"raft.queue_time_us":335,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":40074,"thread_start_us":278024,"threads_started":2,"wal-append.queue_time_us":109718}
I20260709 13:15:16.516157  1010 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.432408  1214 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:16.357077   836 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.621538   784 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.625988 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1480) took 2662 ms. Trace:
I20260709 13:15:16.627024 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1800) took 3183 ms. Trace:
I20260709 13:15:16.364871   959 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.264s
W20260709 13:15:16.636272 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2747038669999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:15:16.637688 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2503935399997772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 13:15:16.636480 31023 rpcz_store.cc:276] 0709 13:15:13.443458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.557836 (+114378us) service_pool.cc:224] Handling call
0709 13:15:13.570211 (+ 12375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:13.570691 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:13.570730 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:13.571315 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:15:13.731233 (+159918us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:13.731279 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:13.731339 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:14.219429 (+488090us) raft_consensus.cc:1685] finished
0709 13:15:14.219455 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.626720 (+2407265us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54000c4ed0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:16.626955 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":856,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":20441,"spinlock_wait_cycles":27554048,"thread_start_us":105182,"threads_started":1,"wal-append.queue_time_us":199053,"wal-append.run_cpu_time_us":3072,"wal-append.run_wall_time_us":1414691}
I20260709 13:15:16.640401 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:16.636315 30953 rpcz_store.cc:276] 0709 13:15:13.963643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.971807 (+  8164us) service_pool.cc:224] Handling call
0709 13:15:13.985441 (+ 13634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.858169 (+1872728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.625628 (+767459us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540008c5d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:16.625909 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623546112}
I20260709 13:15:16.365231  1224 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.645073  1010 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.645792  1215 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.647133  1215 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:16.647832   784 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.648344  1214 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:16.648926  1214 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:16.649724   619 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.008s
I20260709 13:15:16.555301  1054 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.650477  1054 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.358953  1219 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:16.594996  1156 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:16.647521  1010 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.649947   784 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.645555  1224 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.651540  1156 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.652854  1054 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.658294 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.660126 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 434) took 2682 ms. Trace:
I20260709 13:15:16.660655 31032 rpcz_store.cc:276] 0709 13:15:13.977397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.118404 (+2141007us) service_pool.cc:224] Handling call
0709 13:15:16.131289 (+ 12885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.140975 (+  9686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.141016 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.141506 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.423409 (+281903us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:16.423460 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.423546 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.659861 (+236315us) raft_consensus.cc:1685] finished
0709 13:15:16.659887 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.660047 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4453,"thread_start_us":248582,"threads_started":1,"wal-append.queue_time_us":498068}
I20260709 13:15:16.348194  1154 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.651187 31028 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:16.668349 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.668936 30875 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:16.607568  1077 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:16.597594  1152 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:16.682615 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:16.651183   836 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.664137 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:16.702917 31602 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:16.666340 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.666934 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:16.703631 31032 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:16.673141 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.704770 31596 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:16.706509 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:16.708416 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 357716us
I20260709 13:15:16.597442  1220 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.681782 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:16.685992 30877 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.684468 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.749663 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.750761 31598 raft_consensus.cc:2410] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:15:16.682114 31571 connection.cc:256] RPC call timeout handler was delayed by -1.31241520399999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 13:15:16.703822 30953 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:16.671427 30875 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:15:16.679142 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:16.709405 31027 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:16.673763  1222 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.395s	user 0.002s	sys 0.000s
I20260709 13:15:16.710777 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.751443 31028 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:16.753355 31032 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:16.665526  1169 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:16.667635  1094 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:16.745566 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:16.701875  1152 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:16.748186 30882 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:16.679867  1237 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:16.754212 31596 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:16.751747 31023 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:16.760035 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:16.704005  1077 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:16.775328 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:16.775528 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:16.777064 30953 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:16.745064  1210 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.778475 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:16.784083 31571 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:16.789696 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:16.353442  1051 rpcz_store.cc:276] 0709 13:15:00.359095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:00.359224 (+   129us) service_pool.cc:224] Handling call
0709 13:15:01.789571 (+1430347us) log.cc:844] Serialized 494 byte log entry
0709 13:15:01.838255 (+ 48684us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54003778d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac60735 00007f273ac589fa 00007f273fc204c9 00007f273919cc54 00007f273919cbe2 00007f273919cb11 00007f273919ca8c 00007f273919bd42 00007f2738f9548c 00007f2738f948c6
0709 13:15:01.983089 (+144834us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5400335a20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abdab26 00007f273abd449a 00007f273abd3714 00007f273abb3eaa 00007f273abbad53 00007f273abbacd9 00007f273abbac69 00007f273abbac31 00007f273abb9dfd 000000000038f354
0709 13:15:16.277444 (+14294355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15467,"raft.queue_time_us":63524,"raft.run_cpu_time_us":3488,"raft.run_wall_time_us":217800,"spinlock_wait_cycles":1439280896,"thread_start_us":267042,"threads_started":1}
I20260709 13:15:16.780699   619 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:16.775233  1169 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:15:16.759469  1094 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:16.794242  1006 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:15:16.790731   959 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.792171  1151 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:16.882973  1151 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.883582  1151 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:16.900792  1229 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:15:16.902648  1232 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:16.913230  1224 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:16.916520  1224 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:16.796358  1239 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:16.898942  1154 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.934015  1239 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:16.935420  1239 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.930050  1182 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:16.935660  1242 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:15:16.942278  1207 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.936780  1228 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:16.957402  1214 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:16.960645  1214 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:16.964709  1233 consensus_meta.cc:287] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.003s
I20260709 13:15:16.965350  1233 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:16.967794  1237 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:16.968159  1233 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.008235 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.012085 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.013051 30953 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:17.014595 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.014789 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.015743 30953 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:17.018237 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2365) took 2024 ms. Trace:
W20260709 13:15:16.807721 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 196330us
I20260709 13:15:17.024260 31025 rpcz_store.cc:276] 0709 13:15:14.993896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.157870 (+1163974us) service_pool.cc:224] Handling call
0709 13:15:16.158302 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:16.159517 (+  1215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.159567 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:16.160210 (+   643us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.267726 (+107516us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:16.267786 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.267871 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.017499 (+749628us) raft_consensus.cc:1685] finished
0709 13:15:17.017538 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.017916 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664,"raft.queue_time_us":1694,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":33152,"thread_start_us":106295,"threads_started":1,"wal-append.queue_time_us":117688}
I20260709 13:15:17.023219 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 846) took 1710 ms. Trace:
I20260709 13:15:17.027967 31597 rpcz_store.cc:276] 0709 13:15:15.312469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.072241 (+759772us) service_pool.cc:224] Handling call
0709 13:15:16.072654 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.072951 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:16.374608 (+301657us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.021594 (+646986us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.022158 (+   564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.022263 (+   105us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:17.022427 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.022592 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.022841 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36509,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6924,"raft.queue_time_us":13146,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3887,"thread_start_us":624063,"threads_started":2,"wal-append.queue_time_us":426018}
I20260709 13:15:17.031635 31025 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:17.034003 31025 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:17.027395 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:17.036875 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.038659 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:16.842762 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 831) took 1886 ms. Trace:
I20260709 13:15:17.039553 31600 rpcz_store.cc:276] 0709 13:15:14.956403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.944687 (+988284us) service_pool.cc:224] Handling call
0709 13:15:15.945096 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.159983 (+214887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.160012 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.176151 (+ 16139us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.422533 (+246382us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:16.422594 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.422693 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:16.842425 (+419732us) raft_consensus.cc:1685] finished
0709 13:15:16.842458 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:16.842668 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8070,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2352,"thread_start_us":397879,"threads_started":2,"wal-append.queue_time_us":456757}
I20260709 13:15:17.044239   619 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:17.046356   619 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:17.048498 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:16.825572   958 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.050906   958 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.829275   961 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.053022   958 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.053313   961 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:16.823498  1077 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:16.939921  1182 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.065606  1155 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.067194  1155 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.068853  1183 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.069561  1183 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.070309 31025 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:17.061918  1182 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.079116  1119 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.073784  1183 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.055567   961 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.113070 30877 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:17.117149   961 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.099280 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:17.120054  1155 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:17.129276 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 90883.2us
I20260709 13:15:17.141880 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1856) took 2644 ms. Trace:
W20260709 13:15:17.131919 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.148159 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:17.154199 30952 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.025s
I20260709 13:15:17.154083   959 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:17.155390 30952 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.007s	sys 0.025s
I20260709 13:15:17.159945 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1488) took 1063 ms. Trace:
I20260709 13:15:17.143980  1244 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:15:17.160842 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 481603us
I20260709 13:15:17.165441  1094 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.165700 30877 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:17.169986 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.171599 30882 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:17.175012 30954 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:17.176904 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.177529 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1858) took 2225 ms. Trace:
W20260709 13:15:17.178900  1242 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:15:17.184268 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 435861us
I20260709 13:15:17.184811 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.186609 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:17.188060 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:17.188243 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56479.4us
I20260709 13:15:17.205118 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:17.152314   994 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.946s	user 0.024s	sys 0.024s
W20260709 13:15:17.206089   994 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.081s	user 0.024s	sys 0.024s
I20260709 13:15:17.207352  1214 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.207583 30880 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:17.188001  1233 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.209122  1233 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.210309  1246 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:17.210978  1246 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.152595  1182 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.213294  1246 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:17.189895 31026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 438) took 2557 ms (client timeout 2223 ms). Trace:
I20260709 13:15:17.131835  1006 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:15:17.215999 31026 rpcz_store.cc:269] 0709 13:15:14.632235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.753390 (+121155us) service_pool.cc:224] Handling call
0709 13:15:17.189426 (+2436036us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003f5cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.189665 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3113014656}
I20260709 13:15:17.216431  1006 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:17.216858  1006 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:17.218101  1006 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.187928  1249 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.198478 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1862) took 2245 ms. Trace:
I20260709 13:15:17.220329 30954 rpcz_store.cc:276] 0709 13:15:14.952647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.141532 (+188885us) service_pool.cc:224] Handling call
0709 13:15:17.173977 (+2032445us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:17.174411 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.198124 (+ 23713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.198401 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32463104}
I20260709 13:15:17.211629  1233 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.221789 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.222565 30954 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:17.223067 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1498) took 1080 ms. Trace:
I20260709 13:15:17.223393 30954 rpcz_store.cc:276] 0709 13:15:16.143006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.221402 (+1078396us) service_pool.cc:224] Handling call
0709 13:15:17.223012 (+  1610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.155539  1210 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.225042  1210 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:17.219547  1006 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.142473 30957 rpcz_store.cc:276] 0709 13:15:14.497160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.565487 (+ 68327us) service_pool.cc:224] Handling call
0709 13:15:14.565788 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:14.614617 (+ 48829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:14.614665 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:14.615475 (+   810us) log.cc:844] Serialized 52 byte log entry
0709 13:15:16.629583 (+2014108us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003ded00. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:16.784734 (+155151us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.101459 (+316725us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.141045 (+ 39586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.141172 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.141233 (+    61us) raft_consensus.cc:1685] finished
0709 13:15:17.141344 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.141612 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27856,"prepare.queue_time_us":342702,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":112,"raft.queue_time_us":44294,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":81286,"spinlock_wait_cycles":39320448,"thread_start_us":223036,"threads_started":2,"wal-append.queue_time_us":2226048}
I20260709 13:15:17.225615 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 834) took 3928 ms. Trace:
I20260709 13:15:17.199297 30955 rpcz_store.cc:276] 0709 13:15:14.951552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.017557 (+ 66005us) service_pool.cc:224] Handling call
0709 13:15:15.017909 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.108014 (+1090105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.176932 (+1068918us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400256054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:17.177300 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2478786304}
W20260709 13:15:17.225713 31603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 757) took 2607 ms (client timeout 2797 ms). Trace:
I20260709 13:15:17.225677  1210 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.228909 31599 rpcz_store.cc:276] 0709 13:15:13.296594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.315197 (+ 18603us) service_pool.cc:224] Handling call
0709 13:15:13.350821 (+ 35624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:13.802850 (+452029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.224904 (+3422054us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54005f28d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:17.225322 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665255296}
I20260709 13:15:17.191553   958 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:17.234346 31603 rpcz_store.cc:269] 0709 13:15:14.618206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.623927 (+  5721us) service_pool.cc:224] Handling call
0709 13:15:17.225170 (+2601243us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400715054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.225372 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886800640}
I20260709 13:15:17.160533 30952 rpcz_store.cc:276] 0709 13:15:16.096842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.099639 (+  2797us) service_pool.cc:224] Handling call
0709 13:15:16.099980 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.100182 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:16.220484 (+120302us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.156961 (+936477us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.159171 (+  2210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.159270 (+    99us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:17.159394 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.159562 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.159832 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":207,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":167127,"raft.run_cpu_time_us":440,"raft.run_wall_time_us":21188,"thread_start_us":870783,"threads_started":2,"wal-append.queue_time_us":554503}
W20260709 13:15:17.279592 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 58954.3us
W20260709 13:15:17.280145 31601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.008s	sys 0.024s
W20260709 13:15:17.280656 31601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.008s	sys 0.024s
I20260709 13:15:17.277388 30882 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:17.286732 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.292222 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.293496 30955 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
W20260709 13:15:17.295909 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 482974us
I20260709 13:15:17.304849 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet adb189bd941147e0924cc38c9f01bd11 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 13:15:17.306772 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.308634 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.310012  1233 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:17.311012  1004 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.311160 30953 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:17.311529  1119 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.311715  1004 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.312387  1119 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.314493  1004 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.314776  1119 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.317212   958 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.310734  1233 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:17.318565  1156 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.007s
I20260709 13:15:17.319038  1156 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.319530  1233 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.310334 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.320828 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1808) took 1327 ms. Trace:
I20260709 13:15:17.321712  1126 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.322039 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.322410  1126 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.324095  1154 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:17.324918  1154 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.321296 31030 rpcz_store.cc:276] 0709 13:15:15.992871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.181833 (+188962us) service_pool.cc:224] Handling call
0709 13:15:16.182226 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.182482 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:16.348269 (+165787us) log.cc:844] Serialized 14 byte log entry
0709 13:15:16.788364 (+440095us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.198274 (+409910us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18004740a0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:17.238025 (+ 39751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.252392 (+ 14367us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.278624 (+ 26232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.287714 (+  9090us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.320589 (+ 32875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":488899,"prepare.queue_time_us":161522,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":447265,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":46595,"spinlock_wait_cycles":2397056,"thread_start_us":577284,"threads_started":2,"wal-append.queue_time_us":462631}
I20260709 13:15:17.328505 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.329818 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:17.330327  1126 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:17.331015 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:17.335208  1212 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.315s	user 0.004s	sys 0.000s
I20260709 13:15:17.335525  1183 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.338392 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.339107 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1493) took 1203 ms. Trace:
I20260709 13:15:17.339478 30953 rpcz_store.cc:276] 0709 13:15:16.108449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.090174 (+981725us) service_pool.cc:224] Handling call
0709 13:15:17.311732 (+221558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.351750 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.353775 30955 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:17.354045  1152 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.009s
I20260709 13:15:17.354561  1152 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.341331  1183 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.370986  1152 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:17.374095 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.375821   836 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.377560 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:17.369372  1215 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.010s
I20260709 13:15:17.387280 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.392129   784 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:17.404225 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 351812us
I20260709 13:15:17.405184   784 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.407250 30951 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:17.409360 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.392922  1233 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:17.409960 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1863) took 2457 ms. Trace:
I20260709 13:15:17.408715 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.376509   836 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.411916 30951 rpcz_store.cc:276] 0709 13:15:14.952913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.860669 (+907756us) service_pool.cc:224] Handling call
0709 13:15:17.376628 (+1515959us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:17.376934 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.409688 (+ 32754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.409910 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77698816}
I20260709 13:15:17.417173  1239 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.417958  1239 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.418262  1208 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:17.422672   784 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.423302   784 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:17.424507 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1867) took 2470 ms. Trace:
I20260709 13:15:17.425500 31602 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
W20260709 13:15:17.432036 31570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.223s (SENT) [suppressed 17 similar messages]
W20260709 13:15:17.432916 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.433244 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:17.433611 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 609) took 2434 ms. Trace:
I20260709 13:15:17.433966 30880 rpcz_store.cc:276] 0709 13:15:14.999131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:14.999264 (+   133us) service_pool.cc:224] Handling call
0709 13:15:15.000956 (+  1692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:17.208351 (+2207395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.433320 (+224969us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b5400290254. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:17.433535 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5072860544}
I20260709 13:15:17.434558 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.434737   836 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.435572 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.437017 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:17.437671 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1500) took 1185 ms. Trace:
I20260709 13:15:17.438061 30954 rpcz_store.cc:276] 0709 13:15:16.252512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.436663 (+1184151us) service_pool.cc:224] Handling call
0709 13:15:17.437048 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.437266 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.437288 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.437362 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:17.437393 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.437466 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.437588 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.435475 30874 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:17.435464 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:17.441578 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 55079.3us
I20260709 13:15:17.445645 30955 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:17.447069 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1496) took 1308 ms. Trace:
I20260709 13:15:17.447471 30955 rpcz_store.cc:276] 0709 13:15:16.138436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.294609 (+1156173us) service_pool.cc:224] Handling call
0709 13:15:17.447013 (+152404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.446547 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:17.417991  1151 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.003s
I20260709 13:15:17.423653   784 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:17.449811 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.453781 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.455277  1256 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.456070  1256 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.456779 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1501) took 1119 ms. Trace:
I20260709 13:15:17.457190 30954 rpcz_store.cc:276] 0709 13:15:16.337733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.442526 (+1104793us) service_pool.cc:224] Handling call
0709 13:15:17.456156 (+ 13630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.456408 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:17.456439 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:17.456500 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:17.456534 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.456596 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.456704 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.458581  1256 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.458838 30954 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.459241 31599 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 4: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:17.452795 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:17.460402 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.460868 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.461041 31600 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:17.461534 30880 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:17.462524 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.462937   784 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.447654 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.463416   856 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.464032 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.465468   763 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:17.467016 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.490466   763 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.491339 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.443092  1155 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:17.424948 30958 rpcz_store.cc:276] 0709 13:15:14.953920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.892598 (+938678us) service_pool.cc:224] Handling call
0709 13:15:15.893416 (+   818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:15.893774 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.893804 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:15.894267 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:15:16.019339 (+125072us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:16.019404 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:16.019505 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.334346 (+1314841us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:17.356374 (+ 22028us) raft_consensus.cc:1685] finished
0709 13:15:17.356395 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.424279 (+ 67884us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4284,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3851,"spinlock_wait_cycles":28998272,"thread_start_us":110630,"threads_started":1,"wal-append.queue_time_us":119989}
I20260709 13:15:17.459642 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 546) took 1033 ms. Trace:
I20260709 13:15:17.482040 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.480321 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.483880 30877 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.483193 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:17.495478 30954 rpcz_store.cc:276] 0709 13:15:16.425832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.458265 (+1032433us) service_pool.cc:224] Handling call
0709 13:15:17.458655 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.459365 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.459560 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.484198  1239 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:17.484403 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.485271 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.485816 30951 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:17.485944  1152 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.499946  1152 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.499993  1155 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:17.500588 30950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 523) took 4307 ms (client timeout 1603 ms). Trace:
W20260709 13:15:17.501044 30950 rpcz_store.cc:269] 0709 13:15:13.192585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.235935 (+ 43350us) service_pool.cc:224] Handling call
0709 13:15:17.500174 (+4264239us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400256f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.500385 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918012288}
I20260709 13:15:17.502247  1152 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:17.502344  1155 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.503423 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.504020 30880 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:17.487202 30955 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:17.489463  1170 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.493100 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.503649 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:17.448691  1233 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.503077 31599 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:17.507753 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 545) took 1080 ms. Trace:
I20260709 13:15:17.508462 30955 rpcz_store.cc:276] 0709 13:15:16.425565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.476636 (+1051071us) service_pool.cc:224] Handling call
0709 13:15:17.486895 (+ 10259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.505296 (+ 18401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.505492 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.506951 30874 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:17.510560 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.506291  1170 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:17.511636 31600 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:17.512041  1156 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.514891 30957 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
W20260709 13:15:17.514643 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 137948us
I20260709 13:15:17.522078   856 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:17.522864   856 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.512432  1215 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:17.524310  1215 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.525589   856 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.526799  1215 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.520390 30953 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:15:17.535341 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1499) took 1383 ms. Trace:
I20260709 13:15:17.535655 30953 rpcz_store.cc:276] 0709 13:15:16.151835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:17.441507 (+1289672us) service_pool.cc:224] Handling call
0709 13:15:17.492386 (+ 50879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:17.535072 (+ 42686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.535263 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:17.527508 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:17.539436 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.540402 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.541047  1098 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:17.542032  1042 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:17.532557 30951 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:15:17.542721  1042 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.543907  1109 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.544121 30951 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:17.545485 30951 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.545969  1233 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.519922  1170 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.546500 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1818) took 1528 ms. Trace:
I20260709 13:15:17.547297 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.470468  1151 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.546912 31027 rpcz_store.cc:276] 0709 13:15:16.017756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.219594 (+201838us) service_pool.cc:224] Handling call
0709 13:15:16.219931 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:16.752713 (+532782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.538429 (+785716us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400378cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:17.546339 (+  7910us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125101824}
I20260709 13:15:17.547502  1042 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.549669  1151 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:15:17.550153  1210 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.551468 30878 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:17.551353 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:17.551748 30879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2193) took 1324 ms (client timeout 1549 ms). Trace:
W20260709 13:15:17.552230 30879 rpcz_store.cc:269] 0709 13:15:16.226955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.227713 (+   758us) service_pool.cc:224] Handling call
0709 13:15:17.551440 (+1323727us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b54000f9e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.551575 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154597760}
I20260709 13:15:17.552820 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.552826 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.554216  1210 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:17.560343 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.563505 30954 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:17.564121 30955 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.099165 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:17.554668  1154 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.572441  1256 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.572769  1098 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.574039  1256 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:17.574452  1256 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.574132  1098 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.576268 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:17.582671 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.583400 30958 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:17.617449 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.620774 30874 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:17.575834  1182 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:15:17.621104 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 99064us
I20260709 13:15:17.575405  1256 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.612068  1156 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.614347  1155 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:17.632599 30956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 534) took 4406 ms (client timeout 1929 ms). Trace:
W20260709 13:15:17.633055 30956 rpcz_store.cc:269] 0709 13:15:13.226264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:13.649954 (+423690us) service_pool.cc:224] Handling call
0709 13:15:17.616568 (+3966614us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400350f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.632395 (+ 15827us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683599232}
I20260709 13:15:17.638326 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 444) took 1137 ms. Trace:
I20260709 13:15:17.639623  1215 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.639822 30847 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:17.638720 31032 rpcz_store.cc:276] 0709 13:15:16.427834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.776531 (+348697us) service_pool.cc:224] Handling call
0709 13:15:16.776856 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:16.777215 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:16.777243 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:16.777766 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:15:17.435535 (+657769us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400340920. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc4090 00007f273abd16b8 00007f273ac5a92b 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c
0709 13:15:17.435629 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:17.479942 (+ 44313us) log.cc:844] Serialized 14 byte log entry
0709 13:15:17.496947 (+ 17005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.510955 (+ 14008us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:17.511020 (+    65us) raft_consensus.cc:1685] finished
0709 13:15:17.515699 (+  4679us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.565105 (+ 49406us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1943,"prepare.queue_time_us":146170,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4951,"raft.queue_time_us":93210,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":3121,"spinlock_wait_cycles":296314112,"thread_start_us":116019,"threads_started":2,"wal-append.queue_time_us":313606}
I20260709 13:15:17.640251  1215 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:17.640625 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 84064.8us
I20260709 13:15:17.642290  1019 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.642670  1019 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:17.646806 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.647904 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.649405 31600 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.650652 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.651348 31603 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:17.652359 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:17.652925 31597 raft_consensus.cc:2376] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7. Re-sending same reply.
I20260709 13:15:17.653405  1006 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.653980  1006 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.654541 31596 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:17.655473   856 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:17.656646 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.626049  1151 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:17.657289 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.657701  1151 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.657989  1156 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.659979  1151 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.660475  1256 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.660609 31601 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:17.661158 31598 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:17.656433   856 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.649329  1054 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:17.642764  1215 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:17.681558 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 43671.8us
I20260709 13:15:17.683215 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:17.683967 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 443) took 1256 ms. Trace:
I20260709 13:15:17.684099   886 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:17.684373 31023 rpcz_store.cc:276] 0709 13:15:16.427531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.640144 (+212613us) service_pool.cc:224] Handling call
0709 13:15:17.683587 (+1043443us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54000c44d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.683748 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60752768}
I20260709 13:15:17.687351 30996 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.687664  1051 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:17.687911 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.688668 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:17.687677 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:17.688931 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.689349 31596 raft_consensus.cc:2376] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7. Re-sending same reply.
I20260709 13:15:17.689586 31600 raft_consensus.cc:2376] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7. Re-sending same reply.
I20260709 13:15:17.689937 31598 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:17.690505 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.689397 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.618768  1210 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:15:17.688669 31603 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:17.659999  1156 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:17.696283 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.698185 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.663621  1019 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.699355  1002 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:17.699604 31599 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:17.699945  1054 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.701485 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.702158  1054 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.702667 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.703827 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.704064  1006 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.704851 31603 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
W20260709 13:15:17.704988 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 268547us
I20260709 13:15:17.705729 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.705919 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:17.703429 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:17.706488 31603 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:17.689985   909 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.699436  1270 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.713738 31599 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:17.714052  1036 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:17.712728  1054 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.715627  1268 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:15:17.716985 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:17.713781 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 57271.9us
I20260709 13:15:17.724588  1185 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:17.725596  1275 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:15:17.728307  1163 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:17.729945  1163 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:17.730703  1006 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.731063  1163 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:17.731272  1006 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.733325  1006 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:17.724406  1054 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.737613  1054 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.740206 31598 raft_consensus.cc:2376] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8. Re-sending same reply.
I20260709 13:15:17.741382  1259 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:17.741914  1259 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.742257  1259 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.713130   909 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.749385   909 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.718036  1270 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:17.753505  1270 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.754233  1042 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:17.754720  1042 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.754958  1270 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.756348   763 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.756934 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 766) took 2732 ms. Trace:
I20260709 13:15:17.757493 30950 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:17.757279 31604 rpcz_store.cc:276] 0709 13:15:15.024840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:15.952751 (+927911us) service_pool.cc:224] Handling call
0709 13:15:15.964873 (+ 12122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:15.967678 (+  2805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:15.967710 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:15.967751 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:15.967823 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:17.756514 (+1788691us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b54005f1c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:17.756571 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:17.756758 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5980928}
W20260709 13:15:17.746556 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 66580.6us
I20260709 13:15:17.748538  1183 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.768352  1183 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.769367  1183 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.719322  1036 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:17.770610  1183 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:17.771548 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.771649 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.772351 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.772596 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.773214 31023 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 3.
I20260709 13:15:17.773622 31031 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:17.759611 31596 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:17.761432   856 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:17.762416   917 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:17.774621   917 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.774914 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.775672 31031 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:17.775751   917 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.777166 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.777295   917 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.778944 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:17.779557 31031 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.762380  1097 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.763985  1273 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:17.766539   784 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.766721  1268 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.767503  1030 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:17.770671  1036 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:17.772537 31024 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:17.761170 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:17.761778 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:17.730063 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.796970 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 844) took 1142 ms. Trace:
I20260709 13:15:17.797420 31602 rpcz_store.cc:276] 0709 13:15:16.654871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.706185 (+ 51314us) service_pool.cc:224] Handling call
0709 13:15:17.796745 (+1090560us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540049a7d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.796896 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625668864}
I20260709 13:15:17.801131 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.780509  1273 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:17.803431 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 73493.7us
W20260709 13:15:17.805558 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 122409us
I20260709 13:15:17.791559  1030 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.810693  1085 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:17.811218  1085 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:17.811534  1030 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.813320  1030 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.814246 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.815258  1170 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.820034   856 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:17.821864  1268 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.823920  1097 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.824514  1268 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:17.825886 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.808632   994 raft_consensus.cc:2764] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:15:17.807083  1273 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.839099 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:17.755621  1042 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.841794 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.840117 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.846100 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:17.844666 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 155321us
I20260709 13:15:17.843822 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:17.849097 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.837401  1098 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.848652 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:17.851351 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 88712.8us
I20260709 13:15:17.852934 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.853740 30958 raft_consensus.cc:2410] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:17.851680 30954 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:17.850572 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:17.856151 30956 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:17.856694 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.857276 31601 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:17.858153 30952 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.859723 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:17.859110 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.863443 30953 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:17.865119 31602 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:17.867445 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.864693 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.873054 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.874142 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.864996 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.878918 31605 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:17.878906 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1490) took 1781 ms (client timeout 1722 ms). Trace:
W20260709 13:15:17.879459 30949 rpcz_store.cc:269] 0709 13:15:16.097528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.108504 (+ 10976us) service_pool.cc:224] Handling call
0709 13:15:17.874570 (+1766066us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540008bbd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.878692 (+  4122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352750848}
W20260709 13:15:17.883517 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:17.890405 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.874336  1268 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.891191  1268 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:17.893394  1268 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:17.884598 31024 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:17.895978 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:17.895290 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 87941.7us
I20260709 13:15:17.864539  1206 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.897146 30998 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:17.879112 31600 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:15:17.898398 31600 pending_rounds.cc:85] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 5
I20260709 13:15:17.898696 31600 pending_rounds.cc:107] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:17.899004 31600 raft_consensus.cc:2889] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:17.900516 31029 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:17.900758 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:17.901461 31023 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.902091  1126 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.904364 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.904536  1155 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:17.905084  1155 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.905447 31029 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:17.907996 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101706us
I20260709 13:15:17.908769 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:17.884598 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 123569us
I20260709 13:15:17.918874 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.920097 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:17.924729 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:17.925594 30958 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:17.897965 31032 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:17.930022 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.931069 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:17.936829  1006 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:17.937474  1006 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:17.938361  1006 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.896371 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 442) took 1469 ms. Trace:
I20260709 13:15:17.911141 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.912182 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.914989 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:17.916476   763 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:17.860049 30874 raft_consensus.cc:2955] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:17.877585 31604 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:17.943593 31601 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:17.909250 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.962023 31029 raft_consensus.cc:2410] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:15:17.948112 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.915709 31031 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:17.963929  1042 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:17.964212 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.965401 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:17.966112 31026 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:17.966799 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.967324 31026 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:17.967933  1268 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:15:17.969539 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 73664.5us
I20260709 13:15:17.969784  1259 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.970367 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:17.972016  1256 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:17.972728  1256 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:17.972913 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 58000.5us
I20260709 13:15:17.973759 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:17.973645  1256 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:17.975939   784 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:17.976379  1280 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:17.978078   917 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:15:17.981941 30847 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:17.975736 30998 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:17.982620 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 143607us
I20260709 13:15:17.984951 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:17.985947 31600 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:17.987128 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:17.989157 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:17.949657 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:17.941344 31028 rpcz_store.cc:276] 0709 13:15:16.427235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:16.607290 (+180055us) service_pool.cc:224] Handling call
0709 13:15:17.895981 (+1288691us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54002d5354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:17.896182 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43606784}
I20260709 13:15:17.959161 30952 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:17.972041  1043 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.002204 31024 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:15:18.002803 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 59513.5us
I20260709 13:15:17.955725 30956 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:18.003412 31032 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:18.011145 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.012269 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.012852 31032 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:18.013644 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:18.002566 31023 raft_consensus.cc:2410] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:18.014894 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.015829 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:18.016673 31024 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.019821 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.020553 31026 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:18.023471 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.024166 31601 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:18.019829 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:18.033434 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:18.036772 31029 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.037884  1217 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:18.039834  1217 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:17.994391  1043 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:18.029680 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:18.033536 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:18.048224 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64632.7us
I20260709 13:15:18.048663 31030 raft_consensus.cc:2410] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:18.061719 31597 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:18.046464 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.065407 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.019892  1280 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:18.069635 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:18.034510  1208 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.042503  1217 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.034258  1259 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.076898 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:18.078501 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.076124 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.048254   763 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.042964  1129 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:18.101325 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.101482 31601 raft_consensus.cc:2410] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:18.048593  1094 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.043046  1247 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.089114 31604 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:15:18.043226  1043 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.106520 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
W20260709 13:15:18.111465 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 166715us
I20260709 13:15:18.073215  1051 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:18.077349  1054 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:18.071722  1280 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:18.110426 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 128535us
W20260709 13:15:18.120045 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.126889 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:18.043908   917 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:15:18.042673   784 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:15:18.001534   909 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.103205  1170 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.141688 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:18.147605 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55622.8us
I20260709 13:15:18.107263  1097 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:15:18.131090  1051 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:18.128191  1247 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.155740 30876 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.155627 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:18.163460 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 143909us
I20260709 13:15:18.144413  1280 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.148690  1109 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:18.162173 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:18.169143 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:18.148993  1170 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.158813  1051 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:18.199350  1282 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.404s	user 0.004s	sys 0.000s
I20260709 13:15:18.176136  1042 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:18.219555 31032 raft_consensus.cc:2368] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:18.178588 30880 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:18.184034 31605 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:18.187021   856 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:18.189764  1019 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.145179  1094 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.163796  1208 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.196471 30883 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:18.175854 31028 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:18.200824 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:18.128564   763 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.205466  1280 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:18.245697 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44979.5us
I20260709 13:15:18.125646  1273 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:18.220373 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 94008.7us
I20260709 13:15:18.212581  1109 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:18.233491 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.161149  1247 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:18.238190 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 105846us
I20260709 13:15:18.199383  1170 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:18.259941 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 285611us
I20260709 13:15:18.260815  1129 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.261359  1126 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.267318 31023 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:15:18.272377 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 103316us
I20260709 13:15:18.272841 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.273670 31029 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:18.275133 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:18.277496 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.282987 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.283888 30954 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:18.282895   856 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.290772 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.251461  1109 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.293679   856 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:18.294263  1281 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:15:18.296586  1280 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:18.296761  1094 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:18.296609  1279 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:15:18.297394  1051 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.293747 30953 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:18.301765  1097 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:18.302237  1097 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:18.302706 30922 connection.cc:256] RPC call timeout handler was delayed by -1.1337339050000992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:15:18.303392 30922 connection.cc:256] RPC call timeout handler was delayed by -1.058350670000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:15:18.304332  1051 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.304590 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.306099 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:18.303107  1097 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.309096  1208 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.252921  1142 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.307585 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:18.321143 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48391us
I20260709 13:15:18.321417 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:18.322350 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:18.324622 31605 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.320700  1094 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.328315 30950 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:18.328661 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.329865 31604 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:18.330147 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:18.330518   763 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:18.331212 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.333995 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:18.277679  1270 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.223001  1085 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.344907 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:18.345827 30883 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:18.307561  1097 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:18.313344  1042 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.354686 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:18.353863 30847 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:18.323124  1142 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.364387 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:18.335831  1176 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.280157  1129 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.345799  1246 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.346592  1094 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.364567 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:18.358206  1183 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.587s	user 0.003s	sys 0.008s
I20260709 13:15:18.345309   856 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:18.349396  1098 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:18.380952  1256 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.369014   917 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:15:18.381559  1256 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:18.364684  1163 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.382535  1256 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.383255  1163 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:18.380978 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:18.385398 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.352921  1208 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:18.385959 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:18.387691 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 68036.7us
I20260709 13:15:18.380668   856 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:18.366534  1142 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.357030  1042 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:18.398952 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 94502.2us
I20260709 13:15:18.394209 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:18.383693  1163 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.386543  1085 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.391292   881 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:15:18.389668  1256 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.387509  1208 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:18.401574  1036 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.004s
I20260709 13:15:18.391462  1156 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:18.400995  1042 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.431999 30879 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:18.431196 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:18.384198  1176 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.436023 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:18.438112 31604 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.444309 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:15:18.445633 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 156885us
I20260709 13:15:18.414302  1051 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.447970  1087 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.448576  1087 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.450737  1087 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:18.452451  1291 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:18.453454  1159 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:15:18.454350 30776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 358) took 12582 ms (client timeout 15000 ms). Trace:
W20260709 13:15:18.456188  1284 log.cc:927] Time spent T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:15:18.456859  1292 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:18.457484  1292 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.431391  1036 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.461685  1036 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:18.463690  1288 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.172s	user 0.004s	sys 0.000s
I20260709 13:15:18.469305 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:18.469962  1247 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.472930   856 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:18.473361   856 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:18.473737   856 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:18.474464 30779 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.476286 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.479053 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:18.480024 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.480708 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:18.468564 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.483032 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:18.483805 30880 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.484144 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:18.484848  1183 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:18.485241  1183 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:18.423111  1208 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.479117 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.416426   909 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.464771 31031 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:18.465495 31032 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.465878 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:18.489058 31024 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:18.465978 31028 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.489851 30874 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:18.468259 31023 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:18.492380 31604 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:18.493744 30996 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:18.496805 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.499358 31603 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:18.502038 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 57834.8us
I20260709 13:15:18.428503  1156 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.510510 30998 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:18.434197  1280 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.514022 30847 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:18.519879 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:18.520467 31031 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:15:18.521884 31027 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:18.521615 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 103307us
I20260709 13:15:18.459687  1292 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.527441 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:18.504088   917 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:18.536039   917 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:18.536332 31025 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:18.536512   917 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.536662 31032 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:18.538079 31023 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:18.541018  1176 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:18.454717 30776 rpcz_store.cc:269] 0709 13:15:05.872162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:05.900949 (+ 28787us) service_pool.cc:224] Handling call
0709 13:15:06.398712 (+497763us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400260054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc4090 00007f273ac62f3a 00007f2740a191cc 00007f2740b1737e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc 00007f273efd7392 00007f2738f9548c 00007f2738f948c6
0709 13:15:18.454118 (+12055406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:11.215450 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:11.680236 (+464786us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:11.680321 (+    85us) write_op.cc:435] Acquired schema lock
0709 13:15:11.680343 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:11.751803 (+ 71460us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:11.809309 (+ 57506us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:11.819897 (+ 10588us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:15:12.175239 (+355342us) tablet.cc:701] Row locks acquired
0709 13:15:12.175285 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:15:12.179574 (+  4289us) write_op.cc:270] Start()
0709 13:15:12.230318 (+ 50744us) write_op.cc:276] Timestamp: P: 1783602912177901 usec, L: 0
0709 13:15:12.232828 (+  2510us) op_driver.cc:348] REPLICATION: starting
0709 13:15:12.261027 (+ 28199us) log.cc:844] Serialized 6236 byte log entry
0709 13:15:13.702332 (+1441305us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f2737b500ac 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b
0709 13:15:14.854148 (+1151816us) op_driver.cc:464] REPLICATION: finished
0709 13:15:15.930381 (+1076233us) write_op.cc:301] APPLY: starting
0709 13:15:15.938257 (+  7876us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:15.966275 (+ 28018us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:15.970190 (+  3915us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:16.076972 (+106782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:16.077302 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:15:16.077350 (+    48us) write_op.cc:312] APPLY: finished
0709 13:15:16.077742 (+   392us) log.cc:844] Serialized 107 byte log entry
0709 13:15:16.210041 (+132299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:16.231616 (+ 21575us) write_op.cc:454] Released schema lock
0709 13:15:16.239696 (+  8080us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:16.277946 (+ 38250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:16.285308 (+  7362us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106977,"reported_tablets":23,"spinlock_wait_cycles":725267328,"child_traces":[["op",{"apply.queue_time_us":1045060,"apply.run_cpu_time_us":14933,"apply.run_wall_time_us":347596,"num_ops":15,"prepare.queue_time_us":644900,"prepare.run_cpu_time_us":29234,"prepare.run_wall_time_us":2880660,"raft.queue_time_us":259950,"raft.run_cpu_time_us":18790,"raft.run_wall_time_us":262833,"replication_time_us":2602928,"spinlock_wait_cycles":69818752,"thread_start_us":2135337,"threads_started":5,"wal-append.queue_time_us":1852670,"wal-append.run_cpu_time_us":22780,"wal-append.run_wall_time_us":2823957}]]}
I20260709 13:15:18.544010  1290 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:18.544234 31596 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:18.546030  1098 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:18.547559  1290 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:18.548790  1290 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.549669   881 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:18.551165   881 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:18.543483  1285 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:15:18.556753 31023 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:18.558866 31605 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:15:18.524168  1155 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.007s
I20260709 13:15:18.512219  1054 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:18.513438  1156 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:18.559664 30880 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:18.565114 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.577893 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.578280 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:18.528995  1273 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.551723  1159 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:15:18.601984  1268 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:18.610574  1208 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.614485  1163 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.604617  1054 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:18.616919  1054 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.595090  1075 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:18.594084  1292 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:18.601511 30779 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 2, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 2 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.559801   909 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:18.624071   909 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.624614   909 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:18.631009 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.574215  1247 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.622711 30779 catalog_manager.cc:5697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.573064  1036 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
W20260709 13:15:18.702684 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 311868us
I20260709 13:15:18.734139   856 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.705070 30779 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:18.767638 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:18.708930  1043 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.005s
I20260709 13:15:18.632874  1170 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.713763  1163 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.716922  1109 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.717867  1129 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:18.720323  1298 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:18.721357   881 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:18.652730  1268 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:18.728552   909 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:18.644033 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 223879us
I20260709 13:15:18.793648  1129 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.794203  1129 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.795281  1142 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.795815  1270 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.796556  1129 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:18.797636 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.797991 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.798241 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.797506  1142 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.735436 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:18.737637 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.800469 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:18.801324 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 63800.1us
I20260709 13:15:18.801795 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.801980  1109 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:18.785673  1019 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:18.802795  1087 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:18.743274  1094 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:18.803025  1019 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.803608  1094 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:18.804620  1094 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.805799  1094 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.805892  1019 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:18.806370 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:18.806489  1019 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:18.799917 30954 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:18.807052  1019 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:18.760227   917 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.807963   909 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:18.788256   881 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:18.798501 31596 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:18.579231  1155 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:18.809343   917 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.809278   881 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.810356 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:18.808017 31604 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:18.811080 30952 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:18.800673 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 65308.9us
W20260709 13:15:18.811487 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.765241  1208 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:18.816527 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:18.817101 30880 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:18.811923 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.818696 30956 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:18.812526 30779 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 3, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 3 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.815203 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:18.811967 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:18.810712 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:18.778311  1085 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.730911  1246 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:18.823457 31596 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:18.810650  1155 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:18.827328 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:18.785957  1298 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:18.747362  1183 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:18.823982 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 327258us
W20260709 13:15:18.854467 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 344008us
I20260709 13:15:18.835237 30779 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 4, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:18.884248 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.784891  1043 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.786130  1042 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.800395  1268 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.938468 30883 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.941072 31030 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:18.941232 30880 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:18.830446  1085 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:18.941712 30874 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:18.832248  1109 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 13:15:18.943900 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:18.963285 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:18.855443 31600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.017s	sys 0.033s
W20260709 13:15:18.954530 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 130990us
W20260709 13:15:18.961153 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 429708us
W20260709 13:15:18.974099 31600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.018s	sys 0.034s
W20260709 13:15:18.949041  1030 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.013s
I20260709 13:15:18.977196 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:18.978562 30878 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:18.979149 30956 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:18.980528 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.981912 30876 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:18.982529 30879 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:18.977231 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:18.989518 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:18.990640 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:18.950534  1129 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:19.000267 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:19.013664 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 464738us
I20260709 13:15:19.019133 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:19.025859 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:19.029033 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:19.013990  1097 consensus_meta.cc:287] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.641s	user 0.004s	sys 0.008s
I20260709 13:15:18.986898  1154 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.033174 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.040390 30878 raft_consensus.cc:2368] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
W20260709 13:15:19.041782 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45745.6us
I20260709 13:15:18.942219  1019 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.047174 30956 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:19.050240 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:19.031618  1126 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.006s
I20260709 13:15:19.029404  1270 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:19.080855 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.055964  1259 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:19.048811  1246 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:15:19.061077 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:19.065819 30876 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:19.015228  1129 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:19.069499 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:19.054272 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64973.9us
I20260709 13:15:19.085659 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.028308  1043 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:19.088994 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 111909us
I20260709 13:15:19.092125 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.044694   763 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:19.095963 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:19.097607 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.099745 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:19.100535 30878 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:19.099092 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.102159 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.102131 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:19.019189  1300 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:15:19.104759 31571 leader_election.cc:400] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:19.105451 31571 leader_election.cc:403] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:19.104154 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.104452 30883 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:15:19.102975 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:19.088165  1270 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.118777 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:19.113093 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.081924  1208 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:19.113914 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:19.104657 30876 raft_consensus.cc:2368] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:19.117266 30883 pending_rounds.cc:85] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 5
I20260709 13:15:19.087157  1126 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:19.094684   917 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:19.143661 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47789.4us
I20260709 13:15:19.131551 30883 pending_rounds.cc:107] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:15:19.069007  1097 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:15:19.053542  1235 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:15:19.136879 30882 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:19.141510 30876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:15:19.143217 30878 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.144829 30883 raft_consensus.cc:2889] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.159119 30876 raft_consensus.cc:606] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.159497 30876 raft_consensus.cc:614] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:19.147257 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:19.117651   856 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:19.126161  1270 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.103658   763 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:19.068578  1154 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.159723 31597 pending_rounds.cc:85] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 6
I20260709 13:15:19.162364 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:19.155202 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 53199.7us
I20260709 13:15:19.164148 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:19.171141 31597 pending_rounds.cc:107] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:15:19.171895 31597 raft_consensus.cc:2889] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:19.100021  1292 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:19.144055  1155 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:19.178525 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.175606 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:19.176460 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:19.183175 31601 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.179143 31029 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:19.181020 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:19.183971 31604 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.148929  1163 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:19.149634  1087 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:19.190125 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:19.194845 31602 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:19.192277 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 117800us
I20260709 13:15:19.199205 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:19.199992 30956 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.197750 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:19.217360 31604 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:19.219971 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:19.201778  1303 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:15:19.213003 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.218966 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:19.177336  1043 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:15:19.235075 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:19.231490 30956 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
W20260709 13:15:19.246068 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.248338 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:19.202075  1042 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:19.222900  1156 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.004s
I20260709 13:15:19.255997 31596 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:19.210589   856 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.213158  1307 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.213934  1087 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:19.225310  1085 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:19.264226 31599 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:19.290591  1320 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:15:19.168529  1129 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.262758  1314 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:19.269109  1292 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:19.325680 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 869) took 1114 ms. Trace:
I20260709 13:15:19.301532   917 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:19.318218   763 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.333067   917 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.289089  1042 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:15:19.263132  1156 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.301350  1307 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.270056   856 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.287700  1325 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:19.319622  1308 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:19.323520  1314 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:19.329138 31600 rpcz_store.cc:276] 0709 13:15:18.211226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.211433 (+   207us) service_pool.cc:224] Handling call
0709 13:15:18.211795 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.212056 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:18.974993 (+762937us) log.cc:844] Serialized 14 byte log entry
0709 13:15:19.322742 (+347749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:19.323201 (+   459us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:19.323289 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.323385 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.325602 (+  2217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27486,"prepare.queue_time_us":806916,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":45,"raft.queue_time_us":212972,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6263,"thread_start_us":1108674,"threads_started":2}
I20260709 13:15:19.319285  1292 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.361163 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:19.363251 31025 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:15:19.336908  1006 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:19.372725 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:19.658176 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 409931us
W20260709 13:15:19.660269 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 468193us
I20260709 13:15:19.661758 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:19.662575  1030 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:19.661787 30876 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:19.663316 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:19.557556 31602 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:19.368698 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:19.660494 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 425458us
I20260709 13:15:19.664427 31024 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.663228  1311 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:19.664057 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:19.359589  1314 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.408377  1309 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:19.658938 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.662496 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1829) took 1199 ms. Trace:
W20260709 13:15:19.656396 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.410094  1325 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:19.668267 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:19.563664 31601 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:19.360998   856 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:19.362715  1292 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.669497 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.681599 31026 rpcz_store.cc:276] 0709 13:15:18.463425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.466056 (+  2631us) service_pool.cc:224] Handling call
0709 13:15:18.466388 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.466737 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.466763 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.467271 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:15:18.936584 (+469313us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:18.936644 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:18.936750 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:19.324655 (+387905us) raft_consensus.cc:1685] finished
0709 13:15:19.324680 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:19.662405 (+337725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45,"raft.queue_time_us":15225,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":468820,"threads_started":1,"wal-append.queue_time_us":558161}
I20260709 13:15:19.677469 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:19.374400  1094 consensus_meta.cc:287] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.005s
I20260709 13:15:19.358819  1308 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:19.455132  1126 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:19.375900   909 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:19.741065 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 63689.9us
I20260709 13:15:19.683738  1030 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:19.770582 31024 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:19.375505  1109 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:19.371686  1208 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.771726 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:19.791657 30876 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:19.752285 31602 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:19.363853  1156 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:19.779060  1311 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:19.738282 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 80231.9us
I20260709 13:15:19.371091  1154 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:19.358641  1328 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:19.684149  1163 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:19.719477 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 51302.2us
I20260709 13:15:19.359390  1087 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.738651  1159 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.680915  1002 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:19.791124  1208 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:19.686354 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.680754  1309 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:19.829734  1208 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.830440  1309 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.831997  1309 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.782671 30882 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:19.358016  1307 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.838516  1307 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:19.838950  1170 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:19.839109  1307 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:19.773427  1259 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:19.841537  1170 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:19.374897  1298 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.842625  1002 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:19.843019  1002 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:19.843156  1298 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:19.844027 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:19.843941  1002 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.792851  1019 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.795914 30950 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.790946  1109 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:19.848443 31571 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.010s	sys 0.046s
I20260709 13:15:19.785951  1030 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.778086  1308 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.778250  1246 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:15:19.848886 31571 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.010s	sys 0.046s
I20260709 13:15:19.786156   909 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.782574  1126 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.806059  1154 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:19.862465 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 663167us
I20260709 13:15:19.870651 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.871789 31602 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:19.777745  1325 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:19.891922 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:19.854027  1030 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:19.853175  1328 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.898156 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:19.862613  1256 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.856134  1343 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:19.871601  1156 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.902868 31602 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:19.803073  1311 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.853576  1019 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.898914 31571 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.896111  1002 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:19.909188 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:19.896638  1040 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.888574  1331 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:19.869993  1163 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.930539 31571 leader_election.cc:400] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:19.906536  1256 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.860284  1109 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.939628 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:19.928723  1329 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:19.932173  1270 consensus_meta.cc:287] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.003s
W20260709 13:15:19.939982 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 270550us
I20260709 13:15:19.902253  1154 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.932729 30876 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:19.928962  1156 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.939173  1159 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:19.956403 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:19.954212  1339 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:15:19.933358  1040 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:19.985584 31024 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:19.961069  1109 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:19.960129  1159 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:19.928956  1328 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:19.977771  1307 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:19.997274 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 60063.5us
I20260709 13:15:19.946619  1333 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:20.003153 31026 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:19.948346  1270 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.004679 30882 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:20.009219 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:19.937709  1301 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:15:20.009882  1270 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.005354 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:20.000792  1314 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:20.011216  1314 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:20.011986 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49313.5us
I20260709 13:15:20.012251  1314 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.013448   917 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.013917   917 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:20.015959   917 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.016075 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:20.016460   917 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.012739 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:19.982941  1268 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:19.948931  1331 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:15:20.019040 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 332777us
I20260709 13:15:20.020979 30997 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:20.000149  1342 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 13:15:20.034850  1334 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:15:20.035507  1346 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:20.016573  1094 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:20.032517  1126 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:20.032472  1330 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:15:20.064548  1259 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:19.998477  1159 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:20.050454 31570 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.223s (SENT)
I20260709 13:15:20.050232 30882 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:15:20.064816 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 105375us
W20260709 13:15:20.070184 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49319.5us
I20260709 13:15:20.019920   917 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.024215  1301 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:20.018482  1307 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.076960 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:20.078522 30876 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:20.055289   856 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.073040  1338 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:15:20.081266 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:20.056862 30847 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:20.083297 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:20.054198   909 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.023926  1268 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:20.088548 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:20.103969  1357 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.084491  1346 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:20.087405  1126 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.104930  1325 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.104984  1343 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.072278  1356 raft_consensus.cc:2764] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:15:20.116766 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.119385 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:20.124423 30876 raft_consensus.cc:2376] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5. Re-sending same reply.
W20260709 13:15:20.126052  1352 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:15:20.126572  1345 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:15:20.086822  1311 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.131632  1163 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.141234  1256 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.095464   856 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.120925   909 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:15:20.140209  1259 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.135512  1358 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:20.123891  1329 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.092304  1129 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:20.166720 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 78334.1us
I20260709 13:15:20.187500  1129 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.188555 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:20.189322 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:20.092588  1301 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.189911  1094 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.190872  1094 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.168355 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 803) took 1009 ms. Trace:
I20260709 13:15:20.191934  1301 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.191903 31597 rpcz_store.cc:276] 0709 13:15:19.159039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.159245 (+   206us) service_pool.cc:224] Handling call
0709 13:15:19.159549 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:19.172647 (+ 13098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:19.172698 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:19.191865 (+ 19167us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.666118 (+474253us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:19.666395 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.666472 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:20.168096 (+501624us) raft_consensus.cc:1685] finished
0709 13:15:20.168121 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:20.168287 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":463306,"threads_started":1,"wal-append.queue_time_us":573788}
I20260709 13:15:20.192834  1268 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:20.193536  1311 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:20.193918  1349 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:20.194187 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:20.194933 30883 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:20.194818  1348 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:20.169114  1359 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:20.170360 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 113607us
I20260709 13:15:20.197052  1307 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.198542  1217 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:20.174705  1155 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:20.200030  1155 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:20.200186 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:20.201560 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:20.174979 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.202066 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.202703 31024 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.202781 30883 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:20.203866 30883 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.204802  1156 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:20.205470  1358 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:20.179198  1351 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:15:20.128790  1346 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.183827 30950 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:20.185359   917 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.185992 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.220963 30956 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:20.177281 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 161278us
I20260709 13:15:20.201159  1155 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.190042 30953 raft_consensus.cc:2368] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:20.164829 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 795) took 1362 ms. Trace:
W20260709 13:15:20.171330 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 120904us
I20260709 13:15:20.224068 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:20.224323 31603 rpcz_store.cc:276] 0709 13:15:18.802238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.806110 (+  3872us) service_pool.cc:224] Handling call
0709 13:15:20.130107 (+1323997us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400468cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:20.164753 (+ 34646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494570240}
I20260709 13:15:20.210605 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:20.214994 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.221189 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.194082  1311 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:20.223266 30922 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:20.226491 31026 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.229383 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.232434 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.185406   881 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.233887   856 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.192901  1094 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.236400 30956 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:20.230515 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.237528 31027 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:20.189755  1129 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:20.206411  1358 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:20.186481  1159 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.240346 30951 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:20.240707  1354 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.003s
W20260709 13:15:20.241878 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 397892us
I20260709 13:15:20.231601 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:20.218182  1109 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.245607 30922 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:20.206065  1308 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.250790 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:20.250826 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.251628 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.251916 31023 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:20.252094  1328 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.252781  1311 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:20.174551  1292 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.255383 30950 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.255407 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:20.257035 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:20.259624 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:20.259985 31024 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:20.260845 30958 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:20.262050 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.247954  1356 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:20.262912 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.283195 31603 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.263698 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.264797 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:20.284241 30958 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.266469 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:20.266897 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.285346 31025 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:20.267597 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.286127 31031 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:15:20.268237 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.286895 31023 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.268847  1292 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.269237 30874 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:20.253819   917 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:20.276970  1328 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:20.277467 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.278116  1159 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.249315  1290 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.284315 31597 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:20.285650 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:20.294808 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:20.296029 30950 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:20.301301 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:20.266008 30922 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:20.302384 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:20.300750  1259 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:20.322888 31024 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:20.292992   856 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:20.322850  1259 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.324026  1259 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.323833   856 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.324079 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:20.324944 31024 raft_consensus.cc:2376] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4. Re-sending same reply.
I20260709 13:15:20.325838 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.326363 31024 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:20.327126 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.327319   856 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.293889  1356 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:20.327828 31024 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:20.328359  1356 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.293280  1328 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:20.303231 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 134406us
I20260709 13:15:20.259917  1087 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:20.246197  1331 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:20.354830 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:20.355540 31597 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:20.354337 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.252803  1268 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:15:20.359349 31025 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:20.359609 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:20.360384 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 102094us
I20260709 13:15:20.338052 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.248066   763 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:15:20.351528 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:20.362298 31602 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.363379 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.389175 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:20.391091  1368 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:15:20.391819 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.393888  1176 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.332832  1328 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:20.388093  1367 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:20.396207 30953 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.397040 31601 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.396920 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.398556 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.311914  1309 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:20.328959 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:20.475129 31024 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:20.312490  1290 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.396829 31598 raft_consensus.cc:2376] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4. Re-sending same reply.
I20260709 13:15:20.456148 30883 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:20.457186 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:20.400810 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1836) took 1923 ms (client timeout 1949 ms). Trace:
I20260709 13:15:20.464442 30956 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.485208 31596 raft_consensus.cc:2410] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:20.463107 31600 raft_consensus.cc:2376] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
W20260709 13:15:20.480937 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:20.484859 31030 rpcz_store.cc:269] 0709 13:15:18.477607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.483906 (+  6299us) service_pool.cc:224] Handling call
0709 13:15:20.400630 (+1916724us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001f2f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:20.400748 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717139328}
I20260709 13:15:20.288024  1002 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 13:15:20.336112  1087 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.508662 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.509311 30956 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:20.511862 31024 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:20.511335  1087 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:20.402448  1357 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:20.521893  1371 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:20.401985  1259 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:20.357664  1030 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:20.415182  1159 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:20.524214 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.524960 30883 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:20.464141  1176 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:20.334888   917 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:15:20.419617 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:20.668579 31032 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.565442 31023 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:20.676924 31602 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:20.767163 31602 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:20.679940 31031 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:20.763263 30953 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:20.688772 31603 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:20.474931  1309 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:20.604516 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:20.774969 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 328610us
I20260709 13:15:20.776588 31602 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:20.786017 31604 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:15:20.717020  1343 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.001s
I20260709 13:15:20.785969 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.793196 30879 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:15:20.848333 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:20.798784 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.947052 31601 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:20.946256 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:20.789522 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:20.948945 31602 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:20.764909  1159 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:20.588692  1362 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:15:20.806388 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:20.844035  1356 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.007s
I20260709 13:15:20.783034  1309 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.588936  1363 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:20.785157  1357 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:20.984676 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:20.989025 31601 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:20.775988  1154 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:20.842293  1299 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:20.842226  1259 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:20.950429  1343 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:20.953614  1159 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:20.803920  1331 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:21.055549 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.058255 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.991504  1363 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:21.048030 30833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51261.5us
I20260709 13:15:21.075716 30956 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:20.997406  1290 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:21.084648  1374 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:15:21.086341 31028 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:21.090605  1328 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.582s	user 0.001s	sys 0.008s
I20260709 13:15:21.098533 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:20.844584  1176 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.102133 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.105556 30953 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:20.992295  1356 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.091209  1328 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.107403 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.055155  1299 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:21.099668 30956 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:21.110518  1176 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.119925 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:15:21.120554 30875 raft_consensus.cc:606] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.053958  1357 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.120869 30875 raft_consensus.cc:614] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:21.121506 31571 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:21.125299 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.076877  1363 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.111881  1019 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:21.124291 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:21.118815 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1892) took 1971 ms (client timeout 1669 ms). Trace:
W20260709 13:15:21.128669 30958 rpcz_store.cc:269] 0709 13:15:19.147245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.147495 (+   250us) service_pool.cc:224] Handling call
0709 13:15:21.118614 (+1971119us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540024c554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.118741 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2505080192}
I20260709 13:15:21.126114 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.130331 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.133069  1356 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.134338 31604 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:21.137748 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:15:21.138384 30875 raft_consensus.cc:606] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:21.138720 30875 raft_consensus.cc:614] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:21.139752 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:15:21.140569 31599 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:21.127281  1129 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:15:21.142953  1309 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.143962 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.146523 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:21.153056 31027 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:21.134727 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.154249 30958 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:21.148699 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.149942 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.076494  1331 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.159339 30953 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:21.122327  1087 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.000s
I20260709 13:15:21.162534  1347 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:15:21.166368  1357 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.167277  1333 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:21.167724  1333 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.168139  1333 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.156800  1301 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:21.168785  1301 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:21.169502  1347 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:21.169961  1347 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:21.169730  1301 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:21.170784 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.170941  1347 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.172514  1299 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.173303  1259 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:21.173460  1328 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:21.173647 30951 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.181001 30951 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.183182 30951 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:21.162974  1129 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:21.184449 30951 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:21.184937  1019 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:21.185228 30951 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.185913  1019 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:21.178364 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.179319  1299 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.187826 31604 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:21.177973 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.183662  1259 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.190083  1363 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.191452  1259 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.184022  1030 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.192066  1363 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.192623  1319 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:21.193099  1319 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:21.193979  1319 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.195261  1319 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.197508  1309 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:21.192660  1347 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.186194 30951 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.202926 31602 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:21.211999 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.184890  1353 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:21.224303 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:21.225097 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:21.231005 31027 raft_consensus.cc:2410] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:21.232672 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.227962  1043 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:21.258355 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:21.259590 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:21.260334 31027 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:21.261305 31027 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.261168  1159 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.261962 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 467) took 1003 ms. Trace:
I20260709 13:15:21.262286 31027 rpcz_store.cc:276] 0709 13:15:20.258757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.260831 (+1002074us) service_pool.cc:224] Handling call
0709 13:15:21.261133 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.261684 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.261910 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:21.263628  1159 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:21.265311  1322 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.903s	user 0.015s	sys 0.000s
I20260709 13:15:21.266682 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2231) took 2451 ms. Trace:
I20260709 13:15:21.267046 30877 rpcz_store.cc:276] 0709 13:15:18.814979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.815090 (+   111us) service_pool.cc:224] Handling call
0709 13:15:18.825801 (+ 10711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.826155 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.826209 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.891354 (+ 65145us) log.cc:844] Serialized 26 byte log entry
0709 13:15:19.017762 (+126408us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:19.017802 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.017874 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.143431 (+2125557us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:21.266370 (+122939us) raft_consensus.cc:1685] finished
0709 13:15:21.266396 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.266618 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24750,"raft.queue_time_us":90,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11022,"spinlock_wait_cycles":5282048,"thread_start_us":34314,"threads_started":1,"wal-append.queue_time_us":314742}
I20260709 13:15:21.269191 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.228175  1019 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.176307  1087 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.228929  1353 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:21.271077 30881 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:15:21.274085 30958 raft_consensus.cc:2393] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:21.274480 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.263628 31027 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:15:21.288398 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 180595us
W20260709 13:15:21.289808 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.295475 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1854) took 1042 ms. Trace:
I20260709 13:15:21.237658  1040 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:21.282621  1316 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 2.103s	user 0.009s	sys 0.006s
W20260709 13:15:21.296861 30923 connection.cc:256] RPC call timeout handler was delayed by -1.8859001170001193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 13:15:21.307875 31026 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:21.282367  1308 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:21.308756 30923 connection.cc:256] RPC call timeout handler was delayed by -1.8644595170001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:15:21.310863 30923 connection.cc:256] RPC call timeout handler was delayed by -1.4321020039999439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25510000000000005s for a response
W20260709 13:15:21.311365 30923 connection.cc:256] RPC call timeout handler was delayed by -1.3558001170001717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23290000000000002s for a response
W20260709 13:15:21.311805 30923 connection.cc:256] RPC call timeout handler was delayed by -1.342459516999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2721s for a response
I20260709 13:15:21.297576 31025 rpcz_store.cc:276] 0709 13:15:20.253166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.364018 (+110852us) service_pool.cc:224] Handling call
0709 13:15:20.364381 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:20.397993 (+ 33612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:20.398023 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:20.416967 (+ 18944us) log.cc:844] Serialized 52 byte log entry
0709 13:15:20.992825 (+575858us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:21.294551 (+301726us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.295107 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.295183 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.295243 (+    60us) raft_consensus.cc:1685] finished
0709 13:15:21.295261 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.295412 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":116975,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":2913,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":492530,"threads_started":2,"wal-append.queue_time_us":740374}
W20260709 13:15:21.312247 30923 connection.cc:256] RPC call timeout handler was delayed by -1.1111595170000328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2978s for a response
W20260709 13:15:21.313380 30923 connection.cc:256] RPC call timeout handler was delayed by -1.0903834980001648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:15:21.314035 30923 connection.cc:256] RPC call timeout handler was delayed by -1.0481595170001583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3048s for a response
I20260709 13:15:21.324677 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1856) took 1069 ms. Trace:
I20260709 13:15:21.319897 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.325248 31030 rpcz_store.cc:276] 0709 13:15:20.255498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.521141 (+265643us) service_pool.cc:224] Handling call
0709 13:15:20.523121 (+  1980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.523349 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:20.989950 (+466601us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.324166 (+334216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:21.324249 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:21.324316 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.324418 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.324595 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":586184,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"thread_start_us":799475,"threads_started":2}
I20260709 13:15:21.340583 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1888) took 2527 ms. Trace:
I20260709 13:15:21.284547  1019 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.316116  1344 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.343263 30875 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:21.354133 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.363940 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.341132 30954 rpcz_store.cc:276] 0709 13:15:18.812678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.812789 (+   111us) service_pool.cc:224] Handling call
0709 13:15:18.813070 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:18.955724 (+142654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.955792 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:18.978310 (+ 22518us) log.cc:844] Serialized 52 byte log entry
0709 13:15:19.044685 (+ 66375us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:19.322237 (+277552us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4800150258. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
0709 13:15:21.168740 (+1846503us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18004955e0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf
0709 13:15:21.168895 (+   155us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.340227 (+171332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.340315 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.340361 (+    46us) raft_consensus.cc:1685] finished
0709 13:15:21.340377 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.340525 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144547,"prepare.queue_time_us":149642,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7523,"raft.queue_time_us":133531,"raft.run_cpu_time_us":3526,"raft.run_wall_time_us":368710,"spinlock_wait_cycles":91239168,"thread_start_us":500909,"threads_started":3,"wal-append.queue_time_us":197438,"wal-append.run_cpu_time_us":2706,"wal-append.run_wall_time_us":1111091}
I20260709 13:15:21.344931  1159 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:21.380839 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 256595us
I20260709 13:15:21.377334 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1832) took 2908 ms. Trace:
I20260709 13:15:21.378297 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:21.386859 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.388819 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.365507  1247 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:21.385195 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:21.385711 31029 rpcz_store.cc:276] 0709 13:15:18.464398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.500657 (+ 36259us) service_pool.cc:224] Handling call
0709 13:15:18.500951 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:19.183924 (+682973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.372720 (+2188796us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003782d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:21.372945 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559252224}
W20260709 13:15:21.398295 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.379333   784 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.378782  1363 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.420490  1363 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.422204  1208 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.423246  1363 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.409955 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.403664 30998 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.441447  1019 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:21.453500 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49966.7us
I20260709 13:15:21.455695  1383 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:21.456259  1383 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.378058  1308 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:21.456679  1383 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.417490   784 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.376204  1333 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.458990   784 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:21.345043  1353 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.419147 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 794) took 2617 ms. Trace:
I20260709 13:15:21.428540 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:21.430063 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 44915.7us
I20260709 13:15:21.433698  1129 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:21.441375 30874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 628) took 2399 ms (client timeout 1755 ms). Trace:
I20260709 13:15:21.442448 30876 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:21.400238  1331 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:21.376612  1344 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:21.436627  1387 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:15:21.430401  1109 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.464345 30998 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:21.465557 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 55696.3us
I20260709 13:15:21.478215 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1889) took 2664 ms. Trace:
I20260709 13:15:21.492381 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:21.477861 30874 rpcz_store.cc:269] 0709 13:15:19.041773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.041949 (+   176us) service_pool.cc:224] Handling call
0709 13:15:21.441073 (+2399124us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003e26d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.441241 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721046784}
I20260709 13:15:21.477058 30877 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:21.489739 30957 rpcz_store.cc:276] 0709 13:15:18.813516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.813631 (+   115us) service_pool.cc:224] Handling call
0709 13:15:18.816003 (+  2372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:18.937978 (+121975us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:19.138263 (+200285us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.359744 (+2221481us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b18003b37a0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:15:21.477686 (+117942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:21.477740 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:21.477802 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.478017 (+   215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.478152 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12977,"prepare.queue_time_us":189876,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":131,"spinlock_wait_cycles":18009856,"thread_start_us":274438,"threads_started":2}
I20260709 13:15:21.479044 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:21.500228 30951 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:21.500826 30951 pending_rounds.cc:85] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 5
I20260709 13:15:21.501117 30951 pending_rounds.cc:107] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:21.501425 30951 raft_consensus.cc:2889] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:21.503463  1159 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.477919  1356 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:21.507758  1356 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.505013 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.505568  1363 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:21.509153 30874 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.510895 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1516) took 1031 ms. Trace:
I20260709 13:15:21.511438 30949 rpcz_store.cc:276] 0709 13:15:20.479758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.166521 (+686763us) service_pool.cc:224] Handling call
0709 13:15:21.166905 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.167229 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.167257 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.167723 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:21.380014 (+212291us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:21.484868 (+104854us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.485200 (+   332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.485317 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.510634 (+ 25317us) raft_consensus.cc:1685] finished
0709 13:15:21.510661 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.510821 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2027,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":2304,"thread_start_us":291151,"threads_started":2,"wal-append.queue_time_us":334781}
I20260709 13:15:21.509174  1363 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.514815  1363 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.515695  1087 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.466472  1307 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:21.516719  1307 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.524075 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1509) took 1166 ms. Trace:
I20260709 13:15:21.524513 30953 rpcz_store.cc:276] 0709 13:15:20.357461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.160566 (+803105us) service_pool.cc:224] Handling call
0709 13:15:21.160933 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.161366 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.161406 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.251940 (+ 90534us) log.cc:844] Serialized 26 byte log entry
0709 13:15:21.428605 (+176665us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:21.428649 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.428725 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.523860 (+ 95135us) raft_consensus.cc:1685] finished
0709 13:15:21.523879 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.524016 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":14839,"thread_start_us":164466,"threads_started":1,"wal-append.queue_time_us":216264}
W20260709 13:15:21.531615 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 52654.6us
I20260709 13:15:21.519519  1307 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.477377 31605 rpcz_store.cc:276] 0709 13:15:18.801962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.802369 (+   407us) service_pool.cc:224] Handling call
0709 13:15:18.802676 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:18.803042 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.803070 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:18.803706 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:15:19.027696 (+223990us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:19.028012 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:19.030236 (+  2224us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.195487 (+2165251us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:21.404340 (+208853us) raft_consensus.cc:1685] finished
0709 13:15:21.404361 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.419051 (+ 14690us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7559,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":12803840,"thread_start_us":222949,"threads_started":1,"wal-append.queue_time_us":300673}
I20260709 13:15:21.536855 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.537938  1087 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.541981 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.487424  1308 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:21.548782 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.550621 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.559376 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.560873 30877 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.563346 30877 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:21.531152  1129 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:21.566221 30877 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:21.538709  1353 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.539273  1333 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:21.549366  1319 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:21.572913  1129 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.582690 30883 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:21.568349  1299 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.595634  1326 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:21.596177  1326 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:21.595997  1363 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.597133  1326 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.598140  1326 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.598641  1363 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:21.574169  1319 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:21.612649  1319 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:21.616983 31604 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:21.558637  1087 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.633011  1006 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:21.633543  1006 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:21.633704  1183 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.643990 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 462) took 1394 ms. Trace:
I20260709 13:15:21.644443 31023 rpcz_store.cc:276] 0709 13:15:20.249826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.331192 (+ 81366us) service_pool.cc:224] Handling call
0709 13:15:20.357987 (+ 26795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.756098 (+398111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.643690 (+887592us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000c44d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:21.643918 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463479680}
W20260709 13:15:21.645352 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 108593us
I20260709 13:15:21.646780 30923 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.650571  1159 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:21.652729  1299 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:21.654093  1344 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:21.656246 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.656880  1087 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:21.656880 30882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1670) took 1650 ms (client timeout 1580 ms). Trace:
W20260709 13:15:21.658193 30882 rpcz_store.cc:269] 0709 13:15:20.006640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.008966 (+  2326us) service_pool.cc:224] Handling call
0709 13:15:21.656701 (+1647735us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54002ab554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.656807 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65233664}
I20260709 13:15:21.656141 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2402) took 1407 ms. Trace:
I20260709 13:15:21.659191 31032 rpcz_store.cc:276] 0709 13:15:20.248642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.248750 (+   108us) service_pool.cc:224] Handling call
0709 13:15:20.252479 (+  3729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:20.774583 (+522104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.655906 (+881323us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54001f2054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:21.656077 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956009728}
I20260709 13:15:21.660583 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.660799 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.661671 30996 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.662432 30996 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.664048 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:21.666869 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 468) took 1407 ms (client timeout 1867 ms). Trace:
I20260709 13:15:21.667538 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.671420 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1520) took 1190 ms. Trace:
W20260709 13:15:21.667342 31031 rpcz_store.cc:269] 0709 13:15:20.259025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.294539 (+ 35514us) service_pool.cc:224] Handling call
0709 13:15:21.666697 (+1372158us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540007b054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.666817 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520575744}
I20260709 13:15:21.671811 30955 rpcz_store.cc:276] 0709 13:15:20.480867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.166548 (+685681us) service_pool.cc:224] Handling call
0709 13:15:21.166946 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:21.167303 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.167335 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:21.171943 (+  4608us) log.cc:844] Serialized 52 byte log entry
0709 13:15:21.367156 (+195213us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:21.548299 (+181143us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.548734 (+   435us) log.cc:844] Serialized 14 byte log entry
0709 13:15:21.671109 (+122375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.671183 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.671227 (+    44us) raft_consensus.cc:1685] finished
0709 13:15:21.671239 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.671363 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4053,"prepare.queue_time_us":227082,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2714,"raft.queue_time_us":24078,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":8470,"spinlock_wait_cycles":410240,"thread_start_us":476262,"threads_started":3,"wal-append.queue_time_us":261340}
I20260709 13:15:21.680522  1383 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.676111  1344 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:21.682989  1383 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:21.683961  1299 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.684494  1299 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.686811  1344 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:21.687320  1408 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.669727  1363 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:21.687897  1344 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.688165  1363 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:21.688871  1363 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.688086  1408 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.694028 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:21.698917 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:21.703344 31601 raft_consensus.cc:2393] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:21.676317  1087 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:21.723474 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.728972 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:21.731957 30883 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.732014 31596 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.738464 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.742704 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:21.743046  1333 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:21.746946  1333 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.748401  1408 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.756561 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:21.728605  1270 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:21.687350  1319 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.756058 31596 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.757917 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:21.758564 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 111174us
I20260709 13:15:21.760233 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.740384  1087 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:21.750464  1340 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.762802 31599 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.765740 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.769326 31598 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:21.769922 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.772868 30883 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.774575 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.775799 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.776814 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.778954  1344 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.788558  1344 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.787380  1307 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:21.789175  1344 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.787649  1346 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.780488  1383 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:15:21.791903  1346 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:21.792276  1346 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:21.793103  1346 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.794008  1346 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.795954   784 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.796412   784 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.796756   784 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.803804  1344 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:21.778228  1208 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:21.811125 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:21.813618 30878 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:21.813490 31604 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:21.812901 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:21.816082  1155 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.816470 31598 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.816565  1155 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.817087  1344 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:21.817410  1365 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.312s	user 0.000s	sys 0.005s
I20260709 13:15:21.818039  1087 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.820899  1319 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:21.821105  1401 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 13:15:21.822057 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 571) took 1644 ms. Trace:
I20260709 13:15:21.822422 30950 rpcz_store.cc:276] 0709 13:15:20.177772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.223801 (+ 46029us) service_pool.cc:224] Handling call
0709 13:15:21.821901 (+1598100us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54001950d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.821999 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70551424}
I20260709 13:15:21.826363  1356 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:21.774611  1340 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.826524  1363 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.763283  1270 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.828872  1340 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.829749  1270 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:21.830051 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.015s	user 0.023s	sys 0.066s
W20260709 13:15:21.830369 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.023s	sys 0.066s
W20260709 13:15:21.830874 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.831303 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:21.831444 31026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 464) took 1581 ms (client timeout 1602 ms). Trace:
W20260709 13:15:21.831833 31026 rpcz_store.cc:269] 0709 13:15:20.250419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.263383 (+ 12964us) service_pool.cc:224] Handling call
0709 13:15:21.831261 (+1567878us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540009e2d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.831394 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2351327488}
I20260709 13:15:21.836089 31024 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:21.837263 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1857) took 1580 ms. Trace:
W20260709 13:15:21.837401 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.837590 31024 rpcz_store.cc:276] 0709 13:15:20.256801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.558665 (+301864us) service_pool.cc:224] Handling call
0709 13:15:21.835855 (+1277190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.836510 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.837076 (+   566us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540009e2d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.837198 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2867886336}
I20260709 13:15:21.815275  1006 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.840839  1006 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:21.841439  1208 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:21.842092  1208 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.843394 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:21.844215  1344 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:21.844576 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.845366  1357 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.846051  1357 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:21.846553  1357 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:21.847453  1357 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.852589 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1518) took 1372 ms. Trace:
I20260709 13:15:21.852468  1208 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.853235 30958 rpcz_store.cc:276] 0709 13:15:20.480319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.156005 (+675686us) service_pool.cc:224] Handling call
0709 13:15:21.852370 (+696365us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b5400254c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.852522 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140271360}
I20260709 13:15:21.855108 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1672) took 1772 ms. Trace:
I20260709 13:15:21.869484 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 565) took 2909 ms. Trace:
I20260709 13:15:21.873626 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.862578 31600 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:21.879271 30952 rpcz_store.cc:276] 0709 13:15:18.960505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.960614 (+   109us) service_pool.cc:224] Handling call
0709 13:15:18.960946 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:18.972201 (+ 11255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:18.972232 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:18.979894 (+  7662us) log.cc:844] Serialized 26 byte log entry
0709 13:15:21.117312 (+2137418us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18002599c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:21.363202 (+245890us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:21.363256 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.365890 (+  2634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.868710 (+502820us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b240010e1b8. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f27379f39c4 00007f27379f1acb 00007f2737bacdc9 00007f2737baca55 00007f2737babfb0 00007f273a822488 00007f273a822be8 00007f273a7fa398 00007f273a7f576a 00007f273a7f4bb6
0709 13:15:21.869272 (+   562us) raft_consensus.cc:1685] finished
0709 13:15:21.869290 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:21.869425 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20068,"raft.queue_time_us":11237,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":9759744,"thread_start_us":245677,"threads_started":1,"wal-append.queue_time_us":2568599}
I20260709 13:15:21.863548 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 637) took 2800 ms. Trace:
I20260709 13:15:21.881649 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:21.846060 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:21.882504 30881 rpcz_store.cc:276] 0709 13:15:19.062772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.129106 (+ 66334us) service_pool.cc:224] Handling call
0709 13:15:21.270833 (+2141727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.294441 (+ 23608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.863351 (+568910us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54000d34d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.863492 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4853647104}
I20260709 13:15:21.855490 30876 rpcz_store.cc:276] 0709 13:15:20.082533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.126615 (+ 44082us) service_pool.cc:224] Handling call
0709 13:15:21.441978 (+1315363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.476497 (+ 34519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.854892 (+378395us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003e26d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:21.855021 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3024212736}
I20260709 13:15:21.890859 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.902272 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.891606 30875 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:21.914572 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:21.916210 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.927719 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.929057 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.930009 30950 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:21.929077 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.934827 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.934940 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.935664 30875 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:21.925921 30881 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:21.937978 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.939183 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:21.939073 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:21.941084 31570 leader_election.cc:400] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:21.941191 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.941506 31570 leader_election.cc:403] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:15:21.943300 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.943886 30955 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:21.950413 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.855648  1208 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.905190  1340 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:21.841401  1363 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.952134 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:21.955235 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 167179us
I20260709 13:15:21.829690   784 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.957135 30949 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:21.957814 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.934511  1347 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.940518  1043 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.956215 30998 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:21.958575 30956 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:21.942817  1006 raft_consensus.cc:2764] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:21.963557 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.952276  1129 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:21.965345 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.962572 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.952589  1408 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:21.961454 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:21.962963 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.969712 30956 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:21.970602 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.970722 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.943038  1319 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:15:21.950555  1326 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.961578  1344 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.962962 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:21.976624 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:21.967758 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.968366 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.968752 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:21.978879 31024 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:21.971314 31027 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:21.971424 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.979929 31032 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:21.965595  1129 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:21.982041 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:21.964849 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:21.975085 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 129103us
I20260709 13:15:21.974807 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.967201 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:21.983747 31026 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:21.983952 31031 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:21.974781 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93234.2us
I20260709 13:15:21.970813  1353 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:21.952425  1407 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.965776  1208 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:21.971800 31029 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:21.966035  1340 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:22.015148  1340 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.015666 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.016234 30954 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.017334  1340 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.020710 31025 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:22.021060 30953 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:21.984984 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:21.978947 30949 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:21.985491 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.022629 30950 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:21.986050 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.023491 31023 raft_consensus.cc:2376] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7. Re-sending same reply.
I20260709 13:15:22.024658 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:21.987885  1416 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:22.028891  1299 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:21.982005  1344 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.032326  1344 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:21.992872 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.035728 31027 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:22.036621 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.037302 31027 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:22.038000 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:21.993495 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.039755 30957 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:21.995680  1319 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:22.040700 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 648) took 1843 ms. Trace:
I20260709 13:15:21.996157   784 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:22.052232 30878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 642) took 2855 ms (client timeout 2242 ms). Trace:
W20260709 13:15:22.052656 30878 rpcz_store.cc:269] 0709 13:15:19.196829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:19.197418 (+   589us) service_pool.cc:224] Handling call
0709 13:15:22.052064 (+2854646us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b54000d39d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:22.052163 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5946705792}
I20260709 13:15:22.053663 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:21.983916  1129 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.060252 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.063548  1259 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.064191  1259 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.064586  1259 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.996466 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:21.965294  1043 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:21.997213 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.067488 30956 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:21.973420  1383 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:21.997774 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:21.998148  1389 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:21.981042  1006 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:15:22.000038 30875 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:22.000633 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.071178 31032 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:22.077301   784 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.077853   784 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:22.079996 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.081511 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.082242  1154 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:22.082571 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:22.083133 30875 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.071202  1383 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:22.009299 30996 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:22.084270 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75036.8us
I20260709 13:15:22.084769 31032 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:21.964098  1347 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.070721 30954 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:22.014182  1270 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:21.983172 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.041232 30879 rpcz_store.cc:276] 0709 13:15:20.197648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.208539 (+ 10891us) service_pool.cc:224] Handling call
0709 13:15:20.228563 (+ 20024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:20.950776 (+722213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.040373 (+1089597us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540001f4d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:22.040624 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297818368}
I20260709 13:15:22.086862 30876 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:15:22.042330 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 57412.6us
I20260709 13:15:22.087339 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:22.088694 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:22.089087 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:22.013489  1208 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.086769 31024 raft_consensus.cc:2376] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7. Re-sending same reply.
W20260709 13:15:22.047151 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.048808 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.049737  1353 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:22.049948 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.055572 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.104712 31023 raft_consensus.cc:2376] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6. Re-sending same reply.
I20260709 13:15:22.067711 30949 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:22.068686 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 72286.9us
I20260709 13:15:22.110955 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:22.111583 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.113246 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.114205 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:22.114699 30883 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.084398  1383 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.011555 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.119203 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.085752 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:22.090790 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:22.043290 30877 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:22.095252 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:22.120728 31604 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.120079 31602 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:22.095350 30875 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:22.096400 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:22.038938 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:22.100559 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.116060 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:22.116050 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.124473 31024 raft_consensus.cc:2368] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
I20260709 13:15:22.116230 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.125162 30951 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.125352 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.125917 31024 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:22.126533 31601 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:22.128818 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.129626 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.130393 30875 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:22.131137 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.117057 31032 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:15:22.117255 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:22.114205 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.132681 31023 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.120055 30879 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:22.132254 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:22.134181 30875 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.134238 30951 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:22.135952 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.136492 31029 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.138269 30951 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:22.075142  1043 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.140187 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.140447 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.147225 30957 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.140211 30958 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:22.086288  1154 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.071573  1389 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:22.150840 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.111944  1319 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:22.135322  1094 raft_consensus.cc:2764] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:22.144834 30953 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:15:22.165889 30883 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:22.150579 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.155978 30956 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:22.168340 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.116189   784 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:22.171846 31029 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.112022  1040 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:15:22.165350 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.128046  1006 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:22.115299  1353 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.170730 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.146451  1309 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.188248 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.188836 31031 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.171026 30998 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.165244 31604 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:22.178031 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.190685 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:22.141666 30951 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:22.151248  1154 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.181401 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.120995  1344 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:15:22.182752 31023 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.185075 31027 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:22.185729  1040 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:22.198289 31024 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:22.211814 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.213485 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.214752 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.216034 31031 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:22.176353  1347 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:22.166644  1247 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:15:22.208043  1183 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.219868  1040 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:22.229470  1299 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.230144 30875 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:22.219677  1043 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:22.251524  1043 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:22.252040  1043 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.252547  1407 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.253361 30954 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.242015 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 460) took 1992 ms. Trace:
I20260709 13:15:22.255924  1347 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:15:22.256343 31028 rpcz_store.cc:276] 0709 13:15:20.249317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.249416 (+    99us) service_pool.cc:224] Handling call
0709 13:15:20.257284 (+  7868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:21.086816 (+829532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.241798 (+1154982us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54002d4954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:22.241960 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906047232}
I20260709 13:15:22.248122  1040 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.209137  1423 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:22.238462  1344 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.209900  1006 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:15:22.249420  1299 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.289379 31031 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:22.292331 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.250509  1208 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:22.250707  1087 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.194478  1309 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.194857  1154 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.237864  1183 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.271279  1040 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.271641 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 646) took 2215 ms. Trace:
W20260709 13:15:22.312357 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.312222 30880 rpcz_store.cc:276] 0709 13:15:20.056486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:20.095040 (+ 38554us) service_pool.cc:224] Handling call
0709 13:15:21.656994 (+1561954us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.657354 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.657381 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.662190 (+  4809us) log.cc:844] Serialized 26 byte log entry
0709 13:15:21.754328 (+ 92138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:21.754366 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:21.754434 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:21.779212 (+ 24778us) raft_consensus.cc:1685] finished
0709 13:15:21.779229 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:22.246070 (+466841us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54002ab550. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:22.271556 (+ 25486us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":332,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":116,"spinlock_wait_cycles":3583376128,"thread_start_us":91774,"threads_started":1,"wal-append.queue_time_us":106101}
I20260709 13:15:22.272449 31028 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:22.273485 31026 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:22.276042 31023 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:15:22.315238 31023 pending_rounds.cc:85] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 3
I20260709 13:15:22.276409  1423 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.315611 31023 pending_rounds.cc:107] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:15:22.316046 31023 raft_consensus.cc:2889] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:22.283936 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 150219us
I20260709 13:15:22.317569 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:22.222303  1346 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:22.258893 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:22.320362 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 61569.4us
I20260709 13:15:22.232020  1389 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.304104 30954 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.305142 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:22.305120 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 85168.3us
I20260709 13:15:22.324741 31031 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:22.328361 30848 leader_election.cc:400] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
I20260709 13:15:22.328688 30848 leader_election.cc:403] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:22.328871 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:22.293174  1344 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:22.343902  1019 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:22.344468  1019 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:22.345351  1043 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.357050  1309 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.358178  1309 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:22.326957  1126 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.358994  1309 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
I20260709 13:15:22.315207  1183 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.300486  1087 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.368649  1155 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.369285  1155 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:22.369617  1155 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:22.370388  1155 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.371578  1155 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.375229 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.368642  1087 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.323359  1423 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.363555 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.380503 31031 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:22.381024  1333 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:22.384548  1159 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:22.339239 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:22.386955 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47786.6us
I20260709 13:15:22.388103 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.345669  1129 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.389807 30957 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.392066 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:22.401165  1129 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:22.407049  1417 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:22.408550  1417 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:22.408706  1340 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:22.360273  1299 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:22.393502   784 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.414216  1043 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.414232  1344 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.409248  1340 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.443902 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.446285 30957 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:22.454319 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 126073us
I20260709 13:15:22.423521  1319 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:22.345379  1019 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.447878  1340 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:22.408667  1353 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.470532 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:22.448252  1126 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:22.472436 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.454427  1356 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.471185 31031 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:22.473613 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:22.460796  1301 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:22.477345 30958 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.480598 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.481163 30958 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:22.478266 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.483807  1040 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:22.488154  1431 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:15:22.489861  1353 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.490262  1319 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.494546 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:22.494920 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.463083  1382 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:15:22.504693 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.506052 30958 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.506232 31031 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.524857  1183 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.527137  1183 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.528055 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.528710 31023 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.535436 31023 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:22.500933  1326 consensus_meta.cc:287] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.004s
I20260709 13:15:22.474575  1417 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.492115  1356 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.538393  1356 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.491843  1433 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:22.538681  1340 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.539314  1433 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:22.536154  1326 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
W20260709 13:15:22.541465 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 46997.3us
W20260709 13:15:22.573135 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 178399us
I20260709 13:15:22.635035 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:15:22.636226 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.638325  1301 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:22.638886  1301 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:22.575357 31031 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.632398 30955 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:22.528090  1382 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:15:22.572746 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 180723us
I20260709 13:15:22.627516 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:22.546725  1129 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:22.650887  1386 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:15:22.540131  1259 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.652896  1382 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:22.629648  1087 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.662772  1340 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.663856  1438 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.669308 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.672426 31604 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:22.673079 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:22.676863 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.540194  1433 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:22.678407 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.690137 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:22.693275 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:22.645462  1126 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.679328  1423 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.695930 30922 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:22.684391  1440 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:22.684240  1301 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.685068 31571 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:22.693611 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.702390 30878 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:22.655622  1154 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:22.704041 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.704435 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.706264 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:22.685623  1448 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:15:22.710883 30879 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.710893 30922 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:22.711694 30877 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:22.705965 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.689170  1019 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:22.698709   917 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.727474 30922 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.699729  1356 raft_consensus.cc:2764] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:22.729058 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.707168  1159 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.707298  1389 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:22.741860 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.731959  1019 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.694871  1438 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.722191  1382 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.712077  1439 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.749694  1259 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:22.752125  1301 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:22.752319  1344 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:22.753232 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:22.785732 30922 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.787281 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.753746  1363 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:22.757570  1423 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:22.759321  1427 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:22.718472  1326 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:15:22.761204  1154 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.722150  1299 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.734256  1040 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:22.723203  1445 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.844563 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.732920  1094 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:22.705132  1440 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.763797  1389 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:22.730203  1432 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:15:22.824659 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 102554us
I20260709 13:15:22.823582  1159 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:22.828853 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:22.836503 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 94772.2us
I20260709 13:15:22.784200  1344 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:22.753454  1407 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:22.809321  1382 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:22.848578 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:22.851049 30879 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:22.824553  1356 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:22.851837  1040 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.865778 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:22.865784 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:22.877179 30879 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:22.783331  1043 consensus_queue.cc:1175] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74f5a5b7556240508983221981af4ab4" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 8 index: 8 } }
W20260709 13:15:22.868306 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 148251us
I20260709 13:15:22.844753  1427 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:22.854633  1389 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:22.889604 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:22.897320 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 168316us
W20260709 13:15:22.898633 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 111429us
I20260709 13:15:22.899926 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.876843  1159 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:22.913017 31596 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:22.873134  1364 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:22.917773 31596 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:22.918354 30997 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:22.920071 30879 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:22.904788  1319 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:22.886978  1407 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:22.885442  1040 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:22.888370  1129 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:22.938875  1129 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:22.860721  1301 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:15:22.939828 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:22.940550 31596 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:22.939852  1129 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.931476 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:22.933316 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:22.944631 31603 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:22.953716  1438 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:22.954335  1438 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:22.954236  1427 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.954888  1438 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.901301  1299 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.966132 31601 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 13:15:22.966531 31601 pending_rounds.cc:85] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:15:22.966756 31601 pending_rounds.cc:107] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:15:22.967005 31601 raft_consensus.cc:2889] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:22.967736 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51787.4us
W20260709 13:15:22.968078 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49814.3us
I20260709 13:15:22.963107 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.968789 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:22.961843 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:22.969905 30879 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:22.971925 30882 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:22.972337 30882 pending_rounds.cc:85] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 7
I20260709 13:15:22.972575 30882 pending_rounds.cc:107] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:22.972815 30882 raft_consensus.cc:2889] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:22.968817 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.914922  1087 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:22.976258 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:22.929255  1326 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.981345 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:22.945917  1445 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:22.989065 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 77684.3us
I20260709 13:15:22.959242  1208 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.935274  1407 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:22.935066  1319 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:22.915575  1126 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:15:22.993312 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:22.993430 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:22.995059 30952 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:23.000546  1087 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:23.000365  1407 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.001485  1208 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:23.002417  1454 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:15:23.003302  1307 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:23.004652 31057 heartbeater.cc:646] Failed to heartbeat to 127.29.5.190:37151 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.5.190:37151 timed out after 15.000s (SENT)
W20260709 13:15:23.037624 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68909.9us
I20260709 13:15:22.990617  1326 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.056409 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:22.988302  1159 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.009050  1438 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:23.078748 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:22.974349  1433 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.998385 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:23.012348 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 152645us
I20260709 13:15:23.061486 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.040182 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:23.086921 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46859.7us
I20260709 13:15:23.088388 30953 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:23.088475 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:23.088904 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:23.008038  1019 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:22.990207  1155 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:23.067389 30950 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:23.011490  1463 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.009833  1319 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:22.990418  1357 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:23.102815 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:23.104103 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:23.104300  1357 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:22.979280  1299 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:22.998027  1462 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:23.095397 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 97177.2us
I20260709 13:15:23.107546 30951 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.111277  1299 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:23.112929  1299 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:23.119908 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 185414us
I20260709 13:15:23.121181 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:22.947382  1344 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:23.125375 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.032186   917 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:23.090298  1417 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:23.100610  1407 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.128746 30951 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:23.067210  1087 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:23.096159  1438 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:23.116983  1299 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.090804  1159 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:23.132962  1259 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.123581  1019 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:23.087105  1469 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:15:23.132751  1462 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:23.134217 30957 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:23.133705 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:23.100682 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 119411us
I20260709 13:15:23.162513 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:23.160122  1299 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.165393  1019 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:23.177155  1019 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.177413  1159 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:23.178207  1299 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:23.163652  1427 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:23.179168  1427 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.181602  1427 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:23.148182  1183 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:15:23.184139  1440 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:23.184919  1440 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:23.185681  1440 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:23.186335  1440 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:23.186702  1440 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:23.187069  1440 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.187106  1087 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.187963  1439 raft_consensus.cc:2764] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:23.189577 30956 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:23.149466  1319 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.207985 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:23.248576 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 114951us
W20260709 13:15:23.269366 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 190688us
W20260709 13:15:23.271585 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 70057.8us
I20260709 13:15:23.272126 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:23.272302  1183 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:23.272675 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:23.272920  1183 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.273283  1439 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:23.264750 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 158681us
I20260709 13:15:23.274171  1259 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:23.273298 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:23.100580  1433 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.150837  1438 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:23.275894 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:23.285730 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 118618us
I20260709 13:15:23.289965 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:23.156678  1482 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:23.291087  1259 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:23.302141 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:23.294541 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:23.154735  1356 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:15:23.260691  1344 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.304194 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:23.320120 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.372926 31603 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:23.335520 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.260593  1478 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:23.278347  1299 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:23.190701  1461 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
W20260709 13:15:23.299880  1465 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:15:23.298302  1183 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:23.389344  1468 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:15:23.390741  1473 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:15:23.397655  1460 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.396s	user 0.002s	sys 0.000s
I20260709 13:15:23.291251  1484 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:15:23.277340  1427 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:15:23.401643  1462 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.327749  1469 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:23.404402  1469 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:23.405933  1469 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:23.420410  1356 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:23.422570  1208 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:23.291544   917 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:23.303973  1470 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:23.427801  1470 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:23.270110  1040 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.440840 31023 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:23.441664 31024 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:23.443511 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:23.449736 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:23.450441 31023 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.377131  1478 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.451673 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:23.452622 31031 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:15:23.382592  1299 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:23.462256 31568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.008s	sys 0.002s
I20260709 13:15:23.406997  1469 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:15:23.300504  1438 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.450191  1476 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:23.462960 31568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.002s
I20260709 13:15:23.457288  1478 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.436975  1482 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:15:23.526758 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:23.565963 30950 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.540015 30957 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:15:23.568011 30957 pending_rounds.cc:85] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 4
I20260709 13:15:23.568257 30957 pending_rounds.cc:107] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:15:23.568497 30957 raft_consensus.cc:2889] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:23.519151 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 243489us
I20260709 13:15:23.571175 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:23.572044 30958 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.460439  1299 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:23.466426 31023 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:23.541280 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:23.558741 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 208734us
W20260709 13:15:23.519953 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 428884us
W20260709 13:15:23.558737 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 184981us
I20260709 13:15:23.595645 30956 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
W20260709 13:15:23.558096 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 284295us
I20260709 13:15:23.596164 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:23.597258 30923 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:23.597803 30958 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:23.598666 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:23.604337 31024 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:15:23.606824 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.046s	sys 0.051s
W20260709 13:15:23.607219 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.046s	sys 0.051s
I20260709 13:15:23.607719 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.609949 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:23.610354 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.519918  1488 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:23.614928 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:23.615166 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.616709 30957 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:23.565105  1427 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:23.582870  1438 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.620325 31031 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:23.540489  1469 consensus_queue.cc:1243] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:23.622049 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:23.628634 30955 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:15:23.617789 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 76630.5us
I20260709 13:15:23.619277  1445 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:23.637300 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.721379 30949 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:23.599748  1461 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.646113 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.653468 30953 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.655551 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:23.655716 30950 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:23.650353  1308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.019s	sys 0.013s
I20260709 13:15:23.608559  1331 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:23.627447  1488 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:23.630167  1364 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:23.636933  1493 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:23.782428  1423 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:23.832202  1423 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:23.747014  1308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.019s	sys 0.013s
I20260709 13:15:23.788664  1270 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:23.792049 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:23.828796 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:23.782497 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:23.840085 30955 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:23.794947  1470 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:23.841122  1470 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:23.841329  1407 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.000s
I20260709 13:15:23.841533  1470 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.843536  1407 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:23.839116  1270 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:23.844178  1407 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:23.846626  1489 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:23.847680  1407 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:23.848193  1488 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:23.849421  1488 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:23.850257 30955 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:23.799999  1498 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.851197  1498 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.853258  1498 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:23.854812  1319 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.000s
W20260709 13:15:23.856489  1479 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
W20260709 13:15:23.790966  1472 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
W20260709 13:15:23.789781  1483 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
W20260709 13:15:23.804303  1492 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:15:23.872467 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:23.934826 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:23.935547  1496 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.614432  1259 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.936182  1496 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.881466 30952 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:23.938378  1496 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:23.939991 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:23.940598 31603 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:23.941654 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:23.882354 30951 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:23.837845  1493 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.942242 31596 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:23.943081 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:23.944442 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:23.607002  1471 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.204s
I20260709 13:15:23.782851  1501 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:23.844312  1474 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:15:23.904570 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:23.961953 30949 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:23.747685  1469 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:15:23.931233  1481 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:23.932264 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:23.972545 30951 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:15:23.974726 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:23.719594  1427 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.779673  1331 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.968500 30876 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:23.981221 31601 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:23.833822  1364 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:23.983512  1440 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
I20260709 13:15:24.023972 31598 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:15:24.024454 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 454042us
W20260709 13:15:23.984453  1497 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:15:23.990734  1299 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:23.867105  1433 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:23.997983 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:23.751865  1461 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.013068 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1691) took 1931 ms. Trace:
I20260709 13:15:23.790621  1499 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 13:15:24.017069 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:24.046003 30878 rpcz_store.cc:276] 0709 13:15:22.081684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.083839 (+  2155us) service_pool.cc:224] Handling call
0709 13:15:22.084156 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.702880 (+618724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.012714 (+1309834us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54000f9954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:24.012990 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421066496}
W20260709 13:15:23.966506  1344 consensus_meta.cc:287] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.586s	user 0.014s	sys 0.002s
W20260709 13:15:24.018204 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 419891us
I20260709 13:15:24.012220 30953 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:23.809947  1478 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.059213 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:24.059950 31596 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:24.018612  1094 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.997865  1040 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:23.970692  1501 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.056618 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2255) took 1226 ms. Trace:
I20260709 13:15:24.030169  1340 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.025298 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:24.031349  1043 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.065146 30956 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:24.023310  1098 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.067623 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:24.038882 31028 raft_consensus.cc:2410] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:15:24.077991 31596 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:24.047819  1363 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.086656 30955 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:15:24.133019 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 107811us
I20260709 13:15:24.134037 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:24.087401 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:24.075364 30881 rpcz_store.cc:276] 0709 13:15:22.830274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.830446 (+   172us) service_pool.cc:224] Handling call
0709 13:15:22.830820 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:22.835915 (+  5095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:22.835961 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:22.840193 (+  4232us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.986003 (+145810us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:22.986047 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.986121 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.056404 (+1070283us) raft_consensus.cc:1685] finished
0709 13:15:24.056434 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.056563 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4694,"raft.queue_time_us":9726,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":11270,"thread_start_us":116409,"threads_started":1,"wal-append.queue_time_us":445708}
I20260709 13:15:24.013244  1481 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.035418  1440 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.088546 30953 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:24.122143 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:24.147478 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:24.088275 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 479) took 2124 ms. Trace:
I20260709 13:15:24.148727 31030 rpcz_store.cc:276] 0709 13:15:21.964186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:21.964456 (+   270us) service_pool.cc:224] Handling call
0709 13:15:21.972928 (+  8472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:21.984313 (+ 11385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:21.984341 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:21.995478 (+ 11137us) log.cc:844] Serialized 26 byte log entry
0709 13:15:22.887973 (+892495us) spinlock_profiling.cc:243] Waited 9.03 ms on lock 0x7b1800083b00. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:22.987885 (+ 99912us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:22.987925 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:22.988050 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.077285 (+1089235us) raft_consensus.cc:1685] finished
0709 13:15:24.077308 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.088200 (+ 10892us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11011,"raft.queue_time_us":11547,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5213,"spinlock_wait_cycles":20776192,"thread_start_us":99700,"threads_started":1,"wal-append.queue_time_us":1463966}
I20260709 13:15:24.139325  1471 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:15:24.136921  1019 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.959s	user 0.007s	sys 0.005s
I20260709 13:15:24.151472  1129 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.170542 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:24.065409  1493 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.073966  1501 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:24.164973 31568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.005s	sys 0.024s
W20260709 13:15:24.176587 31568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.005s	sys 0.024s
I20260709 13:15:24.149083  1482 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.138927  1363 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.153935  1475 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.080387  1340 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.087381  1043 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.197067 31604 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:24.198486 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:24.203414 31596 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:24.133216  1098 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.196942  1475 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:24.172389  1491 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:24.200752  1427 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.206737 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:24.074950  1094 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.167699  1423 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:24.153481  1364 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.232185 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:24.205173  1471 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.249430  1331 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:24.274893 30878 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:24.275405 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:24.205907  1482 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:24.251176 30883 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:24.202821  1499 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:24.194433  1019 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.250432  1094 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:24.290495 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.291216 30953 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:24.280687 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.034s
I20260709 13:15:24.218276  1475 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.284302 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:24.284492 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:24.257072 31596 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:15:24.260924  1087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.004s	sys 0.025s
I20260709 13:15:24.288671 30949 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:24.295239 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:24.293085 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.009s	sys 0.034s
I20260709 13:15:24.259352  1491 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:24.293409 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.003s	sys 0.052s
I20260709 13:15:24.285607  1498 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:24.288966  1331 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:15:24.299775 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.003s	sys 0.052s
W20260709 13:15:24.303256 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 680425us
I20260709 13:15:24.288106  1490 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:24.298780 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 643273us
I20260709 13:15:24.329392 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:24.331008 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:24.296868 30996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.028s	sys 0.051s
I20260709 13:15:24.274340  1319 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:15:24.297333  1087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.004s	sys 0.025s
W20260709 13:15:24.331735 30996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.029s	sys 0.051s
I20260709 13:15:24.336198 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:24.322165  1307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.010s
W20260709 13:15:24.339359 30922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.038s	sys 0.065s
W20260709 13:15:24.350649 30922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.038s	sys 0.065s
I20260709 13:15:24.365720 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.366281 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.366456 31030 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:24.367261 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.369174 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.371141 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.379607 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:24.383723 31571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.030s	sys 0.021s
W20260709 13:15:24.384207 31571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.030s	sys 0.021s
W20260709 13:15:24.384522 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 73470.9us
I20260709 13:15:24.395330 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.396736 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.397740 30949 raft_consensus.cc:2368] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8.
I20260709 13:15:24.398840 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.401063 31031 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:15:24.334898  1299 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:24.373534  1307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.007s	sys 0.010s
I20260709 13:15:24.413427 31600 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:24.357008  1331 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:24.375869  1461 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:24.283306  1471 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.353781  1463 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:24.499488 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:24.387130  1478 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.412705  1493 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.512008 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.384929   784 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:24.512658 31600 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.415098  1126 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:24.595427  1487 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.182s
I20260709 13:15:24.596474  1504 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:23.644995 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:24.596987  1480 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.597311  1502 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.324s
I20260709 13:15:24.597998  1441 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:24.600967  1510 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:15:24.607227 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.676024 31029 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
W20260709 13:15:24.676144 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 391702us
I20260709 13:15:24.608191 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.609251 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.516379 30949 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:24.616031 31031 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:24.678450 31026 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
W20260709 13:15:24.616523  1521 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:15:24.617026 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:24.617245  1520 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:24.617833 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:24.483258  1040 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:15:24.486590  1448 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.506588  1440 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:24.354796  1490 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.512221  1299 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:24.517036  1463 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:24.645201  1480 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:24.662726  1481 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.585263  1516 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:24.604429  1478 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:24.586567  1491 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.664878  1331 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.413800  1482 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.668674 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.830166 30951 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:24.831238 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.831929 30951 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:24.832885 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.833499 30951 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:24.834395 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.835011 30951 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:24.669521 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1927) took 1056 ms. Trace:
I20260709 13:15:24.835919 30950 rpcz_store.cc:276] 0709 13:15:23.612903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.825832 (+212929us) service_pool.cc:224] Handling call
0709 13:15:23.826251 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:23.826653 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:23.826691 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:23.827217 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.309949 (+482732us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:24.310005 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.310090 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:24.669332 (+359242us) raft_consensus.cc:1685] finished
0709 13:15:24.669350 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:24.669464 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22611,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":482368,"threads_started":1,"wal-append.queue_time_us":840584}
I20260709 13:15:24.838631 30950 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:24.669586 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:24.670369 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:24.670770 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:24.672880  1477 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.482s	user 0.003s	sys 0.001s
I20260709 13:15:24.506296   917 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:15:24.674499 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:24.683284 31028 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:24.733376 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56624.9us
I20260709 13:15:24.646027  1504 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:24.585379  1493 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:24.667667  1438 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.022s	user 0.005s	sys 0.004s
I20260709 13:15:24.743492 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.651954 31600 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:24.744591  1417 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:24.739531  1126 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:24.905931 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:24.906613 31600 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:24.745796  1490 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.746290  1299 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:24.746815  1522 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:15:24.747006  1463 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:24.748786  1471 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:24.747429  1488 consensus_meta.cc:287] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.898s	user 0.011s	sys 0.000s
I20260709 13:15:24.742960  1340 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:24.755493  1489 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.755089  1464 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:24.756940  1019 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:24.758991 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1928) took 1145 ms. Trace:
I20260709 13:15:24.919449 30955 rpcz_store.cc:276] 0709 13:15:23.613189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.854089 (+240900us) service_pool.cc:224] Handling call
0709 13:15:23.854461 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.087047 (+232586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.758681 (+671634us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400350a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:24.758919 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533294336}
I20260709 13:15:24.920710 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:24.921376 30955 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:24.651648  1511 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.675102  1363 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:24.808086  1429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.018s	sys 0.012s
I20260709 13:15:24.817927  1502 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:24.737224  1476 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.161s	user 0.011s	sys 0.000s
W20260709 13:15:24.841581 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 170888us
I20260709 13:15:24.739981  1043 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:24.660396   784 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.762131  1480 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.845194 30950 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:24.846413 30951 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:24.680397  1475 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:24.868124 31603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.052s	sys 0.067s
I20260709 13:15:24.702224  1520 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:24.868700 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 487466us
I20260709 13:15:24.874576 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:24.790283  1510 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:15:24.877858  1535 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:24.863834  1481 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:24.897965 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:24.828099  1478 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.904987 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:24.876799  1470 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.035s	user 0.013s	sys 0.000s
I20260709 13:15:24.742430  1448 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:24.904352  1389 consensus_meta.cc:287] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 2.004s	user 0.017s	sys 0.000s
I20260709 13:15:24.681566  1441 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.915234 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:24.916283  1517 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.794553  1516 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.896373  1526 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:24.932914 31602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.022s
I20260709 13:15:24.903640  1440 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:15:24.914564  1438 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:24.921722  1490 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.920435  1464 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:24.921900  1489 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:24.955034 31603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.052s	sys 0.067s
I20260709 13:15:24.956435 31604 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:24.958791 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 60940.4us
I20260709 13:15:24.960945 30949 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:24.964893 31600 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:24.967065 31602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.022s
I20260709 13:15:24.976617 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1537) took 1921 ms. Trace:
I20260709 13:15:24.985808 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.057301 30883 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:25.059161 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:24.996872 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:24.998051 30876 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:25.000578 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44411us
I20260709 13:15:25.002051 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.070807 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:25.010375 30877 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:25.011476 31031 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:25.037379 30882 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:25.041800 30879 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:25.054657 30952 rpcz_store.cc:276] 0709 13:15:23.054991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.055198 (+   207us) service_pool.cc:224] Handling call
0709 13:15:23.881271 (+826073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:23.938285 (+ 57014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.976385 (+1038100us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b5400194bd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:24.976543 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898898816}
I20260709 13:15:24.979331 30957 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:15:25.084220 31596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.028s	sys 0.069s
W20260709 13:15:25.085215 31596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.028s	sys 0.070s
W20260709 13:15:24.949533  1429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.018s	sys 0.012s
W20260709 13:15:24.957468  1527 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:15:25.100612 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.114053 30877 raft_consensus.cc:2410] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:25.062252 30954 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:25.114545 30954 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:25.063141 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.012795 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:25.115830 31026 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:25.116997 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:24.938472  1259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.010s	sys 0.022s
I20260709 13:15:25.104676 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:25.000728 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 126258us
I20260709 13:15:25.106899 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.007740  1440 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:24.964586  1441 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:24.962760  1448 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.967711  1478 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:25.127068 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:24.966778  1516 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:24.958228  1481 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:24.998248  1326 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:25.128908 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58185.5us
I20260709 13:15:24.951457   784 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:25.055199  1496 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:24.956316  1475 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:25.126209 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:25.177897 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:25.179989 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:24.981299  1363 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.185s
I20260709 13:15:24.936697  1511 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.955168  1520 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:24.978566  1476 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:25.035315  1489 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:25.032902  1464 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:25.139569 30954 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.167413  1537 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:15:25.000434  1488 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:25.101712  1499 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:25.104233  1357 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.921501  1504 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.994791  1538 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:24.957651  1417 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.180641 31600 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:25.181095 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:25.183205 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.269599 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:25.269785 30877 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:24.963020  1389 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.967890  1340 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
I20260709 13:15:25.128394  1423 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:25.174865  1319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.032s	sys 0.050s
I20260709 13:15:25.128463  1536 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:25.003953  1438 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.293258  1548 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:24.967058  1526 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:25.297117  1543 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.297389  1526 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:25.297904  1526 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:24.997337  1490 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:24.980237  1502 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:25.130257  1259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.011s	sys 0.022s
I20260709 13:15:25.030493 31028 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:25.178946  1482 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.179361  1481 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:24.961194  1470 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:25.247834 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:25.317379 31603 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:25.008424  1126 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.168314  1440 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.197765  1478 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:25.284305  1299 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:25.207552  1475 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:25.285495 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:25.206203  1532 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:25.293169  1536 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:25.269253  1529 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:15:25.238999  1464 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:25.313817 31605 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:25.288174  1319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.032s	sys 0.050s
I20260709 13:15:25.208060  1326 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:15:25.199352  1311 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.965157  1517 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.236316 31604 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:25.243374  1488 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.289827  1538 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:25.297719  1543 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:25.306667  1489 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:25.313910  1340 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:24.958070  1535 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.307586  1493 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:25.402613 31605 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:25.387519 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 264180us
I20260709 13:15:25.329828   917 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:25.289368  1417 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:25.282958  1357 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.378513  1475 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:25.426286 31603 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:25.432940 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 925) took 1039 ms. Trace:
I20260709 13:15:25.383340  1536 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.433362 31603 rpcz_store.cc:276] 0709 13:15:24.394133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.396054 (+1001921us) service_pool.cc:224] Handling call
0709 13:15:25.423897 (+ 27843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.432604 (+  8707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.432869 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:25.304292  1526 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.428412 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:25.324021  1482 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.442147  1516 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:25.444355 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 885) took 1059 ms. Trace:
I20260709 13:15:25.453356 30877 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:25.453750 30882 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:25.455711 30882 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:25.457461 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.426453  1489 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:25.458933 31603 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:25.435884  1475 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:25.459739 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:25.409727  1464 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.449108 31598 rpcz_store.cc:276] 0709 13:15:24.384907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.385046 (+   139us) service_pool.cc:224] Handling call
0709 13:15:24.385396 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:24.407978 (+ 22582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.408025 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:24.491226 (+ 83201us) log.cc:844] Serialized 52 byte log entry
0709 13:15:24.989883 (+498657us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:24.989926 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.989993 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.444104 (+454111us) raft_consensus.cc:1685] finished
0709 13:15:25.444140 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.444282 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22124,"raft.queue_time_us":265466,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":95,"thread_start_us":385711,"threads_started":1,"wal-append.queue_time_us":780835}
I20260709 13:15:25.432456  1155 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:25.474905 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 405707us
I20260709 13:15:25.446614  1516 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:25.465202 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:25.506793 30953 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:15:25.465497 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:25.507576 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 841) took 1386 ms. Trace:
I20260709 13:15:25.436585   917 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:25.414153  1311 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:25.463961 30875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.026s	sys 0.039s
I20260709 13:15:25.480538 31598 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:25.496584 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 836) took 1446 ms. Trace:
I20260709 13:15:25.497079 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:25.497433 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 316370us
I20260709 13:15:25.456212  1437 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:25.431139  1340 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.504374 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:25.507978 31597 rpcz_store.cc:276] 0709 13:15:24.121637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.121806 (+   169us) service_pool.cc:224] Handling call
0709 13:15:25.498916 (+1377110us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400715054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:25.507507 (+  8591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353046272}
I20260709 13:15:25.483700  1155 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.507423 30949 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:25.510815 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:25.512073 30951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.013s	sys 0.056s
I20260709 13:15:25.513011 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:25.508512  1491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.030s	sys 0.066s
I20260709 13:15:25.513510 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:25.514314 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 517367us
I20260709 13:15:25.454509  1448 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:15:25.518486 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:25.519308 31601 rpcz_store.cc:276] 0709 13:15:24.050269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.050437 (+   168us) service_pool.cc:224] Handling call
0709 13:15:24.053187 (+  2750us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:24.076400 (+ 23213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.076427 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:24.077064 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 13:15:24.494941 (+417877us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:24.494984 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.495050 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:25.492563 (+997513us) raft_consensus.cc:1685] finished
0709 13:15:25.492595 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:25.496513 (+  3918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14461,"raft.queue_time_us":26987,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":57082,"thread_start_us":351166,"threads_started":1,"wal-append.queue_time_us":762326}
W20260709 13:15:25.515828 30875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.026s	sys 0.040s
I20260709 13:15:25.521056 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:25.500044  1540 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:15:25.460286  1441 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:15:25.497931  1478 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.070761 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.014s
W20260709 13:15:26.352286 30951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.024s	sys 0.076s
I20260709 13:15:25.529383 31603 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:15:26.352952 31603 pending_rounds.cc:85] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 6
W20260709 13:15:25.769042 30921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.003s	sys 0.007s
I20260709 13:15:26.353526 31603 pending_rounds.cc:107] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:15:26.056871 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 886) took 1670 ms. Trace:
I20260709 13:15:26.353029 30953 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:26.354837 31602 rpcz_store.cc:276] 0709 13:15:24.385988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.386136 (+   148us) service_pool.cc:224] Handling call
0709 13:15:24.386429 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.053127 (+666698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.053172 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.053788 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.319604 (+265816us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:25.500571 (+180967us) log.cc:844] Serialized 14 byte log entry
0709 13:15:25.500842 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.500913 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.056560 (+555647us) raft_consensus.cc:1685] finished
0709 13:15:26.056590 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.056797 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24737,"prepare.queue_time_us":376216,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":283412,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":7401,"thread_start_us":965955,"threads_started":3,"wal-append.queue_time_us":441443}
W20260709 13:15:26.353807 30921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.012s	sys 0.018s
I20260709 13:15:26.352816 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 931) took 1712 ms. Trace:
I20260709 13:15:26.357743 31602 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:26.354154 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:26.358137 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.006s	sys 0.011s
I20260709 13:15:26.358438 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 845) took 1172 ms. Trace:
W20260709 13:15:26.358570 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.006s	sys 0.011s
W20260709 13:15:25.646694 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 467016us
I20260709 13:15:26.359812 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:26.354005 31603 raft_consensus.cc:2889] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:26.360893 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 929) took 1721 ms. Trace:
I20260709 13:15:26.361285 31603 rpcz_store.cc:276] 0709 13:15:24.639488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.470599 (+831111us) service_pool.cc:224] Handling call
0709 13:15:25.528646 (+ 58047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.360628 (+831982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.360844 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:26.354151 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.008s	sys 0.020s
W20260709 13:15:26.362306 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 918854us
I20260709 13:15:25.530192  1553 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:26.352483 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 833996us
I20260709 13:15:26.357376 31598 rpcz_store.cc:276] 0709 13:15:24.640131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.555296 (+915165us) service_pool.cc:224] Handling call
0709 13:15:25.555808 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.556066 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.556105 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:25.556165 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:25.556222 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.556294 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.352753 (+796459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.366669  1482 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:26.028548  1501 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.821s	user 0.014s	sys 0.000s
I20260709 13:15:26.368144 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:26.368496  1501 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.370293 31570 leader_election.cc:400] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8.
I20260709 13:15:25.581936  1437 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.371886 31570 leader_election.cc:403] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:26.370869  1482 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.373080  1482 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.373641  1482 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:26.374794 30952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.003s	sys 0.005s
W20260709 13:15:26.375267 30952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.003s	sys 0.005s
I20260709 13:15:26.370462  1470 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:26.376300  1491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.032s	sys 0.071s
I20260709 13:15:26.377108  1491 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:26.378337  1491 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8.
I20260709 13:15:25.957482  1043 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:26.380347  1043 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.383140  1043 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:26.383610 30874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.004s	sys 0.004s
W20260709 13:15:26.437826 30874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.005s	sys 0.004s
I20260709 13:15:25.690996  1562 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.384455  1478 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.061872  1357 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.386837 30883 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8.
I20260709 13:15:26.057442  1502 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:25.697309  1417 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:26.060755   917 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.054540  1517 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:26.056979  1490 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:26.209372 30957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.006s
W20260709 13:15:26.460604 30957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.002s	sys 0.006s
I20260709 13:15:26.020032  1440 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.359053  1464 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.398718 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:26.398731  1536 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.000s
I20260709 13:15:25.508740  1516 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:25.500818  1511 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:26.401826 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 880748us
I20260709 13:15:26.475489 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:26.402002 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1932) took 1729 ms. Trace:
I20260709 13:15:26.477000 30951 rpcz_store.cc:276] 0709 13:15:24.673046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.953675 (+280629us) service_pool.cc:224] Handling call
0709 13:15:24.953958 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.954204 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:24.954532 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.401676 (+1447144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.401735 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:26.401784 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.401846 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.401948 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48979,"prepare.queue_time_us":2343,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":67525,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":14093,"thread_start_us":1398032,"threads_started":1,"wal-append.queue_time_us":1464309}
I20260709 13:15:26.478899 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:26.479468 30951 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:26.021061  1489 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:25.674995  1547 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
W20260709 13:15:25.675544  1539 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 13:15:26.286219  1558 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:15:26.432832  1504 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.491273 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 923) took 2190 ms. Trace:
I20260709 13:15:26.435461 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1924) took 2823 ms. Trace:
I20260709 13:15:26.491658 31596 rpcz_store.cc:276] 0709 13:15:24.300420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.300712 (+   292us) service_pool.cc:224] Handling call
0709 13:15:24.301938 (+  1226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.347807 (+ 45869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.347862 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.348434 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.086601 (+738167us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:25.086654 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.086751 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.491041 (+1404290us) raft_consensus.cc:1685] finished
0709 13:15:26.491060 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.491208 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23913,"raft.queue_time_us":41810,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":25123,"thread_start_us":588940,"threads_started":1,"wal-append.queue_time_us":886715}
I20260709 13:15:26.491837 30958 rpcz_store.cc:276] 0709 13:15:23.611956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.622330 (+ 10374us) service_pool.cc:224] Handling call
0709 13:15:23.622662 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.035419 (+412757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.035450 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.036630 (+  1180us) log.cc:844] Serialized 26 byte log entry
0709 13:15:24.489947 (+453317us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:24.604841 (+114894us) log.cc:844] Serialized 14 byte log entry
0709 13:15:24.621161 (+ 16320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:24.621302 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.434699 (+1813397us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b540008e420. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abcfdbe 00007f273abda930 00007f273abda8d8 00007f273abda858 00007f273abda813 00007f273abd9a9c 00007f2740ac5626 00007f2740abfdd8 00007f273ac167cb 00007f273ac192c0
0709 13:15:26.435111 (+   412us) raft_consensus.cc:1685] finished
0709 13:15:26.435225 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.435393 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15823,"prepare.queue_time_us":116621,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":524576,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":6389,"spinlock_wait_cycles":104527232,"thread_start_us":768793,"threads_started":2,"wal-append.queue_time_us":769765}
I20260709 13:15:26.374136  1437 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.494213 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:26.442437 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 82694.8us
I20260709 13:15:26.494952 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1562) took 1027 ms. Trace:
I20260709 13:15:26.495262 30958 rpcz_store.cc:276] 0709 13:15:25.468016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.493944 (+1025928us) service_pool.cc:224] Handling call
0709 13:15:26.494898 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.495632 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:25.701247  1555 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.496196 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:26.496796 30958 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:26.496752  1555 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:25.695612  1389 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:26.446085 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 83119.9us
W20260709 13:15:26.473886  1520 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.256s	user 0.013s	sys 0.000s
I20260709 13:15:26.358861 31602 rpcz_store.cc:276] 0709 13:15:25.185962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.357251 (+1171289us) service_pool.cc:224] Handling call
0709 13:15:26.357578 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.358224 (+   646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.358389 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.451031 30877 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:25.706017  1543 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.421125  1554 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.429476  1469 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:26.429281  1505 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.462472 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 108378us
I20260709 13:15:26.515055 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:26.484375  1043 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:26.464113 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93982.4us
I20260709 13:15:26.463358  1482 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.470928 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2267) took 1798 ms. Trace:
I20260709 13:15:26.455983  1470 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:26.467160  1463 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.534s	user 0.013s	sys 0.000s
I20260709 13:15:26.484215 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:26.535107 30951 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:26.534966  1463 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.535696 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1561) took 1068 ms. Trace:
I20260709 13:15:26.536057 30951 rpcz_store.cc:276] 0709 13:15:25.467698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.483935 (+1016237us) service_pool.cc:224] Handling call
0709 13:15:26.535635 (+ 51700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.536950 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:26.537513 30951 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:25.500272  1538 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.452307  1570 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.488427  1501 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.489166  1340 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.494073  1437 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:26.351094  1551 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:25.507324  1270 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.503590 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:26.519663  1490 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:26.507066 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 677) took 1001 ms. Trace:
I20260709 13:15:26.482511  1259 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.470144  1311 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:26.518733 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.567584 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.447367  1480 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.467s	user 0.012s	sys 0.000s
I20260709 13:15:26.466116 30953 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:26.521726 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:26.548026  1570 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.523681 30875 rpcz_store.cc:276] 0709 13:15:24.672277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.673208 (+   931us) service_pool.cc:224] Handling call
0709 13:15:24.673493 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.673726 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:24.935406 (+261680us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.469789 (+1534383us) log.cc:844] Serialized 14 byte log entry
0709 13:15:26.470641 (+   852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:26.470678 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:26.470715 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.470760 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.470881 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2755,"prepare.queue_time_us":414341,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":77,"raft.queue_time_us":46510,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":31541,"thread_start_us":1795068,"threads_started":3,"wal-append.queue_time_us":1076797}
W20260709 13:15:26.565354  1441 consensus_queue.cc:1175] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bda0856a7efd4d0e96615b66bef383c6" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260709 13:15:26.454511  1562 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.538463 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:26.505934  1565 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.508790  1554 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:26.581640 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 86085.1us
I20260709 13:15:26.582692 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1563) took 1114 ms. Trace:
W20260709 13:15:26.553457 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76850us
I20260709 13:15:26.510792  1543 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:26.516356  1489 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:26.480858  1536 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:26.556102 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52573us
I20260709 13:15:26.584430 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:25.956128  1462 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.514508  1577 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:26.566087 30877 rpcz_store.cc:276] 0709 13:15:25.505287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.512770 (+  7483us) service_pool.cc:224] Handling call
0709 13:15:26.506985 (+994215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.537830  1463 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:26.533196  1478 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.506942  1563 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:15:26.552595  1043 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:26.576117 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 54460.5us
I20260709 13:15:26.557701  1340 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.509838  1520 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.576786  1574 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:26.582878 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:26.549006  1470 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.576241  1270 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:26.574621  1501 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.644083  1501 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.578055  1570 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.615513 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2426) took 1619 ms. Trace:
I20260709 13:15:26.645936 31030 rpcz_store.cc:276] 0709 13:15:24.996467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.996642 (+   175us) service_pool.cc:224] Handling call
0709 13:15:24.997784 (+  1142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.998093 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.998124 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:24.998624 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:15:25.469204 (+470580us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:25.469258 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:25.469344 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.615262 (+1145918us) raft_consensus.cc:1685] finished
0709 13:15:26.615289 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.615445 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1001,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":470254,"threads_started":1,"wal-append.queue_time_us":1201867}
I20260709 13:15:26.583112 30953 rpcz_store.cc:276] 0709 13:15:25.468299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.398463 (+930164us) service_pool.cc:224] Handling call
0709 13:15:26.582629 (+184166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:26.608599 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.585105  1554 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:26.652806 30950 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:26.617013  1577 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.654095 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:26.655366 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:26.656266 31030 raft_consensus.cc:2368] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7.
I20260709 13:15:26.658190  1577 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.615988  1464 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.659595  1464 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.592768 31570 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:26.579815  1480 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.621250 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:26.621416 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:26.615811 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.621583 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.622169 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.622599  1511 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:26.623821  1129 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:26.624604  1569 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:15:26.625325  1575 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:26.721876 31027 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.525276  1505 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.589098  1382 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:15:26.574983  1579 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:15:26.650352  1580 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.619027  1389 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:26.651181  1437 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:26.587735  1565 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.619398 30847 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:15:26.649700 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66917.1us
W20260709 13:15:26.668540 30924 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.644s (SENT) [suppressed 30 similar messages]
I20260709 13:15:26.587678  1543 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.721990 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:26.721869 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 129161us
I20260709 13:15:26.725677  1478 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:26.665131 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:26.756649 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 137323us
W20260709 13:15:26.758615 30996 connection.cc:256] RPC call timeout handler was delayed by -1.3371078259999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 13:15:26.620784  1574 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.723678 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.764447 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 673) took 1307 ms. Trace:
I20260709 13:15:26.647387  1043 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:26.728080 31031 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:26.648170  1340 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:26.740571 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:26.734552  1437 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:26.691480  1417 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.691807  1126 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:26.749120 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:26.725648  1440 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:26.593421  1462 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.660130 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.724596  1129 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.655992  1555 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.766577  1482 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.765290 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.734105 31032 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:26.827116 31600 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:26.765892 30779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 350) took 18879 ms (client timeout 15000 ms). Trace:
W20260709 13:15:26.828585 30779 rpcz_store.cc:269] 0709 13:15:07.878821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:07.880587 (+  1766us) service_pool.cc:224] Handling call
0709 13:15:26.758291 (+18877704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:19.189226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:19.232334 (+ 43108us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:19.232392 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:15:19.232409 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:19.290521 (+ 58112us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:19.290610 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:19.290640 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:15:19.291265 (+   625us) tablet.cc:701] Row locks acquired
0709 13:15:19.291312 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:15:19.291483 (+   171us) write_op.cc:270] Start()
0709 13:15:19.291628 (+   145us) write_op.cc:276] Timestamp: P: 1783602919291416 usec, L: 0
0709 13:15:19.291651 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:15:19.358446 (+ 66795us) log.cc:844] Serialized 2445 byte log entry
0709 13:15:20.402562 (+1044116us) op_driver.cc:464] REPLICATION: finished
0709 13:15:20.826512 (+423950us) write_op.cc:301] APPLY: starting
0709 13:15:20.826611 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:20.826833 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:20.826975 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:20.996569 (+169594us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:21.086304 (+ 89735us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:15:21.086351 (+    47us) write_op.cc:312] APPLY: finished
0709 13:15:21.086700 (+   349us) log.cc:844] Serialized 53 byte log entry
0709 13:15:21.086906 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:21.087038 (+   132us) write_op.cc:454] Released schema lock
0709 13:15:21.087113 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:21.087544 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:21.087578 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":711136,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":423606,"apply.run_cpu_time_us":3798,"apply.run_wall_time_us":261014,"num_ops":6,"prepare.queue_time_us":146432,"prepare.run_cpu_time_us":26180,"prepare.run_wall_time_us":796763,"raft.queue_time_us":274495,"raft.run_cpu_time_us":21986,"raft.run_wall_time_us":298660,"replication_time_us":1110727,"thread_start_us":940340,"threads_started":4,"wal-append.queue_time_us":514633,"wal-append.run_cpu_time_us":17265,"wal-append.run_wall_time_us":2108080}]]}
I20260709 13:15:26.765743 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:26.832719 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 67050.1us
I20260709 13:15:26.833715  1570 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.764858 30874 rpcz_store.cc:276] 0709 13:15:25.456594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.456737 (+   143us) service_pool.cc:224] Handling call
0709 13:15:25.474668 (+ 17931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.508588 (+ 33920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.508644 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.509625 (+   981us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.438245 (+928620us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:26.438289 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.438371 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:26.764235 (+325864us) raft_consensus.cc:1685] finished
0709 13:15:26.764256 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:26.764387 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":425304,"raft.queue_time_us":33627,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10688,"thread_start_us":926446,"threads_started":1,"wal-append.queue_time_us":970225}
I20260709 13:15:26.752115  1579 consensus_queue.cc:1243] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:26.750840  1580 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:26.836186  1580 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:26.836244  1382 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:26.722378  1562 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.766173  1574 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:26.764683  1478 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.844667 31032 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:26.845602  1478 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.846450 30953 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:26.763973  1501 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.763494  1448 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:26.799249  1520 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.817935 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.848690  1448 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.849656 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.850809 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.802084 31030 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:26.852686 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:26.853695 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:26.823601 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47707.7us
I20260709 13:15:26.660961  1155 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.857290  1155 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.857870  1155 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:26.850906  1448 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.859128  1155 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:26.859725  1382 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:26.860826 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.862212 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.862933 31026 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:26.771102  1340 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.773020  1437 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:26.799715  1563 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:26.864257 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 108658us
I20260709 13:15:26.799942  1417 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.872726 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:26.872735  1563 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.873764  1563 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:26.874017 30847 connection.cc:256] RPC call timeout handler was delayed by -1.0963155880001523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:15:26.874845  1505 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.881618  1563 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:26.884690  1563 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.868203  1043 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.821054  1440 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.868381  1580 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.860172  1382 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:26.866218  1570 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.801563  1126 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.890535  1579 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.895192  1440 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.921449  1515 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.920828  1581 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:26.923986 30951 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
W20260709 13:15:26.925946  1583 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:15:26.906715  1470 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.912084  1536 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:26.927175  1475 consensus_meta.cc:287] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.439s	user 0.006s	sys 0.006s
I20260709 13:15:26.886262  1574 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.894464  1563 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:26.929085 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.926156 31027 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:26.941202  1480 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:26.927536  1363 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.927656  1098 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:26.966005 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:26.970839 31027 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:26.974547 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.975278 31023 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
W20260709 13:15:26.970611  1481 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.587s	user 0.010s	sys 0.003s
I20260709 13:15:26.944721  1581 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:26.942696  1515 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.912894  1579 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.984447 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:26.984637 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:26.987564  1353 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:26.943125  1382 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.989969 31023 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:26.995254 31027 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:26.994184  1346 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:26.997154  1346 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:26.967888  1475 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.987957  1353 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.972317  1516 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:26.986090  1581 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.016248  1346 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:27.043012 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 289910us
I20260709 13:15:27.040798 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1565) took 1572 ms. Trace:
I20260709 13:15:26.977375  1363 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.000825  1543 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:26.986122  1481 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.036497  1353 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:27.044778 31570 leader_election.cc:400] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7.
I20260709 13:15:26.989504  1515 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.044236 30958 rpcz_store.cc:276] 0709 13:15:25.468768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.497556 (+1028788us) service_pool.cc:224] Handling call
0709 13:15:26.497879 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:26.505200 (+  7321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:26.505228 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:26.514179 (+  8951us) log.cc:844] Serialized 52 byte log entry
0709 13:15:26.584420 (+ 70241us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:26.584477 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.584543 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.004017 (+419474us) raft_consensus.cc:1685] finished
0709 13:15:27.004039 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.040734 (+ 36695us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7024,"raft.queue_time_us":7080,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2278,"thread_start_us":27557,"threads_started":1,"wal-append.queue_time_us":126926}
I20260709 13:15:27.050308 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:27.043704  1579 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.040495  1382 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.040510  1565 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.052915 31028 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:27.055538 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:27.051139  1586 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:15:27.044024  1417 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.057790 31031 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:27.052186 31570 leader_election.cc:403] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:15:27.058226 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 389696us
I20260709 13:15:27.058593 30958 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.050633  1346 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.064248  1482 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7.
I20260709 13:15:27.066286  1481 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.068284 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1925) took 3456 ms. Trace:
I20260709 13:15:27.082451 30956 rpcz_store.cc:276] 0709 13:15:23.612295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.618313 (+  6018us) service_pool.cc:224] Handling call
0709 13:15:23.619646 (+  1333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.077459 (+457813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.067993 (+2990534us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54000cfdd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:27.068210 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007295232}
I20260709 13:15:27.083667 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.084654 30956 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:27.067553  1572 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.703s	user 0.001s	sys 0.001s
I20260709 13:15:27.078959 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:27.085572 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:27.086891 30956 raft_consensus.cc:2410] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:27.087546  1126 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:27.088514  1542 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.806s	user 0.006s	sys 0.013s
I20260709 13:15:27.089895 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1560) took 1623 ms. Trace:
I20260709 13:15:27.090356 30957 rpcz_store.cc:276] 0709 13:15:25.466254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.466391 (+   137us) service_pool.cc:224] Handling call
0709 13:15:25.466736 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.496513 (+ 29777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.496542 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.497041 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.461004 (+963963us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:26.461031 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.461079 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:27.066958 (+605879us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:27.089578 (+ 22620us) raft_consensus.cc:1685] finished
0709 13:15:27.089603 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:27.089831 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29348,"raft.queue_time_us":30361,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":14463,"spinlock_wait_cycles":422119680,"thread_start_us":876376,"threads_started":1,"wal-append.queue_time_us":849792}
I20260709 13:15:27.075502  1340 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:27.092532 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:27.092748 31029 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:27.094262 30957 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:15:27.096737 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.098140 30956 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:27.102138 31023 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:27.106086  1326 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:27.094609  1340 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:27.109232 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:27.110005 31023 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:27.110958 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:27.112669  1574 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:27.114485 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:27.119889  1574 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:27.121021  1574 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:27.121541  1574 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:27.122430  1574 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.123703  1574 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:27.119879 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:27.136528 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1931) took 2463 ms. Trace:
I20260709 13:15:27.137221  1595 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:27.136989 30950 rpcz_store.cc:276] 0709 13:15:24.672670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.952558 (+279888us) service_pool.cc:224] Handling call
0709 13:15:24.952938 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:26.653285 (+1700347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:27.136237 (+482952us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400112e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:27.136463 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3908677504}
I20260709 13:15:27.137897  1595 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.139092 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.139662 30950 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.140250 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.140707  1498 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:27.145466 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.147373 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:27.152911 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.155516 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.156738 30877 raft_consensus.cc:2368] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6.
I20260709 13:15:27.159797 30878 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:27.161535 30958 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:27.162645 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.163295 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:27.165179 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:27.166237 30958 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:27.167117 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:27.167999 30958 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:27.169618 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.170919 31596 raft_consensus.cc:2410] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:27.172286 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.176470 30924 leader_election.cc:400] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6.
I20260709 13:15:27.176860 30924 leader_election.cc:403] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:27.177006 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.177667 30878 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:27.178821 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:27.159108  1326 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.157783  1498 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:27.168231 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.235505 30950 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:27.236629 31602 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:27.231371 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:27.236850 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.237202 30958 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:27.239166 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.240027 31596 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 3.
I20260709 13:15:27.236925 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.242290 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.243552 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:27.243820 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.244611 30879 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:27.245579 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:27.246137 30881 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.182411 30875 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:27.189899 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:27.248263 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.248823 30883 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:27.200541 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.249943 30874 raft_consensus.cc:2410] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:27.248263 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.251071 31596 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:27.252084 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:27.252673 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:27.253611 31596 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:27.256891 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:27.258250 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:27.180824  1389 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.259562 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.264557 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.160612  1382 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:27.129597  1129 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.264724 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.270007 31596 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:27.164999  1423 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.265983 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:27.241279  1579 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:27.284416 30958 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:27.241314  1308 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6.
I20260709 13:15:27.180469  1326 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.161661  1448 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:15:27.165768  1126 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:15:27.323930 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:27.326310 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 70540.1us
I20260709 13:15:27.181306  1340 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:15:27.200774  1208 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 13:15:27.241050  1565 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 13:15:27.522850  1598 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:15:27.455440  1581 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.556954 30998 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:27.327749  1595 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.353044  1326 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:27.571590  1487 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.572300  1581 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.331480 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:27.628799 30998 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:27.328763 31596 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:27.348284 31598 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:27.341233  1554 consensus_meta.cc:287] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.005s
W20260709 13:15:27.673408  1515 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:15:27.673882  1515 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:27.675969  1515 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:27.326696  1475 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:27.574110  1602 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:27.356479  1516 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.653520  1129 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:27.683379  1440 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.003s
W20260709 13:15:27.679736  1574 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.002s
I20260709 13:15:27.322817  1423 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.317798  1389 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.390057  1566 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.423s
I20260709 13:15:27.572394  1487 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.708725  1487 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.667104  1518 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:15:27.697544  1489 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.109s	user 0.013s	sys 0.000s
W20260709 13:15:27.699800  1353 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.002s
I20260709 13:15:27.716214  1353 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.700166  1440 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.720683  1440 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:27.671545  1554 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.736606  1554 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.384377  1437 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.739218  1437 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.728497  1423 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:27.730270  1353 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.704891  1389 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:27.320953  1579 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:27.763104  1579 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:27.769359  1565 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:27.769901  1565 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:27.344113  1498 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.794008  1498 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:27.801604  1270 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:27.316632  1382 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.805413  1382 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:27.770948  1565 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:27.863720  1565 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:27.910725  1579 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:27.386667 30881 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:27.964412 30880 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:27.974176 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:27.988312 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.990765 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:27.358590 30958 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:27.993636 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:27.994401 30955 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:27.997272 30955 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:27.998495 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 609) took 1491 ms. Trace:
W20260709 13:15:28.000488 30996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.005s
W20260709 13:15:28.001034 30996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.001s	sys 0.005s
W20260709 13:15:28.001418 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 738568us
I20260709 13:15:28.004871 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1886) took 3400 ms. Trace:
I20260709 13:15:28.005750 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.006808 31023 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:28.006757 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 503) took 3640 ms (client timeout 1800 ms). Trace:
W20260709 13:15:28.007261 31025 rpcz_store.cc:269] 0709 13:15:24.366609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.366721 (+   112us) service_pool.cc:224] Handling call
0709 13:15:28.006315 (+3639594us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54003f5cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.006577 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4738598656}
I20260709 13:15:28.009083 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:28.009747 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.010485 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:28.011333 31025 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.012923 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2429) took 1407 ms. Trace:
I20260709 13:15:28.013417 31028 rpcz_store.cc:276] 0709 13:15:26.605870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.606028 (+   158us) service_pool.cc:224] Handling call
0709 13:15:28.012465 (+1406437us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54001bf654. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.012694 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761588992}
I20260709 13:15:28.005359 31024 rpcz_store.cc:276] 0709 13:15:24.604446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.606152 (+  1706us) service_pool.cc:224] Handling call
0709 13:15:24.606495 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:24.972131 (+365636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.972178 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:24.972247 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:24.972305 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.004295 (+3031990us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540007c954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:28.004385 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.004665 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840123264}
I20260709 13:15:28.016981 31030 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:28.017614 31024 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:28.019243 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 390425us
I20260709 13:15:28.019465 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2439) took 1294 ms. Trace:
I20260709 13:15:28.019837 31031 rpcz_store.cc:276] 0709 13:15:26.724800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.850531 (+125731us) service_pool.cc:224] Handling call
0709 13:15:28.019074 (+1168543us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002d4954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.019299 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473112832}
I20260709 13:15:28.021064 31027 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:28.021517 31031 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:28.021821 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1892) took 1358 ms. Trace:
I20260709 13:15:28.022221 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1896) took 1356 ms. Trace:
I20260709 13:15:28.022838 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.023870 31023 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:28.025756 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1894) took 1354 ms. Trace:
I20260709 13:15:28.069103 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:28.026755 30954 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:28.001477 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 610) took 1494 ms (client timeout 1954 ms). Trace:
W20260709 13:15:28.071209 30951 rpcz_store.cc:269] 0709 13:15:26.506827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.538240 (+ 31413us) service_pool.cc:224] Handling call
0709 13:15:28.001067 (+1462827us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54002904d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.001252 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791821184}
I20260709 13:15:28.072757 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:28.074231  1126 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:28.018208 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2437) took 1409 ms. Trace:
I20260709 13:15:28.075773  1326 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:28.075866 31030 rpcz_store.cc:276] 0709 13:15:26.608925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.853470 (+244545us) service_pool.cc:224] Handling call
0709 13:15:28.017972 (+1164502us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001f2054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.018132 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672478464}
I20260709 13:15:28.076854  1326 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.077414 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:28.028805 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2435) took 1420 ms. Trace:
I20260709 13:15:28.030021 31026 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:28.033324  1043 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.034951  1019 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:28.035343 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:28.036320 31604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 921) took 3752 ms (client timeout 2026 ms). Trace:
I20260709 13:15:28.037865   917 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.038904  1270 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:28.040797 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2433) took 1433 ms. Trace:
I20260709 13:15:28.041213 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 932) took 3343 ms. Trace:
I20260709 13:15:28.042320 31603 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:27.999130 30953 rpcz_store.cc:276] 0709 13:15:26.506572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.647891 (+141319us) service_pool.cc:224] Handling call
0709 13:15:27.998001 (+1350110us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b54002b7d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:27.998238 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217402240}
I20260709 13:15:28.015553 31028 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:28.042851  1094 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.044004 30958 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:28.022661 31031 rpcz_store.cc:276] 0709 13:15:26.665824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.020728 (+1354904us) service_pool.cc:224] Handling call
0709 13:15:28.021184 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.021940 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.022135 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.046550 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:28.112843 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2441) took 1190 ms. Trace:
W20260709 13:15:28.048465 31605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 833) took 4032 ms (client timeout 1824 ms). Trace:
I20260709 13:15:28.049176 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:28.051626 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 844) took 2865 ms. Trace:
I20260709 13:15:28.051501 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:28.022234 31027 rpcz_store.cc:276] 0709 13:15:26.662975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.010827 (+1347852us) service_pool.cc:224] Handling call
0709 13:15:28.011421 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.021536 (+ 10115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.021743 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:28.053315 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.053246 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 927) took 3461 ms. Trace:
W20260709 13:15:28.055382 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.055254 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:28.060314  1259 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:28.061060  1208 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.064999 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:28.122584 31023 rpcz_store.cc:276] 0709 13:15:26.889738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.007544 (+1117806us) service_pool.cc:224] Handling call
0709 13:15:28.079705 (+ 72161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.067422 30882 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:28.069036 31024 rpcz_store.cc:276] 0709 13:15:26.663552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.016808 (+1353256us) service_pool.cc:224] Handling call
0709 13:15:28.017227 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.018054 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.018220 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.047879 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:28.129148 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 108394us
I20260709 13:15:28.078169 31032 rpcz_store.cc:276] 0709 13:15:26.608295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.608403 (+   108us) service_pool.cc:224] Handling call
0709 13:15:28.028386 (+1419983us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b54002d5354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.028614 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22758656}
W20260709 13:15:28.113027 31604 rpcz_store.cc:269] 0709 13:15:24.283925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.284050 (+   125us) service_pool.cc:224] Handling call
0709 13:15:28.035838 (+3751788us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400322dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.036061 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520524160}
W20260709 13:15:28.122742 31605 rpcz_store.cc:269] 0709 13:15:24.016414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.016750 (+   336us) service_pool.cc:224] Handling call
0709 13:15:28.047992 (+4031242us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54004853d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.048203 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906446720}
I20260709 13:15:28.131503 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1893) took 1462 ms. Trace:
I20260709 13:15:28.142453 31028 rpcz_store.cc:276] 0709 13:15:26.663251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.014497 (+1351246us) service_pool.cc:224] Handling call
0709 13:15:28.015049 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.120400 (+105351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.125154 (+  4754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:28.124838 31600 rpcz_store.cc:276] 0709 13:15:24.592150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.414883 (+822733us) service_pool.cc:224] Handling call
0709 13:15:25.415311 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:26.827524 (+1412213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.052624 (+1225100us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540069e954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:28.053010 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3246361472}
I20260709 13:15:28.141119 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1940) took 1007 ms. Trace:
I20260709 13:15:28.145251 30958 rpcz_store.cc:276] 0709 13:15:27.125251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.995245 (+869994us) service_pool.cc:224] Handling call
0709 13:15:28.043290 (+ 48045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.121505 (+ 78215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.131213 (+  9708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15232}
I20260709 13:15:28.146175 30880 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.119522 31029 rpcz_store.cc:276] 0709 13:15:26.607616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.608302 (+   686us) service_pool.cc:224] Handling call
0709 13:15:28.040328 (+1432026us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540007b554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.040573 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021844864}
I20260709 13:15:28.148183  1208 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.152400  1495 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:28.153729  1208 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.153255   917 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.123306 31597 rpcz_store.cc:276] 0709 13:15:25.185730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.400276 (+1214546us) service_pool.cc:224] Handling call
0709 13:15:28.048989 (+1648713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.049846 (+   857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.049890 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.049962 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.050052 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.050146 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.051225 (+  1079us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54004853d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.051429 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23337,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":212,"spinlock_wait_cycles":3790669056}
W20260709 13:15:28.152546 31571 connection.cc:256] RPC call timeout handler was delayed by -2.2486352450000595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:15:28.156374 31571 connection.cc:256] RPC call timeout handler was delayed by -2.1532352450001326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 13:15:28.156792 31571 connection.cc:256] RPC call timeout handler was delayed by -1.6627352450000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 13:15:28.157150 31571 connection.cc:256] RPC call timeout handler was delayed by -1.5269368550000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:15:28.153345  1495 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.151587 30874 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:28.132921  1259 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.153286 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:28.148404 30878 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
W20260709 13:15:28.154732 30950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.008s	sys 0.006s
I20260709 13:15:28.112416  1019 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:28.152417 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:28.119582 31601 rpcz_store.cc:276] 0709 13:15:24.698061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.420816 (+1722755us) service_pool.cc:224] Handling call
0709 13:15:28.036928 (+1616112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:28.037840 (+   912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.037875 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:28.037925 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.037984 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.038089 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.040851 (+  2762us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400322dd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.040995 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3197,"raft.queue_time_us":33720,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":258,"spinlock_wait_cycles":3667869056}
I20260709 13:15:28.171634 30953 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:15:28.177522 30950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.008s	sys 0.007s
I20260709 13:15:28.121112  1094 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:28.188668  1340 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:15:28.191483 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 505) took 1581 ms. Trace:
I20260709 13:15:28.190482  1019 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.217437 31025 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:28.202098 31026 rpcz_store.cc:276] 0709 13:15:26.609522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:26.863615 (+254093us) service_pool.cc:224] Handling call
0709 13:15:28.029350 (+1165735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.122033 (+ 92683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.191143 (+ 69110us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002d5350. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.191337 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675739520}
I20260709 13:15:28.224874 30881 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:28.225463 30879 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:28.255918  1574 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:28.257272  1581 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.258175  1611 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.259552 30953 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:15:28.258258  1581 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.256995  1574 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.269984 30958 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.259071  1611 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:28.274464 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 94001.1us
I20260709 13:15:28.267987  1595 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:28.277767 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101034us
I20260709 13:15:28.282475  1019 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.288303  1440 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:28.290544  1475 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:28.291483  1475 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.292618  1611 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.295013  1475 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:28.295970 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.297739  1496 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.299803  1331 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.300585 31601 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:28.300531  1331 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.303108  1331 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.304190 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:28.304979 30958 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:28.230165  1353 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 13:15:28.308327 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:28.317107 31605 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:15:28.315014 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:28.339200 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.330194 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 920) took 4131 ms. Trace:
I20260709 13:15:28.239868  1043 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.312024 31571 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:28.337134 30998 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:28.380473 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 43524.6us
I20260709 13:15:28.381151 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:28.382313  1326 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:28.383481  1340 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:28.383683  1475 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.384466  1475 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.386641  1129 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:28.387308  1129 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.387895 30882 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:15:28.388206 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:28.389710  1129 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:28.390403  1129 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:28.390851  1129 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:28.325680  1331 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:15:28.392947  1094 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.393625  1094 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.305011  1574 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:28.315968  1581 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.411808 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:28.312542  1579 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.318419  1610 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:28.320056  1495 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.318229   917 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.427376 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:28.428915 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:28.429563  1094 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.430873  1407 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:28.408185  1340 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:28.438688 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:28.436466 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:28.299824  1496 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.313062  1595 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.463464 30954 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:28.452441 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69249us
I20260709 13:15:28.462885  1308 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:28.512897  1620 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:28.464044  1475 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:28.552551 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 117093us
W20260709 13:15:28.552956 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 241224us
I20260709 13:15:28.452644  1574 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:28.554287 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.554100 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:28.436484  1129 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:28.558861  1159 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:15:28.559087  1595 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.374945 31599 rpcz_store.cc:276] 0709 13:15:24.198383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:24.259180 (+ 60797us) service_pool.cc:224] Handling call
0709 13:15:24.290313 (+ 31133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:24.290665 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:24.290697 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.033064 (+3742367us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b2c00047358. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:15:28.034046 (+   982us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.078632 (+ 44586us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:28.184907 (+106275us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.208041 (+ 23134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.220415 (+ 12374us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.329783 (+109368us) raft_consensus.cc:1685] finished
0709 13:15:28.329880 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.330028 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73080,"prepare.queue_time_us":164708,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":69147,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":21244,"spinlock_wait_cycles":97675648,"thread_start_us":76842,"threads_started":2,"wal-append.queue_time_us":170746}
W20260709 13:15:28.513015 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72969.1us
W20260709 13:15:28.510784 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 59550.6us
I20260709 13:15:28.558719  1308 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.499801  1340 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:28.561775 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:28.512725 30958 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.571813 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1542) took 5485 ms. Trace:
W20260709 13:15:28.512214  1565 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.648s	user 0.018s	sys 0.000s
I20260709 13:15:28.574427 31605 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:28.437919  1407 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:28.553494 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:28.581952 30954 rpcz_store.cc:276] 0709 13:15:23.086441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:23.086644 (+   203us) service_pool.cc:224] Handling call
0709 13:15:23.087027 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:25.062155 (+1975128us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54001efda0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abd1dc0 00007f273ac5c1c0 00007f273ac5d231 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c
0709 13:15:26.664140 (+1601985us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b580050f6d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:15:28.026067 (+1361927us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001efda0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abcfa1d 00007f273abb61a4 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419
0709 13:15:28.558463 (+532396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.571691 (+ 13228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442899456}
I20260709 13:15:28.582603 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:28.586733  1126 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:28.586979 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:28.589357  1617 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:15:28.589788 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:28.590731 31605 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:28.592990  1623 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.213s	user 0.004s	sys 0.000s
I20260709 13:15:28.593765  1407 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.594151 30951 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:28.594604 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 215758us
I20260709 13:15:28.594859 31599 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:28.595557 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:28.597210 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:28.598942  1498 consensus_meta.cc:287] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.005s
I20260709 13:15:28.599891  1578 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.600061 31602 raft_consensus.cc:2410] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:28.600481  1578 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.601125 31605 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:28.613893 30956 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:28.614785  1208 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:28.615931 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:28.620270 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:28.586200  1610 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:28.625837 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 343979us
W20260709 13:15:28.626840 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 73599us
I20260709 13:15:28.627471 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:28.627745 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:28.628044  1610 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:28.628687 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 616) took 1490 ms. Trace:
I20260709 13:15:28.626055  1605 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:28.617885  1043 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:28.640983 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 43867.7us
I20260709 13:15:28.641515  1448 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:15:28.642343 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:28.643936 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 615) took 1507 ms. Trace:
I20260709 13:15:28.644474 30957 rpcz_store.cc:276] 0709 13:15:27.117674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.419345 (+301671us) service_pool.cc:224] Handling call
0709 13:15:27.423096 (+  3751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.201001 (+777905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.201054 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.229980 (+ 28926us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.397279 (+167299us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.397333 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.415081 (+ 17748us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.592152 (+177071us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:28.602572 (+ 10420us) raft_consensus.cc:1685] finished
0709 13:15:28.602594 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.624886 (+ 22292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604473,"raft.queue_time_us":838858,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":266,"spinlock_wait_cycles":33027456,"thread_start_us":301790,"threads_started":2,"wal-append.queue_time_us":149470}
I20260709 13:15:28.642617  1498 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:28.648547 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:28.629076 30949 rpcz_store.cc:276] 0709 13:15:27.118031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.040795 (+922764us) service_pool.cc:224] Handling call
0709 13:15:28.041402 (+   607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.121236 (+ 79834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:28.121888 (+   652us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.168948 (+ 47060us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.349335 (+180387us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:28.349373 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.349438 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.602500 (+253062us) raft_consensus.cc:1685] finished
0709 13:15:28.602518 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.608064 (+  5546us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":220765,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"thread_start_us":151688,"threads_started":2,"wal-append.queue_time_us":253710}
I20260709 13:15:28.656642  1094 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.657714  1482 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.657732  1448 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:28.658486  1448 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:28.659583  1448 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:28.666313  1043 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:28.666857  1043 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.667263  1043 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:28.668219  1592 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:28.668938  1592 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:28.670321  1592 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:28.672246 30847 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 1.575s (SENT)
I20260709 13:15:28.672948 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:28.674777  1353 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:28.674921 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.677825  1353 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:28.678337  1628 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.679085  1353 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:28.679525  1628 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:28.679980  1628 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:28.680590 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 944) took 1430 ms. Trace:
I20260709 13:15:28.681102 31602 rpcz_store.cc:276] 0709 13:15:27.250630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.265771 (+ 15141us) service_pool.cc:224] Handling call
0709 13:15:28.680276 (+1414505us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54004deed4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:28.680495 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949910784}
I20260709 13:15:28.679544  1353 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:28.682916  1353 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:28.684360  1353 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.686772  1581 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:28.687239  1581 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:28.650509  1498 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:28.688334  1498 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:28.688292  1581 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.634083  1605 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:28.693251  1605 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:28.694443  1578 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.694686 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.677428  1259 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.771373  1563 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.772157  1563 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:28.774156  1557 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 2.352s	user 0.005s	sys 0.015s
I20260709 13:15:28.778527 31029 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:28.771402  1498 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.717927 30958 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:28.727308  1475 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:28.731050  1438 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.735208  1208 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.735671  1308 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.829181 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1897) took 2141 ms. Trace:
I20260709 13:15:28.830304 31029 rpcz_store.cc:276] 0709 13:15:26.681890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.161297 (+1479407us) service_pool.cc:224] Handling call
0709 13:15:28.777911 (+616614us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:28.778169 (+   258us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:28.822984 (+ 44815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.823299 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34591616}
I20260709 13:15:28.823465  1475 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:28.836189  1475 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:28.841082  1580 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.841600  1043 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.843079  1464 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.845701  1308 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.846668  1462 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.846417  1308 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:28.857219  1571 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 2.493s	user 0.008s	sys 0.021s
I20260709 13:15:28.774880  1563 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:28.861128 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 137076us
I20260709 13:15:28.864476 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:28.868000 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1554) took 3998 ms. Trace:
I20260709 13:15:28.868861 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:28.680985  1628 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:28.870540 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 242933us
I20260709 13:15:28.855824  1448 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.868554 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:28.869858 31028 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.868528 30952 rpcz_store.cc:276] 0709 13:15:24.865137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:25.077329 (+212192us) service_pool.cc:224] Handling call
0709 13:15:25.077681 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:25.471158 (+393477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:25.471192 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:25.483903 (+ 12711us) log.cc:844] Serialized 26 byte log entry
0709 13:15:26.375729 (+891826us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:26.375807 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:26.376149 (+   342us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:28.850153 (+2474004us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:28.858405 (+  8252us) raft_consensus.cc:1685] finished
0709 13:15:28.858428 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:28.863489 (+  5061us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":214860,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":27623,"spinlock_wait_cycles":408298752,"thread_start_us":1187451,"threads_started":2,"wal-append.queue_time_us":849631}
I20260709 13:15:28.874152 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:28.876750 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 204709us
I20260709 13:15:28.876999 31601 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:28.860906  1498 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:28.884160 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 330113us
W20260709 13:15:28.888413 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 246250us
I20260709 13:15:28.890419 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:28.902879 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:28.905402 30881 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:28.906831 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:28.895274  1043 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.911928  1628 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:28.918258 30957 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:28.923063 31571 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:28.908465  1259 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:28.907941  1340 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.916258  1308 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:28.937340 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.941154 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:28.942808  1627 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.944715  1499 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:28.945205  1499 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.945607  1499 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:28.948518 31602 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:28.952559 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.953881 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.955265 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.956269 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:28.956725 31031 raft_consensus.cc:2376] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5. Re-sending same reply.
I20260709 13:15:28.957472 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:28.963982 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:28.965399 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:28.965934 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:28.966204  1464 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.967957  1577 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.968658  1577 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:28.972062  1610 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:28.975291  1496 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:28.977156  1417 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:28.977769  1417 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.978207  1417 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:28.980193 30780 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.983032 30780 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:28.985364 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:28.986930  1613 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.730s	user 0.003s	sys 0.000s
I20260709 13:15:28.987217 30957 raft_consensus.cc:2410] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:28.941884 31601 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:28.996083  1553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.424s	user 0.014s	sys 0.024s
W20260709 13:15:29.000801 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64109.4us
W20260709 13:15:29.001874 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 100272us
I20260709 13:15:29.006817 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.007951 30958 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:29.006763 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:29.008219 30780 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 3, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 3 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:29.010511 30780 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.011200  1562 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:29.012274 30956 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:29.013136  1484 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:29.013550  1484 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:29.014827 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1900) took 2288 ms. Trace:
I20260709 13:15:29.016755  1340 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.018484  1526 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.019209  1340 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.020138 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.020681  1577 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.020828 30949 raft_consensus.cc:2376] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7. Re-sending same reply.
I20260709 13:15:29.011088 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:29.021822 31027 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:29.008900  1590 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:29.023089 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.024052 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.023108 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.024816 30880 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:29.023241 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.025786 30877 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:29.025784 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.026626 30957 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:29.012169  1562 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:29.027560  1562 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:29.028091  1562 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:29.028851  1488 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.029111  1562 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:29.030076  1634 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:15:29.030815  1535 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.015239 31025 rpcz_store.cc:276] 0709 13:15:26.726801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.264874 (+1538073us) service_pool.cc:224] Handling call
0709 13:15:29.013910 (+749036us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:29.014146 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.014436 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.014464 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.014516 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:29.014551 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.014607 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.014708 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21888384}
I20260709 13:15:29.026876 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.031744 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.032743 30956 raft_consensus.cc:2376] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6. Re-sending same reply.
I20260709 13:15:29.033690 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:29.034446 31032 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:29.034533 30780 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 4 to 6, term changed from 2 to 6, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:29.014501  1484 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:29.036332 31027 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:29.036885  1440 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:29.037431  1440 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:29.036943 30780 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.038408 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:29.039170 31570 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:29.032137 30958 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
W20260709 13:15:29.040189 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 74879.9us
I20260709 13:15:29.041106  1353 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:29.041038 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.026700  1363 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.031262  1562 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.042637  1363 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:29.041649  1353 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.044561  1353 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.041071  1581 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:29.046312  1550 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 2.627s	user 0.019s	sys 0.023s
I20260709 13:15:29.042102 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.036399  1484 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:29.048378 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:29.048929  1496 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:29.049508 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.050732  1496 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:29.051002 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.052075  1496 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.053826 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:29.054446 31604 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.055678 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:29.056030  1619 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.592s	user 0.000s	sys 0.002s
I20260709 13:15:29.056329 30881 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.060195 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:29.060586  1568 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 2.660s	user 0.006s	sys 0.013s
I20260709 13:15:29.060997 30882 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
W20260709 13:15:29.062481  1604 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.600s	user 0.003s	sys 0.000s
I20260709 13:15:29.062709 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.063892 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 614) took 1981 ms. Trace:
I20260709 13:15:29.064239 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.064993 30880 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:29.064263 30950 rpcz_store.cc:276] 0709 13:15:27.082520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:27.243210 (+160690us) service_pool.cc:224] Handling call
0709 13:15:27.244657 (+  1447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:27.316036 (+ 71379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:27.316067 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:27.322170 (+  6103us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.267427 (+945257us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:28.267487 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.267573 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.061801 (+794228us) spinlock_profiling.cc:243] Waited 52.1 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:29.063586 (+  1785us) raft_consensus.cc:1685] finished
0709 13:15:29.063611 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.063837 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5224,"raft.queue_time_us":10453,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11213,"spinlock_wait_cycles":119930112,"thread_start_us":770953,"threads_started":1,"wal-append.queue_time_us":1020306}
I20260709 13:15:29.029036  1475 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.068317 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.068475 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.069144 30878 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:29.069979  1475 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:29.027499 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.072801 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:29.076848 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 62051.7us
I20260709 13:15:29.078356 30958 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
W20260709 13:15:28.998454  1553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.553s	user 0.014s	sys 0.025s
I20260709 13:15:29.086865 30881 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:29.088799 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.088927 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.095257 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.100591 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.095927 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.097095 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:29.102473 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.096006 31596 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:29.108009 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:29.110355 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:29.114171 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.114296 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:29.001504  1605 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.111831 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.120618 30950 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:29.120452 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.123983 31600 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:29.106314 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 223062us
I20260709 13:15:29.141088 31602 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:29.142650 31031 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:29.148439 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.148762 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.149770 30956 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:29.149978 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.088135  1553 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:29.091248  1441 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.148380 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.141575 31602 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:29.158850 31571 leader_election.cc:400] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8.
I20260709 13:15:29.159209 31571 leader_election.cc:403] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:29.165546 30879 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:29.153056 31598 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
I20260709 13:15:29.140324 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.193357 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.194662 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:29.196391 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 89659.4us
I20260709 13:15:29.207115 31026 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:29.208019 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:29.211086 30847 leader_election.cc:336] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 1.824s (SENT)
W20260709 13:15:29.211758 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45367.5us
W20260709 13:15:29.209481 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55813.2us
I20260709 13:15:29.215386 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.038410  1440 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.208756 31597 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:29.206907  1441 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:29.221861 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:29.222200 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.222965 30879 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:29.210697 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.213471 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.167306 30780 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 5, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.232642 31025 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:29.233459 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 512) took 2480 ms. Trace:
I20260709 13:15:29.233541  1499 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.233902 31025 rpcz_store.cc:276] 0709 13:15:26.753304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.231953 (+2478649us) service_pool.cc:224] Handling call
0709 13:15:29.232397 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.233170 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.233401 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.229633 31031 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:29.224437 30950 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:29.262450 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1899) took 2539 ms. Trace:
I20260709 13:15:29.190547  1627 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8.
I20260709 13:15:29.267536 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.267642 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.262979 31026 rpcz_store.cc:276] 0709 13:15:26.723059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.230588 (+1507529us) service_pool.cc:224] Handling call
0709 13:15:29.035064 (+804476us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:29.035314 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.212823 (+177509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.262165 (+ 49342us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400347454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:29.262379 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436022912}
I20260709 13:15:29.266144  1356 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.258744 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1898) took 2566 ms. Trace:
W20260709 13:15:29.273430 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 183641us
I20260709 13:15:29.219223  1340 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.276711 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:29.287420 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 65645.7us
I20260709 13:15:29.296690 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.151458  1553 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.273895 31030 rpcz_store.cc:276] 0709 13:15:26.692199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.179302 (+1487103us) service_pool.cc:224] Handling call
0709 13:15:28.462823 (+283521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:28.463979 (+  1156us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:28.620117 (+156138us) log.cc:844] Serialized 14 byte log entry
0709 13:15:28.889226 (+269109us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:28.901336 (+ 12110us) log.cc:844] Serialized 26 byte log entry
0709 13:15:28.901662 (+   326us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:28.901722 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:28.901836 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.258462 (+356626us) raft_consensus.cc:1685] finished
0709 13:15:29.258487 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.258667 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3057,"prepare.queue_time_us":217955,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":3831,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":2220,"spinlock_wait_cycles":11648,"thread_start_us":354613,"threads_started":2,"wal-append.queue_time_us":303190}
I20260709 13:15:29.318347 30878 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:29.318655 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.320451 30882 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:29.325086 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.191392  1592 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:15:29.328917 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:29.311542  1636 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:15:29.297673  1475 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.307749 31602 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.345362 31030 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:15:29.323638  1440 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:29.356112  1463 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.369134 31600 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:29.370925 31602 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.332501  1464 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:29.368009 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2442) took 2475 ms. Trace:
I20260709 13:15:29.373279 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.380285 30952 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:29.377174 31031 rpcz_store.cc:276] 0709 13:15:26.892719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.276588 (+2383869us) service_pool.cc:224] Handling call
0709 13:15:29.344298 (+ 67710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.367638 (+ 23340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.367665 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.367716 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.367751 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.367845 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.367953 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:29.388862 30875 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:29.390858 31604 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:29.391937 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.395424 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.396011 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.310969  1626 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:15:29.399171 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.307263  1356 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:29.377061 30780 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 3 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:29.417622 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 53409.8us
W20260709 13:15:29.418875 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 252313us
I20260709 13:15:29.367058  1463 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:29.423290 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 113404us
I20260709 13:15:29.370004  1353 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.426654  1640 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.414876 31029 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:29.435173 31031 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:15:29.436075 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 169055us
I20260709 13:15:29.448184 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.438606  1535 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.450969  1535 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:29.452379  1464 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:29.454118  1346 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:29.454583  1346 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:29.456514  1535 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:29.456874 31031 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:29.368672  1475 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.457806  1528 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.458702 30883 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:29.457610 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:29.441496 31571 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:29.472040 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.481818 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.472730 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.474929 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:29.426702  1441 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:29.436542  1463 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.495184  1159 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:15:29.505717  1437 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:29.494139 31032 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:29.477697 30780 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 6, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 6 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:29.497318 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.460273  1627 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:29.502411 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.511158 30877 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:29.503343 31031 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:15:29.507297 30951 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:29.495465  1528 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:29.518761  1417 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.001s
I20260709 13:15:29.520598 30949 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:29.519999 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 251897us
I20260709 13:15:29.456902  1356 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:29.509730 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52205.5us
I20260709 13:15:29.520380 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.512250 31031 pending_rounds.cc:85] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 3
W20260709 13:15:29.528450 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 46975.9us
W20260709 13:15:29.508409 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1910) took 1447 ms (client timeout 1826 ms). Trace:
W20260709 13:15:29.542635 31032 rpcz_store.cc:269] 0709 13:15:28.061143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.149068 (+ 87925us) service_pool.cc:224] Handling call
0709 13:15:29.033610 (+884542us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35f8c 00007f2737b35ef6 0000000000375939 00007f273fba91e0 00007f273fc720c4 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:29.508318 (+474708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5772032}
I20260709 13:15:29.495362  1353 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.530006 31031 pending_rounds.cc:107] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:29.569031 31031 raft_consensus.cc:2889] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:29.570684 31570 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.800s (SENT)
I20260709 13:15:29.571686 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:29.572353 30951 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:15:29.571714 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 130299us
I20260709 13:15:29.510636  1605 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.519902  1498 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:15:29.605170 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64781.7us
I20260709 13:15:29.535497  1535 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:29.532593 30780 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 5 to 7, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131), pending config changed. New cstate: current_term: 7 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: NON_VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:29.660795 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.560914  1562 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:29.558706  1627 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:29.664096 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 83497.6us
W20260709 13:15:29.668097 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49674.6us
W20260709 13:15:29.669482 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 133961us
I20260709 13:15:29.671062 31603 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:29.455722  1346 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.521725  1417 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:29.683386 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 74751us
W20260709 13:15:29.683682 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.684170 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:29.684993 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:29.685664 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:29.686635  1389 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:29.687217 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.692850 31596 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:29.694094 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:29.694923 31028 consensus_meta.cc:287] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.813s	user 0.015s	sys 0.003s
I20260709 13:15:29.688282 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.695286 31028 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:29.696399  1346 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.698071 31026 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:29.689121 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:29.699445 31598 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:29.614845  1535 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:29.700791  1535 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:29.702456  1535 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.705281  1475 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:29.706077  1475 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:29.706513  1475 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:29.706943  1475 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:29.717537 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:29.718236 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:29.685681 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 202074us
I20260709 13:15:29.601832  1356 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:29.724154 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 519) took 1292 ms (client timeout 1624 ms). Trace:
W20260709 13:15:29.724804 31028 rpcz_store.cc:269] 0709 13:15:28.434101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.863910 (+429809us) service_pool.cc:224] Handling call
0709 13:15:29.721204 (+857294us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:29.729136 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50563.6us
I20260709 13:15:29.731978 31602 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:15:29.732846 31602 pending_rounds.cc:85] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 6
I20260709 13:15:29.733351 31602 pending_rounds.cc:107] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:15:29.733860 31602 raft_consensus.cc:2889] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:29.736338 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:29.726471 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:29.565302  1626 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 13:15:29.750299 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:29.657099  1159 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:29.740101 30780 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:29.744411  1363 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:29.572184  1640 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.765002  1488 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.770008  1437 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:29.780241  1441 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:15:29.780295  1159 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:29.799782 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.793051 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:29.789446  1484 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.016s
W20260709 13:15:29.809530 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 132080us
I20260709 13:15:29.728273  1356 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:29.746316  1353 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.066s
W20260709 13:15:29.818550 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:29.820781 30882 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:29.794133  1488 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:29.800426  1437 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:29.806730  1441 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:29.794554 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2443) took 2721 ms. Trace:
I20260709 13:15:29.812500  1438 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:29.786468  1382 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:15:29.830669  1645 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:29.841951  1159 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:29.832126 31023 rpcz_store.cc:276] 0709 13:15:27.073154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.269043 (+2195889us) service_pool.cc:224] Handling call
0709 13:15:29.330709 (+ 61666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.348382 (+ 17673us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:29.396930 (+ 48548us) log.cc:844] Serialized 14 byte log entry
0709 13:15:29.794175 (+397245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:29.794227 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:29.794270 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.794351 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.794490 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45763,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":534,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2597,"thread_start_us":333077,"threads_started":1}
I20260709 13:15:29.845146 31025 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:29.854568  1518 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:29.857983  1640 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:29.831444  1441 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:29.858807  1640 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:29.859318  1640 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:29.829342  1627 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.859723  1441 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:29.861013  1441 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:29.847576 30780 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 5 to 6, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 6 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.828147  1488 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:29.830726  1437 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:29.862668 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.873199 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:29.877767  1643 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.381s	user 0.001s	sys 0.001s
I20260709 13:15:29.863356  1640 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:29.938876 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 253252us
I20260709 13:15:29.901552  1382 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:29.924886  1440 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.007s
I20260709 13:15:29.949025 30780 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 3, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 3 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.888103  1484 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:15:29.862360  1438 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:29.957808 30950 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
I20260709 13:15:29.959789 31599 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:29.886628  1592 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:15:29.952984  1581 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.908s	user 0.004s	sys 0.016s
I20260709 13:15:29.973171 30950 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:29.947409  1417 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.012336 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1746) took 1627 ms. Trace:
I20260709 13:15:30.013123  1043 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:30.013550  1043 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:30.014407  1043 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.016134 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:30.016458 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 513) took 3262 ms. Trace:
I20260709 13:15:30.016983 30955 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:30.008394 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2448) took 2884 ms. Trace:
I20260709 13:15:30.022096 31026 rpcz_store.cc:276] 0709 13:15:27.123708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.290017 (+2166309us) service_pool.cc:224] Handling call
0709 13:15:29.697844 (+407827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.698621 (+   777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.008179 (+309558us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54003773d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:30.008334 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833699712}
I20260709 13:15:30.023309 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.024490 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.016856 31025 rpcz_store.cc:276] 0709 13:15:26.753549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.234873 (+2481324us) service_pool.cc:224] Handling call
0709 13:15:29.844973 (+610100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.854491 (+  9518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.016271 (+161780us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54001b1cd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:30.016401 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402014080}
I20260709 13:15:30.026285 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.026898 31025 raft_consensus.cc:2368] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
W20260709 13:15:29.984345  1644 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:15:29.985347  1438 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:29.971295  1496 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:29.989253 30949 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:29.989187 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:29.990558  1356 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:29.991689 31023 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:29.992493 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1903) took 3095 ms. Trace:
I20260709 13:15:29.992959  1159 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:29.992673 30780 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 6, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:29.993466 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.056486 31028 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:29.993757 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.994459 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:29.995663 31024 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:29.996232 30957 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:30.000773 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:29.983651  1382 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.006103  1499 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.007236  1528 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.059409 31027 rpcz_store.cc:276] 0709 13:15:26.896780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.266802 (+2370022us) service_pool.cc:224] Handling call
0709 13:15:29.298005 (+ 31203us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:29.346708 (+ 48703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.346744 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:29.364904 (+ 18160us) log.cc:844] Serialized 52 byte log entry
0709 13:15:29.635466 (+270562us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:29.635884 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.636028 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:29.992290 (+356262us) raft_consensus.cc:1685] finished
0709 13:15:29.992310 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:29.992437 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":948,"raft.queue_time_us":3720,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":20009,"thread_start_us":216171,"threads_started":1,"wal-append.queue_time_us":566178}
W20260709 13:15:30.008352  1647 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:15:30.008430  1448 consensus_meta.cc:287] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.131s	user 0.021s	sys 0.004s
I20260709 13:15:30.009406 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 518) took 1656 ms. Trace:
I20260709 13:15:30.073169 31030 rpcz_store.cc:276] 0709 13:15:28.412388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.316038 (+903650us) service_pool.cc:224] Handling call
0709 13:15:29.335071 (+ 19033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.350127 (+ 15056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.009122 (+658995us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b5400146c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:30.009348 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14038784}
I20260709 13:15:30.027596 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:30.031939 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56592.6us
W20260709 13:15:30.033407 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 227676us
I20260709 13:15:30.039551 30951 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
W20260709 13:15:30.040704 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 356584us
I20260709 13:15:30.012739 30876 rpcz_store.cc:276] 0709 13:15:28.384998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.388791 (+  3793us) service_pool.cc:224] Handling call
0709 13:15:28.389085 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.044151 (+655066us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800461c20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac52bfb 00007f273ac5d64b
0709 13:15:29.044321 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.044346 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.044870 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.196445 (+151575us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.196486 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.196555 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.012033 (+815478us) raft_consensus.cc:1685] finished
0709 13:15:30.012050 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.012254 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14139,"raft.queue_time_us":45838,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":144640,"spinlock_wait_cycles":11614080,"thread_start_us":198068,"threads_started":2,"wal-append.queue_time_us":303218}
I20260709 13:15:30.056733 30780 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.062481 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:30.063134 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 74064us
I20260709 13:15:30.015728  1043 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:30.080063 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.081854 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.081344 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 361741us
I20260709 13:15:30.084563 31028 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:30.087689 31031 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:15:30.089627 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 274245us
I20260709 13:15:30.093501 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:30.072598  1356 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:30.097529 31571 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.043221  1488 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.107980 31023 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:30.100873 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:30.042006  1437 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.100518 31599 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:30.085273  1417 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:30.130427 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46242us
I20260709 13:15:30.132020 31605 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.134755 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.135402 31597 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.133502 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:30.134958 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.067988  1159 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.100062  1581 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:30.145229 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:30.148307 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 66881.2us
W20260709 13:15:30.149447 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 148758us
W20260709 13:15:30.153847 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45046.5us
W20260709 13:15:30.155529 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 67100.4us
I20260709 13:15:30.167440 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:30.165097 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:30.169480 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:30.140554  1356 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:30.175493 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.143566  1626 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.150478  1353 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:30.147297  1581 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.185580 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:30.186560 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.187664 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1755) took 1114 ms. Trace:
I20260709 13:15:30.170257  1496 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.211011  1389 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:30.212199 31571 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:30.204734 30880 rpcz_store.cc:276] 0709 13:15:29.072749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.073815 (+  1066us) service_pool.cc:224] Handling call
0709 13:15:29.074135 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.074808 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.074850 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.075322 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:15:29.341249 (+265927us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:29.341299 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:29.341369 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.187363 (+845994us) raft_consensus.cc:1685] finished
0709 13:15:30.187397 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.187581 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":265504,"threads_started":1,"wal-append.queue_time_us":753533}
I20260709 13:15:30.193497  1528 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.180853 30924 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.222045  1382 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.207506  1259 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:30.209889  1581 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.208911  1438 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:30.249927 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46616.4us
W20260709 13:15:30.218887 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 43480us
I20260709 13:15:30.194312  1498 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:15:30.249466  1528 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.264091  1382 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:30.255240  1259 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:30.274047  1528 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.279783 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.274825  1437 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.275714 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.259934  1496 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:30.274439  1423 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:15:30.258852  1669 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:30.274335  1661 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:30.248126  1665 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:30.315263 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 146584us
I20260709 13:15:30.316279 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 630) took 1094 ms. Trace:
W20260709 13:15:30.361409 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.361959 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.246531  1626 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:15:30.358345 30956 rpcz_store.cc:276] 0709 13:15:29.221838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.221969 (+   131us) service_pool.cc:224] Handling call
0709 13:15:29.259373 (+ 37404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:29.321396 (+ 62023us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:29.561646 (+240250us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.315920 (+754274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:30.315974 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:30.316018 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.316086 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.316219 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":516634,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":15466,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":865891,"threads_started":3,"wal-append.queue_time_us":540663}
I20260709 13:15:30.389097 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:30.357556  1535 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.000s
I20260709 13:15:30.322975  1496 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:30.318670 31026 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:30.319439 31603 raft_consensus.cc:2368] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9.
I20260709 13:15:30.276863 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.328573 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:30.280339  1668 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:15:30.331275 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69849us
I20260709 13:15:30.400555 31602 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:30.330569  1661 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:30.405202 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.392251  1592 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:30.310657  1673 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:15:30.406459 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.400166  1496 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.409096 31599 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:30.405599 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 223135us
I20260709 13:15:30.413844 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:30.407533 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 131900us
I20260709 13:15:30.395838  1382 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:30.419816 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 59586.2us
I20260709 13:15:30.421643 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.424813 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.421730 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:30.423152 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:30.413291 30922 leader_election.cc:336] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 1.506s (SENT)
I20260709 13:15:30.424306 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.426054 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.403649  1627 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.427202 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.429832 31602 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:30.405158  1661 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.407601  1553 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:30.428722 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.362033  1356 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.406314  1678 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.431970  1484 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.432452 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.450012 31602 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:30.406962  1488 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.413194  1592 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:30.425187  1463 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.889s	user 0.009s	sys 0.004s
I20260709 13:15:30.456642 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.422322  1535 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.414336  1353 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:30.436337 31599 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:30.428197 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 229753us
I20260709 13:15:30.451840 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.452984 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.479856 31605 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:30.480005 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.446866 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.389981  1665 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.450924 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.456545  1592 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:30.477722 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.457309 31031 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:30.519408  1535 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:30.457926  1664 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:15:30.520494 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.521548 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.522096 31031 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:30.432403  1382 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.482221  1686 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:30.459565  1553 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.523350  1686 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:30.524297  1686 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:30.484242  1676 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:15:30.526117 31029 raft_consensus.cc:2376] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6. Re-sending same reply.
I20260709 13:15:30.527336 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:30.484866  1671 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:15:30.451844  1681 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:30.487602 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.531263  1528 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:30.491499  1640 consensus_meta.cc:287] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.001s
I20260709 13:15:30.433245  1259 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.532064 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.532675  1640 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.533079 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.533422  1528 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.533619 31029 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:30.534484 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.534641  1640 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.434099  1627 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.536150 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.537154  1438 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:30.434128  1610 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:15:30.537649  1438 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.456095  1484 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.540167  1484 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:30.496176  1667 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 13:15:30.520519 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.541869 31026 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:30.542594 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.543098 31026 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:30.498291  1688 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:30.522856 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:30.545019  1674 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:15:30.545068 31031 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:30.545918 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.548784  1553 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.550705  1496 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.552074  1627 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.535566 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.553004 31029 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
W20260709 13:15:30.498699  1475 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.001s
I20260709 13:15:30.500531 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 954) took 1039 ms. Trace:
I20260709 13:15:30.561755 31604 rpcz_store.cc:276] 0709 13:15:29.460978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.479156 (+ 18178us) service_pool.cc:224] Handling call
0709 13:15:29.505155 (+ 25999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.541920 (+ 36765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.541964 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.633368 (+ 91404us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.200799 (+567431us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:30.200847 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.200917 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.500262 (+299345us) raft_consensus.cc:1685] finished
0709 13:15:30.500285 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.500439 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24319,"raft.queue_time_us":33694,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":98966,"thread_start_us":464994,"threads_started":1,"wal-append.queue_time_us":763481}
I20260709 13:15:30.500737  1353 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:30.501174 30923 leader_election.cc:336] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.506s (SENT)
I20260709 13:15:30.501746  1626 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.503054 31597 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:30.496206 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:30.503893 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 68841.9us
I20260709 13:15:30.504243 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.507601 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.572201 31030 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:30.507892 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.476527  1463 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.450928  1678 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.509757  1562 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.511725 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:30.512745 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:30.582317 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.513478 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.431655  1499 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.516361 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.517597 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:30.515391  1581 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.518800  1441 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:30.480829 31028 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:30.519404 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 623) took 2201 ms (client timeout 1599 ms). Trace:
I20260709 13:15:30.484072 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:30.587512 30953 rpcz_store.cc:269] 0709 13:15:28.317501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:28.411953 (+ 94452us) service_pool.cc:224] Handling call
0709 13:15:30.519147 (+2107194us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54000cfdd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:30.519302 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4379323648}
I20260709 13:15:30.537249 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.481047 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:30.568874 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 138302us
I20260709 13:15:30.569078 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 955) took 1087 ms. Trace:
I20260709 13:15:30.577122 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.577836 31024 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:30.589774 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:30.579806 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 78637.3us
I20260709 13:15:30.585294 31025 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:30.590338 31597 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:30.586700 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.590911 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.591076 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:30.530313  1677 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:15:30.591472 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.589089 31600 rpcz_store.cc:276] 0709 13:15:29.481881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.499819 (+ 17938us) service_pool.cc:224] Handling call
0709 13:15:29.524940 (+ 25121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.806847 (+281907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.806877 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.817654 (+ 10777us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.208221 (+390567us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:30.208280 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.208371 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.544302 (+335931us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:30.553741 (+  9439us) raft_consensus.cc:1685] finished
0709 13:15:30.553760 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.569012 (+ 15252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4667,"raft.queue_time_us":70894,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":43338,"spinlock_wait_cycles":4530432,"thread_start_us":616561,"threads_started":2,"wal-append.queue_time_us":564350}
I20260709 13:15:30.592715 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.591323 31604 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:30.589299 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:30.596621 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:30.576735  1440 raft_consensus.cc:2764] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:15:30.599282 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.568892  1681 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:30.569823  1627 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:30.619364 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.620990 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:30.581652  1562 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:30.598233  1610 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:30.629675 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 112120us
I20260709 13:15:30.631083 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:30.634600 30922 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.577123  1475 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:30.636679 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 210677us
I20260709 13:15:30.578774  1438 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.638547 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.639374 30847 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.617569  1626 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.579680  1661 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.588937  1669 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:30.656994 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:30.647634 30847 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.621695  1423 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.621879  1628 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.646399  1535 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.650151  1689 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.650205  1208 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:30.651031  1438 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.651360 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.652624  1484 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:30.623461  1528 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.661938  1693 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.662032  1681 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.663741  1678 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.664147  1475 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:30.664840  1666 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:30.635998  1627 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.666129  1688 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.666208 30953 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:30.668027 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 55922.6us
I20260709 13:15:30.604471  1499 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.658214  1662 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.640296  1610 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:30.692212 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44670.2us
I20260709 13:15:30.710752 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.689520  1689 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.721680 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.722236 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:30.679378 31596 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:30.722697 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.686445  1628 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.691550 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:30.722447  1689 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.598305  1592 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.744452  1689 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:30.744943  1592 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.723937 30951 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:30.746642 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:30.747315 31596 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:30.747519  1689 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:30.748068  1689 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:30.748471 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:30.748588  1689 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.749948 30882 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:30.751022 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.752197  1628 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.701732  1208 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:30.752650  1475 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:30.753211  1475 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:30.753401  1208 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.754242  1475 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.713810 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 966) took 1028 ms. Trace:
I20260709 13:15:30.692291 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:30.710157 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.691269  1484 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:30.698335  1651 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.066s	user 0.007s	sys 0.000s
I20260709 13:15:30.694720  1661 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.759218  1628 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:30.759886  1628 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:30.759804  1441 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:30.714851  1685 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.267s	user 0.003s	sys 0.000s
I20260709 13:15:30.760944  1628 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.761570  1259 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.762809 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1921) took 1511 ms. Trace:
I20260709 13:15:30.759248  1484 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.764274 31600 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.765429  1553 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:30.686694 30880 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:30.727972 31603 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:30.725737  1605 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.767328  1605 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.768509 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.769410  1627 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:30.769687 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.706058  1389 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:30.770447  1389 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.724457  1417 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.771944  1417 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:30.772946 31603 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:30.772859  1417 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.773983  1417 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.693050 30883 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.735970  1499 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.776847  1665 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.705425  1463 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.777518  1437 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:30.763267 31032 rpcz_store.cc:276] 0709 13:15:29.251097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.543854 (+292757us) service_pool.cc:224] Handling call
0709 13:15:30.019858 (+476004us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:30.020309 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:30.020339 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:30.020921 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:15:30.260081 (+239160us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:30.260138 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.260235 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.714081 (+453846us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:30.761741 (+ 47660us) raft_consensus.cc:1685] finished
0709 13:15:30.761764 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.762612 (+   848us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400146c50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:30.762740 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1271,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":1102714496,"thread_start_us":238755,"threads_started":1,"wal-append.queue_time_us":382147}
I20260709 13:15:30.778376  1437 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.717437 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.708822 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.734735 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.722791 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.701862  1496 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.756795 31598 rpcz_store.cc:276] 0709 13:15:29.685900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:29.711245 (+ 25345us) service_pool.cc:224] Handling call
0709 13:15:29.711665 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:29.711974 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:29.712010 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:29.712679 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:15:30.099758 (+387079us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:30.135328 (+ 35570us) log.cc:844] Serialized 14 byte log entry
0709 13:15:30.144464 (+  9136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:30.144573 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:30.522139 (+377566us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b18004c21c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:30.529622 (+  7483us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:30.713549 (+183927us) raft_consensus.cc:1685] finished
0709 13:15:30.713577 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:30.713737 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23324,"prepare.queue_time_us":34576,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":15861,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":12595,"spinlock_wait_cycles":44578432,"thread_start_us":386144,"threads_started":1,"wal-append.queue_time_us":515972}
I20260709 13:15:30.737741  1688 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.704095  1581 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.701309  1562 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.782807 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.783303  1562 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.784296 30883 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.784556  1463 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.785938  1437 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:30.679620 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 52667us
I20260709 13:15:30.786799  1463 consensus_queue.cc:1059] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:30.727394  1662 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.787971  1448 raft_consensus.cc:3055] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:30.788385  1448 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:30.715991  1669 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.789162  1448 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:30.789785  1662 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.724965 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:30.731087  1610 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:30.751577 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.706583  1697 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:30.757601 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65394.4us
I20260709 13:15:30.761417 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.799121 31601 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.769778  1605 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:30.787406  1553 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:30.741096 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.735677 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:30.800556 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 64971us
I20260709 13:15:30.800802 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:30.803941 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 79072.2us
I20260709 13:15:30.804723 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:30.806114 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 176306us
I20260709 13:15:30.810515 31603 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:30.797749 31600 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:30.797966 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.695648  1159 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:30.791112  1356 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.820526 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:30.824554 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.827937 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.828320 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.803678  1697 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:30.823148  1528 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.849716 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.849970 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.850294 31598 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.848659 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.852115 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.853474 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.840291  1581 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:30.864087 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.856626 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:30.860626 30879 raft_consensus.cc:2368] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:30.861142 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.861369  1535 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:30.861796 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.862411  1678 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:30.862571 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.862430 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.897933 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.924316 31031 raft_consensus.cc:2410] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:30.891203 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.886263 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:30.889639 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.926072 31032 raft_consensus.cc:2410] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:15:30.846122  1159 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.884727 30878 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:30.888665 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.917084 31601 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
W20260709 13:15:30.893168 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 296648us
I20260709 13:15:30.840109  1437 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:15:30.920243 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.933265 31599 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:30.934103 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.923195 31030 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:30.916222 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.935395 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.935742 31028 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:30.847663  1697 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:30.935659 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:30.936930 31027 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.855782  1693 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:30.937718 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.942040 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:30.918478 31023 raft_consensus.cc:2376] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6. Re-sending same reply.
I20260709 13:15:30.938898 30922 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.939893 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:30.928301 31024 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:30.943792 31599 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:30.942008 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:30.945423 31603 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:30.946017 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 59849.2us
I20260709 13:15:30.947696 31025 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:30.946904 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:30.952975 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:30.953409 31570 leader_election.cc:400] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6.
I20260709 13:15:30.953797 31602 raft_consensus.cc:2410] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:30.954255 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:30.845924  1689 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:30.884495  1640 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:15:30.936829  1448 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:30.920519  1605 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:30.941720  1528 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:30.949162  1553 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:30.951269  1610 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:31.005167 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 148634us
W20260709 13:15:30.983654 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 121103us
W20260709 13:15:31.006654 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.013859 31027 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:31.009474 30875 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 7. Ops: []
I20260709 13:15:31.018322  1382 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.018211  1605 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.025566 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.915570  1673 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:15:30.948585  1488 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:15:31.040745 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.053459 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.069818 31025 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:31.031437 31028 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:31.046936 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.054605 31027 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:31.061326 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:31.074016  1701 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:15:30.998353  1535 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:31.074978  1698 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:15:31.077253  1389 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.081002 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.036237  1159 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:31.085162  1689 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:31.086555  1708 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:15:31.089154  1605 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.058414 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:31.093984  1675 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:31.094254 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.094993 31026 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:31.095938 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.998103  1441 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:15:31.099689 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.100063 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.100123 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.100771 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:30.992830  1686 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:15:31.101213 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.101356 30877 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:31.101461 30881 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.103761 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.105031 30874 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:31.083554  1159 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:31.107129 30875 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:31.106777  1159 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.005980  1681 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:31.108006  1681 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:31.108417  1681 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.109089 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:31.071439 31030 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:30.985463  1353 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:30.994840  1693 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:31.116210 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 169405us
I20260709 13:15:31.119154 31031 raft_consensus.cc:2368] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
I20260709 13:15:31.122867 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:31.111654 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:30.994169  1475 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:30.987673  1627 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.119948 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.125728 30874 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:31.126307 31600 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.127034 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:31.128858 31599 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:31.130043 31597 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:31.137153 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:31.139271 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.140969 30881 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:31.144336 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.145125 31031 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.079644  1389 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:31.128235  1647 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:31.046937  1463 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:15:31.024740  1610 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.149432 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:31.119524  1693 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:31.148491 30924 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:31.133342  1605 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.139660  1553 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.158500 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.160005  1693 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.162642  1356 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:31.163902  1703 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:31.164529  1703 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:31.165455  1703 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.167618  1610 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.152601  1340 consensus_queue.cc:1059] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:15:31.146451  1441 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:15:31.167903  1721 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.171789 31029 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:31.175065 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.175562 31598 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:31.176754 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.180063 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.180574 30880 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:31.181562 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.184413 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.187783 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.196576 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:31.197651 31598 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:15:31.215005 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 180373us
W20260709 13:15:31.217545 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 278714us
I20260709 13:15:31.182629  1356 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:31.219625 30922 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:31.220929 30997 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.678s (SENT)
I20260709 13:15:31.221572 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:31.224061 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 200604us
I20260709 13:15:31.225356 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:31.227972 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.228794 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:31.229526 31596 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.243552 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:31.275583 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 56015us
W20260709 13:15:31.315029 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.322414 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:31.323067 31598 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:31.325274 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.325910 30881 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:31.329224 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 108278us
I20260709 13:15:31.225005  1356 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:31.332473 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.337649 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:31.338461 30880 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.216339  1484 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.197322  1697 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.324839  1389 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:31.312649  1722 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:31.394143 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:31.312618  1499 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:15:31.328605  1721 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:31.398869 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.334462  1356 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.336189  1605 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.322337  1627 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:15:31.419463 30881 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:31.321003  1704 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:15:31.420413 30876 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:31.422441 31571 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:31.423527 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 180105us
I20260709 13:15:31.424326 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:31.424840 31571 leader_election.cc:400] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:31.425204 31571 leader_election.cc:403] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:31.420936  1423 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:31.440852 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.404600  1666 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.450546 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:31.425314  1496 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:31.425271  1389 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:31.456786 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.426548  1686 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:31.455497 30997 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.960s (SENT)
I20260709 13:15:31.453748 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:31.429350  1717 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:15:31.461932 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:31.444344  1481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.005s
I20260709 13:15:31.453207  1696 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:31.457422  1440 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:31.418720  1722 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.461125  1423 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:15:31.474448  1481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.005s	sys 0.005s
I20260709 13:15:31.482393 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.482735  1731 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:31.488713 30997 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.057s (SENT)
I20260709 13:15:31.489154 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:31.489215 30997 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:31.492939  1720 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:15:31.494051 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:31.496380  1581 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:31.496764  1581 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:31.497617  1581 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.498651  1681 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.460664  1662 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:15:31.481304  1499 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.502573 30880 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:31.483505  1423 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.483639  1496 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:31.487412  1696 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:31.503268 31571 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:31.456728  1666 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:31.506249  1718 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:15:31.522995 31031 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:31.486109  1389 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.504374  1440 raft_consensus.cc:2764] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:15:31.501617  1627 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:31.512651  1723 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:15:31.513425  1496 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:31.535815  1496 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.536126  1734 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:31.514492  1423 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.527562  1605 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:31.551471  1731 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:31.551448  1727 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:15:31.553125  1610 raft_consensus.cc:3055] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:31.555320  1666 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:31.542310  1704 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:15:31.557045  1722 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.566401  1696 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.571501 31596 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:31.578209 30997 leader_election.cc:336] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.231s (SENT)
W20260709 13:15:31.616215 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:31.579149 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 76114.9us
I20260709 13:15:31.615116 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:31.551448  1743 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:15:31.532594  1499 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:15:31.580657  1610 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:31.624049  1737 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:15:31.572557  1484 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.573686  1731 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:31.629472 30956 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:31.628369 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:31.588368  1728 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.632499 31605 raft_consensus.cc:2393] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:31.582005  1475 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:31.635336 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.588702  1627 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.615003  1682 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.616369  1697 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.567164  1693 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:31.640444 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 186789us
W20260709 13:15:31.643563 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 65373.8us
I20260709 13:15:31.575922  1496 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.645421 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.646062 30957 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.631865  1605 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.648450 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.649050 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.649672 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.649994 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.650673 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.652426 31031 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:31.631898  1666 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:31.638592  1475 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.653235 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.654011 30954 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.654888 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:31.639225  1728 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:31.653195  1448 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:15:31.645668  1682 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.640610  1739 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.660696 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.660795 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.656447 30950 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:31.673925 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.678406 31026 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:31.678644  1356 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:31.642076  1627 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.655953  1740 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.680245  1740 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.681104  1356 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:31.655812  1681 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.682214  1740 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:31.678478  1730 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:15:31.682166  1610 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.684019 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.684643 30954 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.684156  1731 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.684877  1693 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.685240  1731 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:31.674764  1666 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.686740  1692 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:31.687638  1666 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:31.657261 30951 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:31.689539 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 566755us
I20260709 13:15:31.690760 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:31.690956  1733 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:15:31.691880  1353 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:31.692833  1353 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.693499  1682 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.694291  1702 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:31.694768  1702 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:31.695111  1728 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:31.695835  1678 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.695720  1702 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.697310  1678 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:31.697516  1702 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:31.698575 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 549206us
I20260709 13:15:31.699319 30847 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:31.700606 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.701985 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.684963  1627 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:31.697695  1678 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.710570 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.712318  1626 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.716097 30950 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:31.664229  1475 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.722862 31604 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:31.724565 30878 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:31.725871 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:31.720500 30957 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:31.727106 30954 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:31.727543 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.720975  1562 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:31.730273 30957 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:31.691676  1689 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:31.728415 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.741092 30954 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:31.720044  1678 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:31.745415 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 43482.1us
I20260709 13:15:31.748456 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.750810 30950 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:31.730055  1628 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.743884  1740 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:31.758805 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.740803  1689 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.746474  1673 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.771916 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.773384 30954 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:31.794421 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.769532  1689 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.771719  1496 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:31.806272 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.807122 30954 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:31.812151 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.814033 30953 raft_consensus.cc:2368] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
W20260709 13:15:31.804404 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 78631.8us
I20260709 13:15:31.815430 30848 leader_election.cc:400] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
I20260709 13:15:31.815718 30848 leader_election.cc:403] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:15:31.773455  1740 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:31.818567 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 146533us
I20260709 13:15:31.819370 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.820461 30954 raft_consensus.cc:2410] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:31.821880  1752 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:31.826460  1752 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:31.826719  1754 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:15:31.836539  1665 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:31.837044  1665 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:31.836877  1423 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.838068 31596 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:31.837970  1665 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.838891  1610 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:31.839221  1665 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:31.826793  1752 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:31.822207  1747 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:15:31.843853  1690 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:15:31.844060 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.844331  1690 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:31.845288  1690 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.846360  1690 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.846240  1627 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:31.848932  1389 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:31.849308  1389 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:31.850241  1740 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:31.850065  1389 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:31.850744 30956 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:31.851053  1389 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:31.851975 30956 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:31.825632 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:31.856439 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:31.858510 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:31.861349  1581 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.863968  1746 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:31.864562  1746 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:31.865432  1746 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:31.868995 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 121335us
I20260709 13:15:31.870460 30957 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:31.870643 30847 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:31.873109 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.873706 31025 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:31.875802 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:31.876097 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 60811us
I20260709 13:15:31.880077 31026 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:31.880923 30954 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:31.881031 31023 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:31.883324 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:31.877226 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:31.886406 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:31.887132 31030 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 4: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:31.887385 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:31.890668  1628 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.891315  1628 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:31.892932  1628 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:31.903474 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.904538 31604 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.905292 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:31.906167 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:31.909107 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.909866 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.916134 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:31.918452 30956 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:31.866458  1423 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:31.874636  1627 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:31.922112 31597 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:31.921839 30953 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:31.873759  1592 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.914795  1697 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:31.881474  1259 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7.
I20260709 13:15:31.880625  1499 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:31.925166 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.914985  1484 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:31.917096  1748 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:31.931237 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:31.933139 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.880070  1678 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:31.947292 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:31.947846 30953 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:31.965049 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:31.937923  1697 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.965356 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.932211  1666 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:31.967670 31025 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:31.971746 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.941431  1499 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:31.970650 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:31.986651 30954 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:31.986779 30879 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:31.994709 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.985702  1697 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:32.307634 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.255961 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:31.994350  1499 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:32.055837 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.360319 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.362454 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:15:31.971261  1553 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.003s
I20260709 13:15:31.948720  1484 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:31.949280  1423 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:15:32.365016 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 450558us
W20260709 13:15:32.365207 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 161811us
I20260709 13:15:31.994051  1627 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:32.373627  1678 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:32.377445  1665 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.538s	user 0.014s	sys 0.004s
W20260709 13:15:32.382894 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:32.056157  1720 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:15:32.432061  1757 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 13:15:32.454200 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.578948 30952 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:32.455442 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.468138 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.580109 30954 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:32.382459  1259 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:32.508916 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.583112 31604 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:32.538285 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.440757 30958 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:32.565778 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:32.586930 31599 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:32.378901  1605 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:32.569793 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.590854 30953 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:32.443661  1346 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.454380  1553 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:32.569945  1670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.026s
I20260709 13:15:32.566438 31597 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:32.576670 31598 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:32.579589 30956 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:32.587131 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:32.508669  1673 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.492167  1746 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:32.631979 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.030s	sys 0.032s
W20260709 13:15:32.632477 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.030s	sys 0.032s
I20260709 13:15:32.636569 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:32.652081 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:32.621867  1723 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:15:32.642128 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.652899 30954 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:32.689967 30949 raft_consensus.cc:2410] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:32.632680  1670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.026s
I20260709 13:15:32.711711 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:32.730669 30953 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:32.649085  1752 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.809s	user 0.003s	sys 0.007s
I20260709 13:15:32.621692  1678 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.156s
W20260709 13:15:32.771270  1757 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:15:32.630867  1346 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.606696  1259 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:32.812623  1689 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.001s	user 0.039s	sys 0.021s
I20260709 13:15:32.813059  1689 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:32.813867  1259 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:32.803972  1610 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.965s	user 0.005s	sys 0.013s
I20260709 13:15:32.814939  1610 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:32.815420  1610 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:32.815804  1610 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:32.816380  1389 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.965s	user 0.014s	sys 0.005s
W20260709 13:15:32.817631  1581 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.956s	user 0.009s	sys 0.011s
W20260709 13:15:32.818527  1764 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:15:32.786578  1627 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.821604  1695 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:32.822170  1695 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:32.824816  1767 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
W20260709 13:15:32.825802  1475 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.097s	user 0.016s	sys 0.008s
I20260709 13:15:32.825541  1697 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.826174  1475 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.631481  1605 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.829298  1605 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:32.829432  1770 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.309s	user 0.000s	sys 0.000s
I20260709 13:15:32.830402  1605 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:32.815004  1689 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:32.849287 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 262205us
I20260709 13:15:32.837157 31028 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:32.650380  1673 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:32.838779 30953 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:32.859963 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 337552us
I20260709 13:15:32.690798  1746 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.827576  1697 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:32.866052  1605 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.771095  1484 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.787751  1752 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:32.883975 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:32.886695 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 546) took 1237 ms (client timeout 1607 ms). Trace:
W20260709 13:15:32.907657 31023 rpcz_store.cc:269] 0709 13:15:31.649666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.649780 (+   114us) service_pool.cc:224] Handling call
0709 13:15:32.886461 (+1236681us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54001f2f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:32.886612 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116827008}
I20260709 13:15:32.844415  1553 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.906183 31604 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
W20260709 13:15:32.921278 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:32.868844 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:32.869000  1774 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.879756  1746 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:32.884989  1605 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:32.888933  1581 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.922473  1475 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:32.953434 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1970) took 1317 ms. Trace:
I20260709 13:15:32.953943 30951 rpcz_store.cc:276] 0709 13:15:31.636166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.636320 (+   154us) service_pool.cc:224] Handling call
0709 13:15:31.638644 (+  2324us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:31.647216 (+  8572us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:15:31.726103 (+ 78887us) log.cc:844] Serialized 14 byte log entry
0709 13:15:31.784457 (+ 58354us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:31.870538 (+ 86081us) log.cc:844] Serialized 78 byte log entry
0709 13:15:31.881427 (+ 10889us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:31.881480 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:31.881569 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.953091 (+1071522us) raft_consensus.cc:1685] finished
0709 13:15:32.953121 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.953357 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8649,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":8535,"thread_start_us":57578,"threads_started":1,"wal-append.queue_time_us":185675}
W20260709 13:15:32.966598  1779 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:15:32.968240 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 661) took 1099 ms. Trace:
I20260709 13:15:32.968750 30957 rpcz_store.cc:276] 0709 13:15:31.869163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.871271 (+  2108us) service_pool.cc:224] Handling call
0709 13:15:31.871589 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:31.904743 (+ 33154us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:31.904775 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:31.905294 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:15:32.380216 (+474922us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:32.380274 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:32.380383 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:32.967947 (+587564us) raft_consensus.cc:1685] finished
0709 13:15:32.967976 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:32.968163 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18553,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":474163,"threads_started":1,"wal-append.queue_time_us":865378}
I20260709 13:15:32.971252  1346 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:32.930089  1778 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:32.950294  1771 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:32.925057  1553 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:32.929020  1702 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:15:32.977046  1695 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:32.948662  1774 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:32.982048  1666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.020s
I20260709 13:15:32.963241  1581 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:32.996315  1666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.007s	sys 0.021s
I20260709 13:15:32.981186  1778 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.007416  1774 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.007594  1778 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.010787  1704 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:33.011325 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.012378 30923 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:33.013478  1464 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:33.013875  1464 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:33.014087 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.014736  1464 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:33.015590 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1968) took 1388 ms (client timeout 1837 ms). Trace:
I20260709 13:15:32.984912  1771 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:33.016108 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1930) took 1955 ms (client timeout 1747 ms). Trace:
W20260709 13:15:33.015990 30949 rpcz_store.cc:269] 0709 13:15:31.627593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.627695 (+   102us) service_pool.cc:224] Handling call
0709 13:15:33.015347 (+1387652us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400256f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:33.015520 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420145408}
W20260709 13:15:33.016613 31029 rpcz_store.cc:269] 0709 13:15:31.060945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.061076 (+   131us) service_pool.cc:224] Handling call
0709 13:15:33.015947 (+1954871us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b540007c954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:33.016045 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227298688}
I20260709 13:15:33.018131  1771 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.019340  1752 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.019656 30955 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:33.019390  1669 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:33.020623  1669 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:33.021080  1669 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:33.022094 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.022506 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.023162 30997 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.936s (SENT) [suppressed 62 similar messages]
W20260709 13:15:33.024394 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 542) took 1376 ms (client timeout 1670 ms). Trace:
W20260709 13:15:33.024752 31028 rpcz_store.cc:269] 0709 13:15:31.648399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.648517 (+   118us) service_pool.cc:224] Handling call
0709 13:15:33.024240 (+1375723us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003764d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:33.024339 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631067904}
I20260709 13:15:33.025254  1581 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:33.027436  1499 consensus_meta.cc:287] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.004s
I20260709 13:15:33.027657  1728 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:33.028121  1673 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.028204  1728 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:33.032582 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.017484 30949 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:33.033651 30879 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:33.048938 30879 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:33.046418  1640 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:33.039994  1464 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.083117 30883 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:33.088591  1778 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.089311  1778 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.047600  1499 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.091970  1787 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:33.092737  1787 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.094074  1499 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.095335  1787 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.095971  1776 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.096503  1695 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:33.105353  1553 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:33.116957 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 84822.1us
I20260709 13:15:33.161193 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.046801  1678 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:33.030704  1481 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.165364 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.176324 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.169867 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.025s	sys 0.028s
I20260709 13:15:33.171876 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.173954 30879 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:33.175202 30949 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:15:33.178303 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.025s	sys 0.028s
I20260709 13:15:33.179354 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:33.179554 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.182155  1605 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.182485  1669 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.182720  1605 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.184108 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 651) took 1536 ms. Trace:
I20260709 13:15:33.184564  1669 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.184818  1605 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.163306  1702 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:15:33.186368  1481 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.184456 30955 rpcz_store.cc:276] 0709 13:15:31.647536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.647670 (+   134us) service_pool.cc:224] Handling call
0709 13:15:33.019473 (+1371803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.020140 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.183935 (+163795us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400256f50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:33.184049 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126327040}
I20260709 13:15:33.173609  1776 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.191202  1481 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:33.180836  1678 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.192755  1776 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.188019  1784 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:33.193956  1678 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.193746  1784 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.178236  1744 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:33.196012  1744 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:33.196273  1702 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:33.196695  1702 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:33.196797  1744 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.198052  1744 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.200766  1610 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.202823  1610 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.174453  1695 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.205780  1695 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.197597  1702 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.230358 30879 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:33.172456  1778 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.233520 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.230816 30879 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:33.236292 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.143119  1728 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.248108 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.207172  1340 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:33.249472 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 111505us
I20260709 13:15:33.255563 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:33.242762 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.248333 30879 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.253165 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.258523 30877 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:33.258620 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.259471 30880 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:33.259261 30883 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:33.262689 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.264103 30879 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.232009  1695 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:33.235752  1678 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:33.270664 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.271287  1678 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.271921 31604 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:33.273516  1610 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.273957  1678 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.274163  1610 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.265131  1553 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.277375  1553 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.278088  1610 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.280378 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:15:33.281464 31028 raft_consensus.cc:606] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:15:33.281895 31028 raft_consensus.cc:614] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:33.264860 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.267145 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.268427 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:33.284237 31598 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:33.238322  1784 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:33.270645  1346 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:33.285617 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.287974 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:33.306921 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 283755us
I20260709 13:15:33.313545 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:33.368718 31024 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:33.367640 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 82079.7us
I20260709 13:15:33.370869 30996 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.373418 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:33.304461 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 290389us
I20260709 13:15:33.261323  1702 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.381517 31029 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:33.279556  1553 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.388675 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:33.389520 31028 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:33.390172 30997 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.537s (SENT)
I20260709 13:15:33.390623 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:33.384495 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.395833 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.397099 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.343030  1610 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.401327 31024 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:33.307052  1464 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:33.400656 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.401914 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:33.402922 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:33.403846 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.407174 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.407810 31032 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:33.381487  1481 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:33.410389  1481 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.410787  1481 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.403661  1535 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:33.411841  1535 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.412221  1535 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.391181  1669 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.416891  1669 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.418947  1669 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.419826  1535 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.431303 31028 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:33.433642 30879 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:15:33.448056 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46390.2us
I20260709 13:15:33.449633 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.264153  1340 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.400274  1784 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.453418  1481 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.401175  1610 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.404332  1640 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.405750  1464 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.404554  1553 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.404304  1802 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:33.466270 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 76128us
I20260709 13:15:33.475824 31028 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:33.477030 30997 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.155s (SENT)
I20260709 13:15:33.477890 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:33.465905  1728 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:33.479118  1605 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:33.480324  1804 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:15:33.465054  1535 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.465037  1610 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.493631 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.493921 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:33.494544 31027 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:33.494923 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.495486 31024 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:33.496106 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.496310 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.497455 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.498005 31026 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:33.498735 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.498972 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 698) took 2503 ms. Trace:
I20260709 13:15:33.499362 30878 rpcz_store.cc:276] 0709 13:15:30.995688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:30.995859 (+   171us) service_pool.cc:224] Handling call
0709 13:15:31.013075 (+ 17216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.725183 (+712108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.498701 (+1773518us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400196254. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:33.498882 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635816704}
I20260709 13:15:33.499372 31026 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:33.462947 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.312043  1695 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.382542  1346 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.516606 31032 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:33.503973 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.522377 30880 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:33.522454 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:33.522722 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:33.523196 30876 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:33.457105  1669 raft_consensus.cc:2764] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:15:33.523808  1695 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:33.524446  1689 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:15:33.524886 30878 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:33.528419  1783 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:33.528990  1783 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.529472 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:33.530354 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:33.530929 30957 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:33.531698  1746 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.532222  1746 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.534096  1746 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:33.535465  1499 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:33.516656  1553 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:33.535898  1499 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:33.536175  1553 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.536892  1159 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.536792  1499 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.538038  1499 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.538864  1689 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.475581  1464 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:33.539366  1689 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.542186  1689 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.506278 31027 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:33.501304 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:33.508378 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:33.549072 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 86179.5us
W20260709 13:15:33.516911 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:33.503137 31571 connection.cc:256] RPC call timeout handler was delayed by -1.5871046570000544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:15:33.462095  1784 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.549849 30957 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:33.520601 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.543294 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:33.550474 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.549927 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.550874 30881 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:33.549270 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.504498 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.551617 30879 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:33.551578 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.504524 31024 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:33.553368 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.555184 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:33.555505 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 78493.7us
I20260709 13:15:33.556067 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.555011 31570 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:33.556236 30997 leader_election.cc:336] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.279s (SENT)
I20260709 13:15:33.531160  1744 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.556027 31028 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:33.546680  1535 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:33.562464 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.560591 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:33.562935 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 192174us
I20260709 13:15:33.564664 31598 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:33.566607 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.568305 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.568982 31598 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:33.568917 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.568351 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:33.643711 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75048.3us
W20260709 13:15:33.644176 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 87974.7us
I20260709 13:15:33.595306 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.645370 31602 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:33.646059 30997 leader_election.cc:336] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.700s (SENT)
I20260709 13:15:33.646445 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:33.592197 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:33.647918 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 79066.7us
W20260709 13:15:33.646638 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 86989.1us
I20260709 13:15:33.554066  1784 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.554137  1259 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.554607  1640 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.650584 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:33.654907 31604 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:33.569890  1692 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:33.649397 31571 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:33.666684 31571 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:33.659212 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.596750 31601 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:15:33.646493 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:33.667532 31604 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:33.595733 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.559070  1744 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.646466 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.567814  1792 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:33.520260  1802 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.643954  1499 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.643604  1689 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:33.567620  1389 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:33.593938 31599 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:33.594875 31600 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:15:33.644104  1793 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:33.671152 30997 leader_election.cc:336] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.919s (SENT)
I20260709 13:15:33.743582 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:33.655736 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 100802us
W20260709 13:15:33.664420 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.650871 31598 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:33.570338  1688 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:33.669983 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:15:33.665689 31028 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:33.744700 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:33.745072 30881 raft_consensus.cc:606] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:33.652988  1783 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.673705  1692 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:33.760877  1692 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.766171 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 934) took 2138 ms. Trace:
I20260709 13:15:33.766616 31596 rpcz_store.cc:276] 0709 13:15:31.627565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:31.627698 (+   133us) service_pool.cc:224] Handling call
0709 13:15:31.628082 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:31.838504 (+210422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.765769 (+1927265us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54005f0fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:33.766107 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482519424}
I20260709 13:15:33.699847  1640 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:33.767942 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.768236  1640 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:33.768808 31596 raft_consensus.cc:2410] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:33.769121  1640 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.659509  1581 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.772068  1581 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.774188  1581 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:33.778738  1535 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:33.669268 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.570134  1626 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:15:33.643353  1695 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:15:33.700657 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50143.5us
I20260709 13:15:33.672426  1791 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:33.702003 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.745464 30881 raft_consensus.cc:614] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:33.704921  1808 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.746627  1811 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:33.747247 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:33.749374 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.750711  1746 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:33.751166  1696 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.751380 31030 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.751832  1475 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.752270 30958 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:33.871958 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.786228  1665 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.779533  1553 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.784006 30953 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:33.784225 31600 pending_rounds.cc:85] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:15:33.674044  1666 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:33.668308 31571 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:33.792296 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:33.667603  1782 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.198s
I20260709 13:15:33.664516  1748 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:33.827858 31596 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:33.657326  1678 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:33.834518 31602 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:33.854662 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.885205 31599 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:33.742738  1605 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:33.742508  1689 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.891753  1689 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:33.834998  1752 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:15:33.858718 30877 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:33.854267 31601 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:33.877928  1746 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:33.896588  1746 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.752795  1688 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:33.899436  1688 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.901120  1553 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:33.874250 31600 pending_rounds.cc:107] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:15:33.902667 31600 raft_consensus.cc:2889] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:33.874835 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1587) took 1910 ms. Trace:
I20260709 13:15:33.903729 30953 rpcz_store.cc:276] 0709 13:15:31.964189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.783510 (+1819321us) service_pool.cc:224] Handling call
0709 13:15:33.783848 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.874062 (+ 90214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.874760 (+   698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:33.670352  1812 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 13:15:33.567981  1728 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:33.880362 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 212140us
I20260709 13:15:33.785840  1793 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.743083  1499 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.921152 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.922052 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.930819 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1596) took 1463 ms. Trace:
I20260709 13:15:33.923702 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.828392  1389 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.877336  1666 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:33.874163  1808 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:33.932016 31604 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
W20260709 13:15:33.927232 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 375226us
I20260709 13:15:33.882095  1775 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:33.943388 31603 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:33.944253 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:33.903324  1689 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:33.912283  1791 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:33.941102 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:33.912046  1481 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:33.941730 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:33.949734 31599 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11.
I20260709 13:15:33.931386  1793 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:33.925298  1748 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:33.932893  1669 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:33.878988  1475 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.883001  1665 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.924844  1678 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:33.939908  1666 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.875391  1696 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:33.931360 30951 rpcz_store.cc:276] 0709 13:15:32.467742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:32.967935 (+500193us) service_pool.cc:224] Handling call
0709 13:15:32.968289 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:32.968508 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:33.238474 (+269966us) log.cc:844] Serialized 14 byte log entry
0709 13:15:33.779794 (+541320us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18003b9260. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:33.930442 (+150648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:33.930500 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:33.930554 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.930624 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:33.930750 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37946,"prepare.queue_time_us":43908,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":54428,"raft.run_wall_time_us":36926,"spinlock_wait_cycles":5259264,"thread_start_us":885837,"threads_started":3,"wal-append.queue_time_us":206504}
I20260709 13:15:33.936197  1739 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:15:33.950030  1791 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.021977 30950 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:34.023237 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 271488us
I20260709 13:15:34.042937 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:33.984498  1535 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:33.947299  1553 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:15:34.043601 31602 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:34.046129 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:34.048666 31604 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:34.050669 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.047181 31027 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:15:34.045332  1803 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:15:34.081159 30951 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:34.050046  1784 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:34.075686 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 241791us
I20260709 13:15:34.046643  1535 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.052135 31027 pending_rounds.cc:85] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 3
I20260709 13:15:34.089605 31027 pending_rounds.cc:107] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:15:34.090003 31027 raft_consensus.cc:2889] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:34.084496 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.094565 30877 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:34.066118  1686 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:34.100441 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.101737 30881 raft_consensus.cc:2410] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:34.047369  1340 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.104287 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:34.105109 31599 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:34.103078  1686 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.082095  1776 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.082141  1744 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:34.137569  1702 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.752s	user 0.001s	sys 0.008s
I20260709 13:15:34.064603  1496 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:15:34.079989  1553 consensus_queue.cc:1243] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:34.128983  1481 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.168134  1481 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.119984  1678 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:34.129539  1340 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:34.131855  1810 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:15:34.119527  1686 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.095821  1535 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:34.136438  1776 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.051870  1782 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:15:34.139830  1689 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.222591 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:34.197377 31030 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:34.235213 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:34.164597  1791 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.164839  1626 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:34.164853  1499 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:34.277565 30957 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:34.157658 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 68396.4us
W20260709 13:15:34.195152 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 274547us
I20260709 13:15:34.279431  1791 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.278728 30847 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:34.172489  1389 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.282642 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:34.172325  1817 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:34.293274 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:34.241304  1813 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.787s	user 0.003s	sys 0.000s
I20260709 13:15:34.097901  1748 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.186879 31023 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:34.292670 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:34.296768 31029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.006s
W20260709 13:15:34.297195 31029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.009s	sys 0.006s
I20260709 13:15:34.297003 30955 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:34.170729 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:34.223750  1496 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:15:34.171661  1818 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:15:34.310143 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 999) took 1055 ms. Trace:
W20260709 13:15:34.310357  1464 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.001s
I20260709 13:15:34.294142 30957 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:34.199802 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.311904 30953 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:34.292681 30949 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:15:34.195749 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 312332us
W20260709 13:15:34.315124 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:34.296278 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.001s	sys 0.014s
I20260709 13:15:34.298812 30950 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:34.276219 30883 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:34.170861  1481 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.308557 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:34.315861 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.001s	sys 0.015s
I20260709 13:15:34.310575 31605 rpcz_store.cc:276] 0709 13:15:33.255126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.255274 (+   148us) service_pool.cc:224] Handling call
0709 13:15:33.255617 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:33.535906 (+280289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.535938 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:33.536485 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:15:33.826791 (+290306us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:33.826846 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.826947 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:34.309916 (+482969us) raft_consensus.cc:1685] finished
0709 13:15:34.309939 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:34.310079 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279833,"raft.queue_time_us":281036,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":73,"thread_start_us":289873,"threads_started":1,"wal-append.queue_time_us":412340}
W20260709 13:15:34.329044 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50382.1us
I20260709 13:15:34.333336 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:34.316128 30883 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:34.252607  1793 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:34.311154  1464 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.342226  1752 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.358503  1752 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.359696  1464 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.359915  1695 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:34.360355  1695 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:34.360786  1695 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:34.361351 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.362047 30878 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
W20260709 13:15:34.335671 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 664494us
I20260709 13:15:34.340445 30883 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.365856 31024 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:34.336019 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.338111 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.305634  1496 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:34.343240 30956 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:15:34.368003 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.368665 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1593) took 1996 ms. Trace:
I20260709 13:15:34.368746 30953 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:34.367105 30877 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:34.283687  1340 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.369902 30956 rpcz_store.cc:276] 0709 13:15:32.372838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.316110 (+1943272us) service_pool.cc:224] Handling call
0709 13:15:34.342820 (+ 26710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.368302 (+ 25482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:34.368594 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.371003 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.342338 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:34.371908 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:34.373140 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.344363  1688 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.379174 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:34.382005 31024 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:34.381057 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.382856 30955 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:34.372074 30881 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.382869 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.384177 31024 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:34.378233 30876 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:34.374703  1340 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:34.370445  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.854s	user 0.046s	sys 0.050s
I20260709 13:15:34.368093  1353 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:15:34.385625  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.874s	user 0.046s	sys 0.050s
I20260709 13:15:34.399001 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:34.399506 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 334593us
I20260709 13:15:34.404062 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:34.404978 30953 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:34.406329 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.406952 30950 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:34.402093 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:34.409008 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.373311  1752 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.381047  1776 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.371621  1626 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:15:34.420815 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:34.400049  1640 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:34.401384  1696 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:34.399060  1783 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:15:34.627810  1833 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:15:34.398383  1688 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:34.497398 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.611575 30881 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
W20260709 13:15:34.621299  1610 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.133s	user 0.023s	sys 0.005s
W20260709 13:15:34.604403 31026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.057s
I20260709 13:15:34.652525 30882 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:34.652693 31026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.006s	sys 0.061s
I20260709 13:15:34.524227 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.653702 30955 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:34.635203 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.499656 30950 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:34.620054 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:34.655505 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 311617us
I20260709 13:15:34.655788 30876 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.484949 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.656457 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:34.657032 30949 raft_consensus.cc:2393] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:34.637549 31024 raft_consensus.cc:2368] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8.
I20260709 13:15:34.496268 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:34.496932 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.639976 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.657836 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:34.658388 30874 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:34.413304  1782 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:34.642194 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:34.418555  1692 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.234s
I20260709 13:15:34.672086 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:34.648012 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:34.650859 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:34.649819 30997 connection.cc:256] RPC call timeout handler was delayed by -1.0013349979999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:15:34.413097  1784 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.486184  1389 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:34.660010 30877 raft_consensus.cc:2368] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11.
I20260709 13:15:34.491120  1689 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
I20260709 13:15:34.413491  1746 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.241s
I20260709 13:15:34.624732  1790 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:34.685653  1782 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:34.684571  1791 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:34.704941  1790 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.705224  1791 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.490175  1722 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:34.707369  1722 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.675493  1696 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.708542 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:34.669910 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:34.674257 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:34.709151 31026 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:34.692306  1832 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:15:34.693064  1831 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:15:34.696367  1828 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:34.696195 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:34.696926  1835 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:15:34.698290  1688 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.413522  1496 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:34.699255  1605 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.001s
I20260709 13:15:34.659046  1553 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:15:34.699756  1626 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:34.685428  1389 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.638585  1640 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.721060  1553 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:34.721515  1553 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:34.702080  1842 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:34.702126  1689 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:34.722373  1553 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:34.703307  1666 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.001s
I20260709 13:15:34.703716  1793 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.704331 30875 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:34.704236 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.705521  1790 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.709549 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:34.659668 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:34.710184 30957 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:34.708388  1696 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.711077 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.672319  1841 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.712106 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:34.707468  1791 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.712541 30955 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:34.698408  1728 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:34.677601  1353 consensus_queue.cc:1243] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:15:34.658288  1610 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.714838 30876 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:34.714401  1688 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:34.736302 31026 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:34.747824 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:34.748590 30955 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.737066 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:34.715014  1826 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:34.740008 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66526.1us
W20260709 13:15:34.740315 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 89562.4us
I20260709 13:15:34.718485  1605 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:34.750130 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.719269  1686 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.744714 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.723716  1553 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.744131  1626 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:34.705526  1782 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.755852 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:34.745635  1728 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.766614  1728 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.747696  1688 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.768834  1688 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:34.760484 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:34.757884  1826 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.743942  1841 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.736135  1666 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.777060  1666 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:34.760365  1626 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.778122 31032 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:34.778472  1626 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:34.761962  1849 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:34.762454 31024 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:34.785681 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.780366  1849 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.798337 31024 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:34.799408 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:34.799376 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.800473 31024 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:34.801303 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:34.781024  1722 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:34.823016  1791 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.825657  1791 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.828621  1686 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:34.784261  1678 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:34.799455  1798 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:34.876523 30953 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:34.876991 30953 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:34.877818 30953 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:34.878731 30953 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:34.872386  1798 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:34.867697  1678 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:34.882937  1678 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:34.933111 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:34.940644  1665 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:34.957803 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 667) took 1429 ms (client timeout 1674 ms). Trace:
W20260709 13:15:34.958444 30958 rpcz_store.cc:269] 0709 13:15:33.528732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.529206 (+   474us) service_pool.cc:224] Handling call
0709 13:15:34.957562 (+1428356us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400350f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:34.957711 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510929664}
I20260709 13:15:34.959992  1846 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:34.967661 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 939) took 1047 ms. Trace:
W20260709 13:15:34.968266 30954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1603) took 2354 ms (client timeout 1537 ms). Trace:
W20260709 13:15:34.968767 30954 rpcz_store.cc:269] 0709 13:15:32.614025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.968035 (+2354010us) service_pool.cc:211] Skipping call since client already timed out
0709 13:15:34.968186 (+   151us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:34.977648  1475 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:34.968149 31602 rpcz_store.cc:276] 0709 13:15:33.920693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.920817 (+   124us) service_pool.cc:224] Handling call
0709 13:15:34.967460 (+1046643us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54007143d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:34.967597 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264650624}
I20260709 13:15:34.997656 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:34.999264 31024 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:35.000264 31602 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:35.000496 31024 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:35.007938 31024 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:34.979004  1776 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:35.017921 30953 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:15:34.975960  1752 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:35.019033 30924 connection.cc:256] RPC call timeout handler was delayed by -1.8049208830000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:15:35.019466 30953 pending_rounds.cc:85] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 4
W20260709 13:15:35.019495 30924 connection.cc:256] RPC call timeout handler was delayed by -1.7113208829998712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:15:35.020042 30953 pending_rounds.cc:107] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:15:35.020444 30953 raft_consensus.cc:2889] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:35.024926  1440 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:35.025365  1440 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:35.006584  1847 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:35.026306  1440 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.026661  1847 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.027870  1855 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.028420  1855 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.029131  1847 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.001323  1846 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:15:35.030582  1855 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.032784 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1940) took 1724 ms. Trace:
I20260709 13:15:35.018772  1786 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:15:35.033710  1728 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.019143  1776 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:35.024928  1841 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:35.036118  1728 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.035827  1776 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.036820  1744 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:35.037011  1776 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.031168  1752 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.037389  1744 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.039284  1744 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:35.040086  1791 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:35.040786 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:35.041276  1440 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:35.040192 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.024150 31032 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:35.039284  1752 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:35.020040 30924 connection.cc:256] RPC call timeout handler was delayed by -1.6618208830000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:15:35.033177 31025 rpcz_store.cc:276] 0709 13:15:33.308202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.308368 (+   166us) service_pool.cc:224] Handling call
0709 13:15:33.347534 (+ 39166us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:33.367528 (+ 19994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:33.367562 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:33.383433 (+ 15871us) log.cc:844] Serialized 52 byte log entry
0709 13:15:33.673453 (+290020us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:33.673511 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:33.673604 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.030263 (+1356659us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b24000c8d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f27379f39c4 00007f27379f1acb 00007f2737bacdc9 00007f2737baca55 00007f2737babfb0 00007f273a822488 00007f273a822be8 00007f273a7fa398 00007f273a7f576a 00007f273a7f4bb6
0709 13:15:35.032486 (+  2223us) raft_consensus.cc:1685] finished
0709 13:15:35.032506 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.032722 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19413,"raft.queue_time_us":33379,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11802,"spinlock_wait_cycles":32711424,"thread_start_us":262011,"threads_started":1,"wal-append.queue_time_us":457375}
I20260709 13:15:35.048350  1346 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:35.216465 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.190675 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 665) took 3254 ms. Trace:
I20260709 13:15:35.219601  1802 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:35.017764  1696 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:35.112299  1808 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.221093  1496 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.221961 31025 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:35.223251 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1938) took 1936 ms (client timeout 2019 ms). Trace:
I20260709 13:15:35.220846  1808 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:35.223658 31023 rpcz_store.cc:269] 0709 13:15:33.287127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.287680 (+   553us) service_pool.cc:224] Handling call
0709 13:15:35.223092 (+1935412us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400146754. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:35.223197 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779674496}
I20260709 13:15:35.218730 30952 rpcz_store.cc:276] 0709 13:15:31.936412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.316020 (+2379608us) service_pool.cc:224] Handling call
0709 13:15:34.343691 (+ 27671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:34.343961 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:34.734901 (+390940us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.190275 (+455374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.190332 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.190401 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.190475 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.190612 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":435538,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":79,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8274,"thread_start_us":817332,"threads_started":2}
I20260709 13:15:35.063243 31026 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
W20260709 13:15:35.104875 31603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 902) took 1514 ms (client timeout 1981 ms). Trace:
W20260709 13:15:35.101892 30848 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.551s (SENT)
W20260709 13:15:35.121608 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 789191us
W20260709 13:15:35.227444 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 125606us
W20260709 13:15:35.228147 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 105364us
W20260709 13:15:35.227455 30924 connection.cc:256] RPC call timeout handler was delayed by -1.6375208829999792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:15:35.228713 30924 connection.cc:256] RPC call timeout handler was delayed by -1.631220882999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:15:35.229525 30924 connection.cc:256] RPC call timeout handler was delayed by -1.5889208829999006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 13:15:35.229669 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:35.230412 31605 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:35.231555 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:35.232400 31599 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.230582 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:15:35.226682 31603 rpcz_store.cc:269] 0709 13:15:33.590027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.595452 (+  5425us) service_pool.cc:224] Handling call
0709 13:15:35.104630 (+1509178us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400459cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:35.104799 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626105728}
W20260709 13:15:35.042555  1535 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.733s	user 0.020s	sys 0.000s
I20260709 13:15:35.243060 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:35.244050 31603 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:35.238085 30848 leader_election.cc:336] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.652s (SENT)
I20260709 13:15:35.238750 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:35.280092 31602 raft_consensus.cc:2410] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:15:35.280187 30848 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.652s (SENT)
I20260709 13:15:35.239837 30955 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
W20260709 13:15:35.281050 30848 leader_election.cc:336] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.681s (SENT)
I20260709 13:15:35.017215  1610 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.258726 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:35.275480 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45248.1us
I20260709 13:15:35.283586 31601 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.283838 30924 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:35.278314 31605 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:35.257443  1535 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.281564 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:35.052953  1389 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:35.190362  1484 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.291960  1437 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:35.292145  1484 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.191262  1693 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:35.121565  1798 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:35.286916 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49696.3us
I20260709 13:15:35.279436  1728 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:35.288861  1678 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.290468 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:35.291049  1722 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.240422  1826 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.295145 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:35.308145 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:35.308944 31026 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:35.310029 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:35.310629 31026 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:35.298028 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:35.309037 30848 leader_election.cc:336] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.837s (SENT)
I20260709 13:15:35.311705 31599 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:35.316771 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:35.319228 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:35.322959 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:35.323342  1678 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:35.323491  1688 consensus_meta.cc:287] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.554s	user 0.014s	sys 0.005s
I20260709 13:15:35.282153  1802 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.326138 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1961) took 1815 ms. Trace:
I20260709 13:15:35.326996 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:35.329659 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:35.307550  1693 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.328624  1855 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:35.373567 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.331166  1826 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.300320 31601 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:35.335084  1346 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.333691 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:35.380834 31599 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:35.328869 31028 rpcz_store.cc:276] 0709 13:15:33.510602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.826939 (+316337us) service_pool.cc:224] Handling call
0709 13:15:33.859377 (+ 32438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.859573 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:33.878981 (+ 19408us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.149285 (+270304us) log.cc:844] Serialized 14 byte log entry
0709 13:15:34.874927 (+725642us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18004757e0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:35.102782 (+227855us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b18004757e0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:35.300899 (+198117us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.325794 (+ 24895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.325844 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.325887 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.325994 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.326086 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":565343,"prepare.queue_time_us":30678,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":10773,"raft.queue_time_us":1002507,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":19061,"spinlock_wait_cycles":74127744,"thread_start_us":435834,"threads_started":2,"wal-append.queue_time_us":531165}
I20260709 13:15:35.382210 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:35.382779 31028 raft_consensus.cc:2376] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9. Re-sending same reply.
I20260709 13:15:35.380421 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:35.383694 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:35.381984 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.386857 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.387522  1845 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:35.388087  1845 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.388461  1845 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.335803 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:35.387600 30875 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:35.325209  1695 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.960s	user 0.016s	sys 0.013s
I20260709 13:15:35.351670 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:35.406667 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 73583.9us
I20260709 13:15:35.351269 31605 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:35.417515 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.361780 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 555) took 1973 ms. Trace:
I20260709 13:15:35.325668  1581 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:35.353319 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:35.448638 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 95404.3us
I20260709 13:15:35.449446 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:35.367470 31026 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:35.369493 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.372087 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.373136 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.335192  1829 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:35.296236  1464 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.312207  1798 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.377671 30880 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:35.375850 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:35.376977  1696 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:35.330627  1484 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.379122 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:35.379199 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.333185  1688 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.487483 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.392558 31602 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 5: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:35.294399  1728 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:35.335718 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:35.365742  1830 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:35.394825  1858 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:15:35.395012  1535 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.335852  1802 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:35.506283 31602 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:35.380636  1346 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.396657 31571 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:35.449767  1811 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:35.509807 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 174152us
W20260709 13:15:35.509987 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 113449us
I20260709 13:15:35.397526 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
W20260709 13:15:35.399206  1553 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.007s
I20260709 13:15:35.374763  1849 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.447011 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.458003 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:35.512434 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.515888 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:35.485396  1808 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.392725  1773 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.521896 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:35.522583 30848 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.945s (SENT)
I20260709 13:15:35.498924  1798 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:35.524578 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 143266us
I20260709 13:15:35.484165 30878 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:35.486820 30881 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:35.483597 30924 leader_election.cc:400] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11.
I20260709 13:15:35.526526 30924 leader_election.cc:403] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:15:35.501410 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.456745  1826 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.511082 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:35.511492 30996 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:35.511650 30958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.010s	sys 0.018s
W20260709 13:15:35.534646 30958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.011s	sys 0.018s
I20260709 13:15:35.501699 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:35.429844 31029 rpcz_store.cc:276] 0709 13:15:33.388495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.388619 (+   124us) service_pool.cc:224] Handling call
0709 13:15:33.388888 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.389087 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:33.736147 (+347060us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.361107 (+1624960us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.361443 (+   336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.361491 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.361539 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.361602 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.361722 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":806172,"prepare.queue_time_us":101810,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":817241,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":10648,"thread_start_us":1118895,"threads_started":3,"wal-append.queue_time_us":663205}
I20260709 13:15:35.487322  1776 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.519164 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:35.536216 30876 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.511068 31605 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:35.537071 30997 leader_election.cc:336] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.155s (SENT)
I20260709 13:15:35.447358  1695 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.486126 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:35.488543  1829 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:35.523556 30848 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.985s (SENT)
I20260709 13:15:35.527288 30877 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:35.528002 31023 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:35.500909  1728 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:35.535377 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 74068.9us
I20260709 13:15:35.544852 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:35.520207 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:35.545400 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:35.514138  1346 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:35.547266 30955 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:15:35.547091  1553 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:35.548377 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.518282  1815 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:35.487026  1464 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:35.552248 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.550722 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:35.557789 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:35.558241 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.560590 30953 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:15:35.557572 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46553.3us
I20260709 13:15:35.558810 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:35.560885 30950 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:35.561488 30878 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:35.559386 31029 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:35.522032  1811 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:35.589960 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52909.8us
W20260709 13:15:35.594403 30997 leader_election.cc:336] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.206s (SENT)
I20260709 13:15:35.594797 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:35.561522 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:35.591054 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.595182 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:35.596047 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.589871 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.592228 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.564184 30949 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:35.598515 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.598551 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.599376 30956 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:35.541930  1739 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:35.507869  1696 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.540261  1839 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.542364  1849 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:35.604988 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.563668  1798 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:35.608990 30949 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:35.609592 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.610704 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 675) took 1188 ms. Trace:
I20260709 13:15:35.606684 30876 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:35.631404 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.640041 30957 rpcz_store.cc:276] 0709 13:15:34.422723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.422839 (+   116us) service_pool.cc:224] Handling call
0709 13:15:35.610551 (+1187712us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b54001e0d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:35.610651 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127449472}
I20260709 13:15:35.641014 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:35.646502 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1970) took 1357 ms (client timeout 1627 ms). Trace:
I20260709 13:15:35.647122 30883 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:35.600255  1437 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:35.602254  1815 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:35.658859 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.650739 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.549099  1776 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.654770 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.662655 30956 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.611521  1782 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:35.619107  1855 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:35.605072  1678 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:35.613821  1440 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:35.656459 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:35.709307 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.710135 30950 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:35.710546  1869 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:35.710883 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.712108  1855 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.713742  1688 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.614837  1463 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:35.718792  1463 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:35.719214  1463 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:35.670742  1798 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:35.720479  1867 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:15:35.720630  1798 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:35.617081  1861 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:15:35.723188  1696 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:35.661010 30957 raft_consensus.cc:2410] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:15:35.646950 31032 rpcz_store.cc:269] 0709 13:15:34.289150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.304767 (+ 15617us) service_pool.cc:224] Handling call
0709 13:15:35.646324 (+1341557us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002d4e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:35.646441 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946395392}
I20260709 13:15:35.659545 30954 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:35.658726 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.724434 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 682) took 1063 ms. Trace:
W20260709 13:15:35.707799 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:35.604663  1752 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:15:35.735399 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.742309 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 560) took 1098 ms. Trace:
I20260709 13:15:35.603622  1791 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:15:35.662245  1159 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:15:35.712846  1464 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:35.618558  1739 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:35.725029 30958 rpcz_store.cc:276] 0709 13:15:34.660971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.959656 (+298685us) service_pool.cc:224] Handling call
0709 13:15:34.961080 (+  1424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.961484 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.961513 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.961974 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.535024 (+573050us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:35.535063 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.535128 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.724147 (+189019us) raft_consensus.cc:1685] finished
0709 13:15:35.724174 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.724358 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":572655,"threads_started":1,"wal-append.queue_time_us":675379}
I20260709 13:15:35.726939 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1967) took 1447 ms. Trace:
I20260709 13:15:35.786616 31031 rpcz_store.cc:276] 0709 13:15:34.279949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.286396 (+  6447us) service_pool.cc:224] Handling call
0709 13:15:34.313382 (+ 26986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.115338 (+801956us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:35.115384 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.116049 (+   665us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.360254 (+244205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:35.360305 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.361292 (+   987us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:35.726673 (+365381us) raft_consensus.cc:1685] finished
0709 13:15:35.726701 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.726869 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":869989,"raft.queue_time_us":807800,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":48605,"thread_start_us":243770,"threads_started":1,"wal-append.queue_time_us":398492}
I20260709 13:15:35.649149  1837 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:35.660040  1790 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.919s	user 0.011s	sys 0.012s
I20260709 13:15:35.733918 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:35.742834 31025 rpcz_store.cc:276] 0709 13:15:34.643512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.222864 (+579352us) service_pool.cc:224] Handling call
0709 13:15:35.223140 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.223329 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:35.517092 (+293763us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.741850 (+224758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.741917 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.741982 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.742065 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.742210 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21826,"prepare.queue_time_us":391204,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":76,"thread_start_us":510824,"threads_started":2}
I20260709 13:15:35.790495 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:35.747320 30874 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:35.726153 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:35.676229  1782 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:35.684111  1859 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:15:35.672179  1437 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:35.533933  1773 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.522109  1830 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.024935 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:36.154402 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 447040us
I20260709 13:15:36.178056 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:36.084950 30883 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:36.178126 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.031917 31024 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:35.991088 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 446268us
I20260709 13:15:36.172551 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:36.087131 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 491952us
I20260709 13:15:36.180048 30957 raft_consensus.cc:2376] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9. Re-sending same reply.
W20260709 13:15:36.025946 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1947) took 2629 ms (client timeout 2233 ms). Trace:
I20260709 13:15:36.008651 31028 raft_consensus.cc:606] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:36.160552 30922 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 1.865s (SENT)
I20260709 13:15:35.740943  1440 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.177556 30951 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:35.920306 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.180626 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 721) took 2093 ms. Trace:
I20260709 13:15:36.181895 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.231588 30883 rpcz_store.cc:276] 0709 13:15:34.087464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.087595 (+   131us) service_pool.cc:224] Handling call
0709 13:15:34.276094 (+188499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.646620 (+1370526us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000f76a0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abcfa1d 00007f273abb61a4 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419
0709 13:15:36.179123 (+532503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.180557 (+  1434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861814528}
I20260709 13:15:36.232474 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:36.174235 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 579781us
W20260709 13:15:36.175275 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.233062 30950 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:36.233489  1869 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.186851 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:36.233870 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:36.189096 31605 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:36.234402 30957 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:35.737619  1811 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:36.235126 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.188402 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.182265 30922 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:36.180944  1581 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:36.236369 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.236572  1581 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:36.236876 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76374.2us
I20260709 13:15:36.237031  1581 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.237437 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:35.776784  1678 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:35.786024  1829 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.196555 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.197458 31602 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:15:36.198058  1871 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.690s	user 0.003s	sys 0.000s
I20260709 13:15:36.198493 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.199360 31032 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:36.204417 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.019037  1340 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:36.206918  1626 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.428s	user 0.015s	sys 0.005s
I20260709 13:15:36.028885  1776 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.968237  1802 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:36.183869  1484 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:36.212559  1728 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 13:15:36.185457  1837 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.169312  1793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.001s
I20260709 13:15:35.790460  1790 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.219515  1849 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.583s	user 0.004s	sys 0.001s
I20260709 13:15:35.837421  1808 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:35.947302  1863 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 13:15:36.021028  1640 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:35.816995  1159 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:35.920521  1815 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.085867  1739 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:35.784026  1688 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.446s
I20260709 13:15:36.222599  1437 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:36.225464  1496 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.000s
I20260709 13:15:36.230336 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.232285 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 722) took 2144 ms. Trace:
I20260709 13:15:36.266539  1808 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:36.182044  1669 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.235221 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.187592 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.190328 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.273300 30879 rpcz_store.cc:276] 0709 13:15:34.087921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.088043 (+   122us) service_pool.cc:224] Handling call
0709 13:15:34.088459 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:34.658742 (+570283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.658777 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:34.715519 (+ 56742us) log.cc:844] Serialized 52 byte log entry
0709 13:15:34.832399 (+116880us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.081497 (+249098us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.227756 (+146259us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.227985 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.231921 (+1003936us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540001f4d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:36.231970 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.232106 (+   136us) raft_consensus.cc:1685] finished
0709 13:15:36.232120 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.232233 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78478,"prepare.queue_time_us":636684,"prepare.run_cpu_time_us":3620,"prepare.run_wall_time_us":23119,"raft.queue_time_us":200740,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":39516,"spinlock_wait_cycles":454607232,"thread_start_us":650888,"threads_started":3,"wal-append.queue_time_us":209914}
I20260709 13:15:36.236385 30878 raft_consensus.cc:2410] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:36.238438 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.240084 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.279464 30950 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:36.181911 31028 raft_consensus.cc:614] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:36.192628 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.241672 30958 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:36.183331 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:36.251418  1340 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.283138 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 99854us
I20260709 13:15:36.265565  1484 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:36.181098 31030 rpcz_store.cc:269] 0709 13:15:33.396541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.402597 (+  6056us) service_pool.cc:224] Handling call
0709 13:15:36.025736 (+2623139us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400347e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:36.025870 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793656576}
I20260709 13:15:36.283174 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.038609  1535 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:36.205025  1346 consensus_meta.cc:287] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 13:15:36.141960  1695 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:36.210017  1845 consensus_meta.cc:287] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.002s
I20260709 13:15:36.296455 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:36.183296  1782 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:36.244704  1481 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.012s
I20260709 13:15:36.152407  1463 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.236585  1873 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:36.262589  1802 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:15:36.184912  1440 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.266127 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.233974  1869 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.264355  1793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.011s	sys 0.002s
I20260709 13:15:36.274909 30882 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:36.233974  1773 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:36.284237 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:36.178545 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 452435us
I20260709 13:15:36.270694  1849 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11.
I20260709 13:15:36.286170 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.386556 30950 raft_consensus.cc:2376] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8. Re-sending same reply.
I20260709 13:15:36.290719 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.387707 30957 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:36.293623 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.263850  1728 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:36.256232  1626 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.298439 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.282346  1610 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:36.274441  1159 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.288512  1535 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:36.287603  1887 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:36.304477  1481 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.000s	sys 0.013s
I20260709 13:15:36.292184  1696 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.279893  1669 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.371057 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1977) took 1074 ms. Trace:
W20260709 13:15:36.371331  1886 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:15:36.372706  1808 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:36.439823  1688 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:36.373051  1463 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.376098  1340 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.376263  1790 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.312992  1879 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.376806  1484 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:36.295220  1346 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.285147  1678 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.304713  1845 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.298507  1496 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.388732 30954 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:36.391248 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:36.393159 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 109012us
I20260709 13:15:36.473963 31023 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:36.474733 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:36.458782  1688 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.395308 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.308139  1882 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:36.314563  1855 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:36.489630 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 256814us
I20260709 13:15:36.308820  1839 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.372798  1693 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.445859 30958 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:36.442880 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:36.448477 30952 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.383404  1581 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.299041  1877 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 13:15:36.449681 31029 rpcz_store.cc:276] 0709 13:15:35.296252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.562506 (+266254us) service_pool.cc:224] Handling call
0709 13:15:35.591349 (+ 28843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:35.981979 (+390630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.982009 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:35.982559 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.273060 (+290501us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:36.273101 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.273168 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.370774 (+ 97606us) raft_consensus.cc:1685] finished
0709 13:15:36.370793 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.370976 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11066,"raft.queue_time_us":118555,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"thread_start_us":518331,"threads_started":2,"wal-append.queue_time_us":282673}
I20260709 13:15:36.451558 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:36.441597  1773 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.458048 30955 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:36.479396 31571 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:36.499349 30950 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:36.477567 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:36.508037 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 261088us
I20260709 13:15:36.587311 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:36.582521 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.526280 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:36.583318 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.588439 31023 raft_consensus.cc:2376] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7. Re-sending same reply.
I20260709 13:15:36.589833 30881 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:36.587261 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.592248 31603 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:36.456823  1696 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.588869 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.527868 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 898) took 2939 ms. Trace:
I20260709 13:15:36.596750 30997 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:36.597791 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.598071 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:36.598399 30950 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:36.597150 31597 rpcz_store.cc:276] 0709 13:15:33.588734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.592425 (+  3691us) service_pool.cc:224] Handling call
0709 13:15:33.592734 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:33.593005 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:35.014417 (+1421412us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.237167 (+222750us) log.cc:844] Serialized 14 byte log entry
0709 13:15:35.292348 (+ 55181us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b1800350860. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:36.504423 (+1212075us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:36.504767 (+   344us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b1800350860. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:15:36.527167 (+ 22400us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.527406 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.527472 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:36.527531 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.527626 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.527794 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2687820,"prepare.queue_time_us":2728173,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":812,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":27262,"spinlock_wait_cycles":62812544,"thread_start_us":222202,"threads_started":1,"wal-append.queue_time_us":314166}
I20260709 13:15:36.599184 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:36.599786 30950 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.600509 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:36.594314 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 364275us
I20260709 13:15:36.595525 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.601621 31605 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:36.601944 31570 connection.cc:256] RPC call timeout handler was delayed by -1.010875710999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:15:36.603266 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 289973us
I20260709 13:15:36.620570 30957 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:15:36.626554 31570 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.604s (SENT)
W20260709 13:15:36.627713 31570 leader_election.cc:336] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.607s (SENT)
W20260709 13:15:36.628680 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 346990us
I20260709 13:15:36.631498  1463 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.633450  1855 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.633951  1855 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.636940 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:36.638583 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:36.499166  1688 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:36.584676  1790 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:36.642198 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.647986 30958 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:36.649132 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:36.642434  1888 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:15:36.588137  1389 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:36.525756  1776 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:15:36.643375  1340 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:36.648020  1883 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.627341  1791 raft_consensus.cc:2764] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:15:36.469826  1879 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.539618  1496 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.595721  1837 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.685175 30958 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:15:36.723537 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2012) took 1108 ms. Trace:
W20260709 13:15:36.723752 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 119894us
I20260709 13:15:36.724038 30958 rpcz_store.cc:276] 0709 13:15:35.615205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.648710 (+1033505us) service_pool.cc:224] Handling call
0709 13:15:36.663408 (+ 14698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.723146 (+ 59738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.723454 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.725689 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:36.726117 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.726517 30958 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 4.
I20260709 13:15:36.727190 31603 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:36.704021  1808 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:36.728430  1808 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:36.728976  1808 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:36.729512 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 80453.1us
I20260709 13:15:36.729724 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.730155 30950 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:36.657611  1790 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:36.696839  1878 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:15:36.627456  1773 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.651417  1886 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:15:36.712116 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 415683us
I20260709 13:15:36.526504  1882 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.721450 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 242139us
I20260709 13:15:36.471498  1535 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:36.610862  1839 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.664278  1695 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:36.731750 31029 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:15:36.732072 30950 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:15:36.730391 31603 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:36.760430 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2015) took 1140 ms. Trace:
I20260709 13:15:36.710886  1901 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.734280 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.626884  1884 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:36.740067 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 110456us
I20260709 13:15:36.687897  1340 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.772306  1845 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.695806  1463 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:36.772663  1340 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:36.749605 31030 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:36.775329 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2493) took 2365 ms. Trace:
I20260709 13:15:36.775739 31024 rpcz_store.cc:276] 0709 13:15:34.409707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.009243 (+599536us) service_pool.cc:224] Handling call
0709 13:15:36.031655 (+1022412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.194391 (+162736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.775101 (+580710us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400347e50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:36.775252 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350572416}
I20260709 13:15:36.776943 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.777422  1346 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.777490 31024 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:36.778065  1893 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:15:36.778378  1159 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.778785 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.710032  1855 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.780870 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 916) took 2021 ms. Trace:
I20260709 13:15:36.757025 31600 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:36.781787 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 1991) took 1227 ms. Trace:
I20260709 13:15:36.626713  1802 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:36.740181  1860 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.358s	user 0.004s	sys 0.000s
I20260709 13:15:36.760797 30950 rpcz_store.cc:276] 0709 13:15:35.619895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.731122 (+1111227us) service_pool.cc:224] Handling call
0709 13:15:36.731860 (+   738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.760178 (+ 28318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.760374 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.762843 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.791561 31029 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
W20260709 13:15:36.793972 30997 connection.cc:256] RPC call timeout handler was delayed by -1.4032772620000742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:15:36.793432 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.771230  1728 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:36.684963  1389 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.782196 30957 rpcz_store.cc:276] 0709 13:15:35.554743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.396209 (+841466us) service_pool.cc:224] Handling call
0709 13:15:36.438919 (+ 42710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.621122 (+182203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.781574 (+160452us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540024bb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:36.781728 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416793856}
I20260709 13:15:36.781436 31596 rpcz_store.cc:276] 0709 13:15:34.759897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.803789 (+ 43892us) service_pool.cc:224] Handling call
0709 13:15:34.804168 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.828297 (+ 24129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.828331 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.828870 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.471902 (+1643032us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b180026f380. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:36.631823 (+159921us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:36.631888 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.631979 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.780347 (+148368us) raft_consensus.cc:1685] finished
0709 13:15:36.780388 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.780757 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18878,"raft.queue_time_us":19002,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":37416,"spinlock_wait_cycles":3436800,"thread_start_us":159394,"threads_started":1,"wal-append.queue_time_us":1866709}
I20260709 13:15:36.748365  1626 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.763810  1843 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.767902  1908 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:36.764119  1669 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:36.785367  1889 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:15:36.790180  1897 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:36.755129  1440 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:36.821313 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 81777.5us
I20260709 13:15:36.795914  1849 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:36.824570 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:36.815737 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.763562  1793 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.759622  1695 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.750013  1869 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.806505 30957 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:36.836119 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2017) took 1182 ms. Trace:
I20260709 13:15:36.836469 30957 rpcz_store.cc:276] 0709 13:15:35.653356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.806045 (+1152689us) service_pool.cc:224] Handling call
0709 13:15:36.806337 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.835875 (+ 29538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.836061 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.837740 30957 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 5. Current term is 6. Ops: []
W20260709 13:15:36.814661 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49095.5us
I20260709 13:15:36.818209 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.790040  1535 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:36.841924 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:36.808821 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:36.794672 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:36.777544  1879 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.851861 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.852178 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:36.801901 31602 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:36.853526  1581 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.818843  1908 consensus_queue.cc:1243] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:36.853927 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.854693 31603 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:36.796685  1791 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:15:36.856194 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 915) took 2096 ms. Trace:
I20260709 13:15:36.857079  1791 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:36.856559 31604 rpcz_store.cc:276] 0709 13:15:34.759610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.770318 (+ 10708us) service_pool.cc:224] Handling call
0709 13:15:34.969403 (+199085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:34.969787 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:34.969831 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:34.978794 (+  8963us) log.cc:844] Serialized 26 byte log entry
0709 13:15:35.240147 (+261353us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:35.240200 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.240282 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:36.306935 (+1066653us) raft_consensus.cc:1685] finished
0709 13:15:36.306954 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.855970 (+549016us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54007143d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:36.856139 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":952,"spinlock_wait_cycles":456880384,"thread_start_us":255047,"threads_started":1,"wal-append.queue_time_us":398505}
I20260709 13:15:36.857079  1688 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.866286  1688 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:36.794536 30997 connection.cc:256] RPC call timeout handler was delayed by -1.3618772620000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:15:36.867996 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1983) took 1344 ms. Trace:
I20260709 13:15:36.868485 31031 rpcz_store.cc:276] 0709 13:15:35.523961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.971312 (+447351us) service_pool.cc:224] Handling call
0709 13:15:35.971682 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.270562 (+298880us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:36.280971 (+ 10409us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.731500 (+450529us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.737300 (+  5800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.737349 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:36.737401 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.867670 (+130269us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540009e2d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:36.867731 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.867922 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76940,"prepare.queue_time_us":21086,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":115383,"raft.run_wall_time_us":13381,"spinlock_wait_cycles":716965120,"thread_start_us":379235,"threads_started":2,"wal-append.queue_time_us":531113}
I20260709 13:15:36.871024 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:36.819154  1843 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.873667  1843 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.875165  1882 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:36.868499  1830 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:36.876479  1908 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:36.876940  1908 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.877102  1882 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.877406  1908 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:36.877657  1882 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.822937  1897 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.833545 31600 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
W20260709 13:15:36.846588  1868 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.866s	user 0.000s	sys 0.002s
I20260709 13:15:36.846805 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.884075 30874 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:36.884173 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.887670 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:36.819674  1790 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.090940 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45416 (request call id 14) took 1764 ms. Trace:
I20260709 13:15:37.326042 31028 rpcz_store.cc:276] 0709 13:15:35.326020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.397030 (+ 71010us) service_pool.cc:224] Handling call
0709 13:15:37.090663 (+1693633us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54001b21d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac54853 00007f273fc2260a 00007f27391a87d4 00007f27391a8762 00007f27391a8691 00007f27391a860c 00007f27391a78c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:37.090828 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142527232}
W20260709 13:15:37.162781 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 338333us
I20260709 13:15:37.327787 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:37.328630 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.328738 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:37.329748  1909 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:37.330181 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:37.330384 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.330976  1909 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:36.885555 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.889552 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:37.364439 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:37.009702 31025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.007s	sys 0.007s
W20260709 13:15:37.127916 30952 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:15:36.886046 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.891791 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.889698 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.884949 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:37.013520 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.022881 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:36.941128 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 195116us
I20260709 13:15:37.412066 30956 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:37.085682 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.411046 30952 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:37.331308 30878 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
W20260709 13:15:37.412492 30956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1992) took 1857 ms (client timeout 2038 ms). Trace:
I20260709 13:15:37.336016 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:37.408322 31029 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:37.021376 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.413659 30957 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:37.332118 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:37.414409 30877 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:37.348820 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:37.414547 30949 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
W20260709 13:15:36.877418 31026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 1982) took 1429 ms (client timeout 1700 ms). Trace:
W20260709 13:15:37.415612 31026 rpcz_store.cc:269] 0709 13:15:35.448179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.515636 (+ 67457us) service_pool.cc:224] Handling call
0709 13:15:36.877231 (+1361595us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400347454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:36.877363 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2801769216}
I20260709 13:15:37.328871 31028 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:37.414196 31030 raft_consensus.cc:2410] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:15:37.409224 31025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.012s	sys 0.016s
W20260709 13:15:37.413177 30956 rpcz_store.cc:269] 0709 13:15:35.554989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.022554 (+1467565us) service_pool.cc:224] Handling call
0709 13:15:37.412429 (+389875us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:37.418917 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.418938 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:37.419492 30924 connection.cc:256] RPC call timeout handler was delayed by -1.3458282580002106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:15:37.337193 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:37.420279 30882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 725) took 2031 ms (client timeout 1692 ms). Trace:
I20260709 13:15:37.420424 31598 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:37.411417 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 526515us
I20260709 13:15:37.408066 31024 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:37.393767 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:37.422695 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:37.526489 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:37.433651 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.526515 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.547034  1926 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:37.547648  1926 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:37.547986 30877 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:37.548175  1926 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:37.347836  1484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.011s	sys 0.020s
W20260709 13:15:36.989462  1782 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.680s	user 0.012s	sys 0.004s
W20260709 13:15:37.385197  1808 consensus_meta.cc:287] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260709 13:15:37.538964 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:37.562391 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1984) took 2024 ms. Trace:
I20260709 13:15:37.562825 30956 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:37.541208 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:37.564253 30957 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:37.565465 30957 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:37.565992 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2027) took 1550 ms. Trace:
I20260709 13:15:37.566293 30957 rpcz_store.cc:276] 0709 13:15:36.015868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.564874 (+1549006us) service_pool.cc:224] Handling call
0709 13:15:37.565157 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.565785 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.565941 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:37.559397 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.560648 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.058152  1843 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:37.432521 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:37.439646 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:37.439324 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:37.570055 31597 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:37.571015 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:37.571146 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:37.433573 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:37.438999 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:37.562978 31025 rpcz_store.cc:276] 0709 13:15:35.538203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.179205 (+641002us) service_pool.cc:224] Handling call
0709 13:15:36.228308 (+ 49103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.228481 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:36.237753 (+  9272us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.561324 (+1323571us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.561548 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:37.561607 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:37.561663 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.562160 (+   497us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.562320 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10136,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3920,"raft.queue_time_us":197,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":105332,"thread_start_us":1322804,"threads_started":2,"wal-append.queue_time_us":1142220}
I20260709 13:15:37.434412 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.884763  1773 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:15:37.576937 30878 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:37.432538 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:36.841650  1695 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.547034 30875 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:37.527421 30949 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:36.923517 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 114770us
I20260709 13:15:37.579805 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.581489 30874 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:37.581593 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:37.063809  1860 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:15:36.882217  1897 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:37.551491 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 214375us
I20260709 13:15:37.552613 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:36.883721  1696 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:37.235872  1739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.011s	sys 0.011s
I20260709 13:15:36.827342  1849 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.923864  1879 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.551054 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:36.879734  1882 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:37.601116 30874 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:15:37.597095  1739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.014s	sys 0.023s
I20260709 13:15:37.602948 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.245632  1883 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:36.986090  1855 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:37.063199  1496 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:37.093184  1440 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:37.084426  1389 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:37.559146 30880 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:37.613284 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.580855  1843 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.622412 30954 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:15:37.535658 30882 rpcz_store.cc:269] 0709 13:15:35.369541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.369648 (+   107us) service_pool.cc:224] Handling call
0709 13:15:37.400414 (+2030766us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54003412d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:37.400604 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780741376}
I20260709 13:15:37.432770  1464 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:37.573345 31596 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
W20260709 13:15:37.549403 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 155724us
I20260709 13:15:37.572576  1688 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:37.629292  1688 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:37.630537  1849 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:37.630290  1688 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:36.840406  1793 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.636866 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.637655 30882 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:37.585651 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 685) took 1139 ms. Trace:
I20260709 13:15:37.638388 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:37.638612 30879 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:37.639134 30882 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:37.638254 30949 rpcz_store.cc:276] 0709 13:15:36.446000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.584865 (+1138865us) service_pool.cc:224] Handling call
0709 13:15:37.585124 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.585290 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.585316 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:37.585353 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:37.585383 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.585438 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.585554 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:37.640077 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 928) took 1162 ms. Trace:
I20260709 13:15:37.640460 31601 rpcz_store.cc:276] 0709 13:15:36.478001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.478413 (+   412us) service_pool.cc:224] Handling call
0709 13:15:36.582877 (+104464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.002237 (+419360us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:37.002289 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.337103 (+334814us) log.cc:844] Serialized 26 byte log entry
0709 13:15:37.551708 (+214605us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:37.551782 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.551951 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.639878 (+ 87927us) raft_consensus.cc:1685] finished
0709 13:15:37.639896 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.640022 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10337,"raft.queue_time_us":142147,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":12302,"thread_start_us":576043,"threads_started":2,"wal-append.queue_time_us":285306}
I20260709 13:15:36.883162  1839 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:37.412863  1909 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:37.062836  1340 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:37.560055  1484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.011s	sys 0.024s
I20260709 13:15:37.587291 30875 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:37.558960  1914 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.588176 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:37.632591  1922 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:15:37.590813 30878 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:15:37.649288 31029 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:37.652817 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:37.653358 30878 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:37.591502 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:37.597018 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 266052us
I20260709 13:15:37.599233 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.605293 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 736) took 2227 ms. Trace:
I20260709 13:15:37.603811 30874 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:37.651311 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.655942 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.604779  1879 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.656912 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:37.607049 31600 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:37.573735  1782 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.573602  1808 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:37.613883 30880 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:37.436245 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:37.717947 31604 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:15:37.616693 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1981) took 2069 ms (client timeout 1761 ms). Trace:
W20260709 13:15:37.718403 30952 rpcz_store.cc:269] 0709 13:15:35.546896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.547705 (+   809us) service_pool.cc:224] Handling call
0709 13:15:37.616512 (+2068807us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54003fedd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:37.616627 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956548352}
I20260709 13:15:37.719684 30952 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:37.720427 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 687) took 1260 ms. Trace:
I20260709 13:15:37.720705 30952 rpcz_store.cc:276] 0709 13:15:36.460164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.719175 (+1259011us) service_pool.cc:224] Handling call
0709 13:15:37.719475 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.720149 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.720372 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:37.620440  1920 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
W20260709 13:15:37.725139 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 66385.7us
I20260709 13:15:37.627485 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:37.590663 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:37.726357 30956 raft_consensus.cc:2410] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:37.651304 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:37.726405 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 99049.7us
I20260709 13:15:37.656340 30882 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:37.662482 31024 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:37.658878 30997 leader_election.cc:336] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.799s (SENT)
W20260709 13:15:37.728668 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69806.6us
W20260709 13:15:37.729516 30997 leader_election.cc:336] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.886s (SENT)
I20260709 13:15:37.656966 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1966) took 3761 ms. Trace:
I20260709 13:15:37.716151 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:37.731148 31025 raft_consensus.cc:2368] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8.
I20260709 13:15:37.732451 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.733301 31025 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:37.631548  1464 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.655191 30881 rpcz_store.cc:276] 0709 13:15:35.377717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.538643 (+160926us) service_pool.cc:224] Handling call
0709 13:15:35.538932 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.590236 (+1051304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.605063 (+1014827us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000d43d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:37.605228 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2416349056}
I20260709 13:15:37.714496 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:37.724455 31031 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:37.637871  1793 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:37.734670 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:37.739197 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2005) took 2137 ms (client timeout 2099 ms). Trace:
I20260709 13:15:37.726967 30875 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:37.736251 30877 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:15:37.739548 30951 rpcz_store.cc:269] 0709 13:15:35.601712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.646884 (+2045172us) service_pool.cc:224] Handling call
0709 13:15:37.739132 (+ 92248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:37.734503 31027 rpcz_store.cc:276] 0709 13:15:33.895559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:34.155926 (+260367us) service_pool.cc:224] Handling call
0709 13:15:34.156453 (+   527us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:35.178561 (+1022108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.178594 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:35.241169 (+ 62575us) log.cc:844] Serialized 78 byte log entry
0709 13:15:35.515579 (+274410us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:35.979909 (+464330us) log.cc:844] Serialized 14 byte log entry
0709 13:15:36.008472 (+ 28563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.034878 (+ 26406us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b1800475660. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:37.656664 (+1621786us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001b21d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:37.656713 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:37.656764 (+    51us) raft_consensus.cc:1685] finished
0709 13:15:37.656775 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:37.656913 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":784184,"prepare.queue_time_us":106164,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":873106,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":11470,"spinlock_wait_cycles":515778304,"thread_start_us":630631,"threads_started":2,"wal-append.queue_time_us":387032,"wal-append.run_cpu_time_us":3050,"wal-append.run_wall_time_us":1193846}
I20260709 13:15:37.730023 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:37.744455 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:37.744769 30997 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.932s (SENT)
I20260709 13:15:37.745882 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:37.738101  1389 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:37.744020  1464 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:37.747186  1389 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:37.748028 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:37.649741  1909 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:37.905296  1916 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
W20260709 13:15:37.914676  1920 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:37.651248  1926 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.659376  1914 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:37.873603 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:38.071156 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 694) took 1365 ms. Trace:
W20260709 13:15:38.071331  1929 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.498s	user 0.000s	sys 0.008s
I20260709 13:15:38.095889 30956 rpcz_store.cc:276] 0709 13:15:36.705665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.735325 (+1029660us) service_pool.cc:224] Handling call
0709 13:15:38.070634 (+335309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.070828 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.070850 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.070891 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.070921 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.070971 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.071095 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:37.751739  1899 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:38.074051  1695 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:38.074481 31025 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:38.104889 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 569) took 1231 ms. Trace:
I20260709 13:15:38.105310 31025 rpcz_store.cc:276] 0709 13:15:36.873369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.818237 (+944868us) service_pool.cc:224] Handling call
0709 13:15:38.074115 (+255878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.104571 (+ 30456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.104818 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:38.107867 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.075376 31570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.674s (SENT) [suppressed 61 similar messages]
I20260709 13:15:37.738265  1811 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:15:37.750995 31029 raft_consensus.cc:2368] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11.
I20260709 13:15:38.078490 30878 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:38.119925 30874 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.079011 31604 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:37.752274 31597 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:37.776575  1389 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.082937 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 1990) took 1693 ms. Trace:
I20260709 13:15:38.083381  1926 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:38.083917  1879 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.085337 31603 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:38.085274  1914 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:38.087497  1605 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:38.089313 30955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2009) took 2486 ms (client timeout 1520 ms). Trace:
W20260709 13:15:38.091316 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 340839us
I20260709 13:15:38.109493  1693 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:38.091881 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 756023us
I20260709 13:15:38.110035 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:38.122282 31023 rpcz_store.cc:276] 0709 13:15:36.389711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.601102 (+211391us) service_pool.cc:224] Handling call
0709 13:15:36.644649 (+ 43547us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:36.661403 (+ 16754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.661449 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:36.662332 (+   883us) log.cc:844] Serialized 78 byte log entry
0709 13:15:37.133568 (+471236us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:37.133635 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:37.133737 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.082702 (+948965us) raft_consensus.cc:1685] finished
0709 13:15:38.082726 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.082881 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3511,"raft.queue_time_us":51701,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":16575,"thread_start_us":392439,"threads_started":1,"wal-append.queue_time_us":680332}
I20260709 13:15:38.096271  1440 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.141517 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 692) took 1519 ms. Trace:
I20260709 13:15:38.159170 30952 rpcz_store.cc:276] 0709 13:15:36.621824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.721339 (+1099515us) service_pool.cc:224] Handling call
0709 13:15:37.749039 (+ 27700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.141092 (+392053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.141125 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.141172 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:38.141211 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.141289 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.141444 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":391748,"raft.queue_time_us":404037}
I20260709 13:15:38.148317 30876 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:38.150806 30955 rpcz_store.cc:269] 0709 13:15:35.602741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.603788 (+  1047us) service_pool.cc:224] Handling call
0709 13:15:38.089119 (+2485331us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540002fdd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:38.089236 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846561664}
I20260709 13:15:38.092985 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:38.152690 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:38.161547 31600 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:38.162757 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:38.164381 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 71487.8us
I20260709 13:15:38.165480 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:38.170169 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.171808 31024 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:38.180150 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.180938 31023 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:38.188414  1610 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:38.188979  1610 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.191032  1610 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.194149 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:38.145507  1849 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:38.191524  1610 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.287863 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 566) took 1415 ms. Trace:
I20260709 13:15:38.288511 31027 rpcz_store.cc:276] 0709 13:15:36.872498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.745325 (+872827us) service_pool.cc:224] Handling call
0709 13:15:37.745600 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.745794 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:37.830233 (+ 84439us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.287294 (+457061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.287380 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:38.287456 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.287566 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.287754 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77264,"prepare.queue_time_us":105201,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":55,"thread_start_us":129923,"threads_started":1}
I20260709 13:15:38.291877 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:38.291785 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 97700.4us
I20260709 13:15:38.293226 31027 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:38.294664 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:38.295410 31027 raft_consensus.cc:2376] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11. Re-sending same reply.
I20260709 13:15:38.296491 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.292163 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:38.297317 31027 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:38.297786 31023 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:15:38.298974 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 223616us
I20260709 13:15:38.164124  1855 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.301673 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.308161 31601 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:38.339510 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.340530 31023 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:38.160012  1605 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:38.203465  1798 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:38.355943 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2014) took 2739 ms. Trace:
I20260709 13:15:38.287650  1877 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:38.293509  1610 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.359833 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:38.304952  1484 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:38.174190  1440 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.367061 31027 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:38.370939 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 790545us
I20260709 13:15:38.371122 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 570) took 1497 ms. Trace:
I20260709 13:15:38.371731 31027 rpcz_store.cc:276] 0709 13:15:36.873633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.345218 (+1471585us) service_pool.cc:224] Handling call
0709 13:15:38.345658 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.370740 (+ 25082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.371044 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.356550 30958 rpcz_store.cc:276] 0709 13:15:35.616055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.727549 (+1111494us) service_pool.cc:224] Handling call
0709 13:15:36.733804 (+  6255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.734212 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:36.820842 (+ 86630us) log.cc:844] Serialized 14 byte log entry
0709 13:15:37.013827 (+192985us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.088347 (+1074520us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18003bc020. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:38.305190 (+216843us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.305346 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:38.305390 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:38.305436 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.305516 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.355843 (+ 50327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1072055,"prepare.queue_time_us":150768,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":1092880,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":43381,"spinlock_wait_cycles":87177856,"thread_start_us":472304,"threads_started":3,"wal-append.queue_time_us":514445}
I20260709 13:15:38.166776  1693 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.313660  1782 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:38.343043  1843 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.363852 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:38.358330  1798 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:38.364758  1340 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.366394  1610 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.434542 31027 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:38.435515 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 573) took 1561 ms. Trace:
I20260709 13:15:38.335148  1855 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:38.300303  1849 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.371883  1484 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:38.436817  1936 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:15:38.438279  1605 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:38.342924  1791 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:15:38.441799 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 684) took 2050 ms. Trace:
I20260709 13:15:38.477885 30957 rpcz_store.cc:276] 0709 13:15:36.391307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.566975 (+1175668us) service_pool.cc:224] Handling call
0709 13:15:37.567254 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.567459 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.567484 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.576999 (+  9515us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.051928 (+474929us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:38.052013 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.052187 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:38.441490 (+389303us) raft_consensus.cc:1685] finished
0709 13:15:38.441517 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:38.441722 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":439094,"threads_started":1,"wal-append.queue_time_us":754660}
I20260709 13:15:38.442654  1914 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:38.443989  1695 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:38.470371  1908 consensus_meta.cc:287] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.592s	user 0.018s	sys 0.004s
I20260709 13:15:38.444398  1798 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:38.450124  1921 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.115s	user 0.006s	sys 0.003s
I20260709 13:15:38.453441  1693 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.525151 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:38.455332  1440 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:38.593904 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 68864.7us
I20260709 13:15:38.476181  1484 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:38.465324  1464 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.718s	user 0.018s	sys 0.009s
I20260709 13:15:38.602784  1464 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.604229 31032 raft_consensus.cc:2368] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:38.605553  1464 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.481025  1946 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:38.606247  1693 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.606693  1946 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.607321  1946 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:38.600791  1340 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:38.467612 31027 rpcz_store.cc:276] 0709 13:15:36.874459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.372799 (+1498340us) service_pool.cc:224] Handling call
0709 13:15:38.434078 (+ 61279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.435170 (+  1092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.435447 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.607023  1693 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:38.521981 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 359268us
I20260709 13:15:38.637863 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:38.613019  1340 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.639390 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:38.627027  1798 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:38.493649  1908 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:38.655416 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 295676us
I20260709 13:15:38.656479 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:38.677884 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:38.678768 31600 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:38.681766 31027 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:38.682703 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 577) took 1802 ms. Trace:
I20260709 13:15:38.683145 31027 rpcz_store.cc:276] 0709 13:15:36.880542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.631437 (+1750895us) service_pool.cc:224] Handling call
0709 13:15:38.652001 (+ 20564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.682380 (+ 30379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.682635 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:38.644651  1340 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:38.693104 31600 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:38.699422 31602 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:15:38.680272  1440 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:38.755401 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:38.761384 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.680047  1877 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:38.804177  1610 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.805840 31023 raft_consensus.cc:2368] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:38.807134  1610 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.809324  1877 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:38.812389  1942 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:15:38.751863  1950 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.761667  1947 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.799916  1883 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:38.836118  1950 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:38.840735  1958 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.841537  1958 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.698155  1945 consensus_queue.cc:1059] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 13:15:38.854874  1855 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:38.856508  1849 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.856074  1946 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.865248  1849 raft_consensus.cc:3055] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:38.870193  1849 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:38.871245  1849 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:38.867786  1693 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.869202  1908 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:38.875197  1946 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:38.876592  1909 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.000s	user 0.012s	sys 0.000s
I20260709 13:15:38.876909  1484 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.877059  1909 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.858104  1883 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:38.845400  1947 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:38.887873 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.888787 31027 raft_consensus.cc:2410] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:38.889246  1947 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:38.890900  1951 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:15:38.893514  1883 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.896404  1958 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.908685  1909 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:38.879115  1484 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:38.930732  1909 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:38.932420  1440 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:38.932904  1440 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:38.933876  1440 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.907338  1340 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:38.974159  1340 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:39.035730 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 105337us
W20260709 13:15:39.072587 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.106305 31571 leader_election.cc:336] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.692s (SENT)
I20260709 13:15:39.297940 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 737) took 2144 ms. Trace:
I20260709 13:15:39.298970 30883 rpcz_store.cc:276] 0709 13:15:37.153741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.584159 (+430418us) service_pool.cc:224] Handling call
0709 13:15:37.584559 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.584985 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:37.585024 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:37.591671 (+  6647us) log.cc:844] Serialized 26 byte log entry
0709 13:15:38.066518 (+474847us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:38.066565 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:38.066654 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.296949 (+1230295us) raft_consensus.cc:1685] finished
0709 13:15:39.297053 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.297554 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":310,"raft.queue_time_us":656,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4516,"thread_start_us":456294,"threads_started":1,"wal-append.queue_time_us":506645}
W20260709 13:15:37.294273 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.022s
W20260709 13:15:39.304160 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.712s	user 0.012s	sys 0.025s
W20260709 13:15:39.304864 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 2.86175e+06us
I20260709 13:15:39.310869 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2330) took 1782 ms. Trace:
I20260709 13:15:39.313098 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2327) took 1969 ms. Trace:
W20260709 13:15:39.315402 30879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2323) took 2426 ms (client timeout 1803 ms). Trace:
W20260709 13:15:39.320837 30922 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.002s	sys 0.002s
W20260709 13:15:39.321911 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.000s	sys 0.017s
W20260709 13:15:39.330016 30848 connection.cc:256] RPC call timeout handler was delayed by -2.865473872000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2948s for a response
W20260709 13:15:39.332273 30949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.045s	user 0.002s	sys 0.002s
W20260709 13:15:39.332894 30950 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.008s	sys 0.009s
I20260709 13:15:39.342566 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2011) took 3739 ms. Trace:
W20260709 13:15:39.343267 30949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.002s	sys 0.003s
I20260709 13:15:39.343204 30954 rpcz_store.cc:276] 0709 13:15:35.603214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.641876 (+1038662us) service_pool.cc:224] Handling call
0709 13:15:37.621999 (+980123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.622961 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.340920 (+1717959us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54003fedd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.342166 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203273600}
I20260709 13:15:39.340994 30877 rpcz_store.cc:276] 0709 13:15:37.343850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.601028 (+257178us) service_pool.cc:224] Handling call
0709 13:15:37.601374 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:37.740345 (+138971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.312542 (+1572197us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54000a0fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:39.312957 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309507328}
I20260709 13:15:39.345156 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 686) took 2893 ms. Trace:
I20260709 13:15:39.345702 30949 rpcz_store.cc:276] 0709 13:15:36.451689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.640160 (+1188471us) service_pool.cc:224] Handling call
0709 13:15:37.640457 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.150852 (+510395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:38.150884 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:38.160657 (+  9773us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.344392 (+1183735us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.344511 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.344690 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.344770 (+    80us) raft_consensus.cc:1685] finished
0709 13:15:39.344783 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.345029 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":499941,"raft.queue_time_us":509494,"spinlock_wait_cycles":34467584,"thread_start_us":1056940,"threads_started":1,"wal-append.queue_time_us":655018}
W20260709 13:15:39.341364 30879 rpcz_store.cc:269] 0709 13:15:36.889225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.889423 (+   198us) service_pool.cc:224] Handling call
0709 13:15:39.315035 (+2425612us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540039c1d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.315210 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522948992}
W20260709 13:15:39.351888 30950 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.008s	sys 0.009s
W20260709 13:15:39.353833 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.000s	sys 0.018s
W20260709 13:15:39.354452 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 977639us
I20260709 13:15:39.340665 30874 rpcz_store.cc:276] 0709 13:15:37.528093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.724124 (+196031us) service_pool.cc:224] Handling call
0709 13:15:38.119730 (+395606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.120316 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.310398 (+1190082us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540005a0d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.310667 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":909082880}
I20260709 13:15:39.357169 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2324) took 2466 ms. Trace:
I20260709 13:15:39.358073 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:39.358734 30953 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 1993) took 3803 ms (client timeout 1648 ms). Trace:
W20260709 13:15:39.359192 30953 rpcz_store.cc:269] 0709 13:15:35.555302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.595833 (+ 40531us) service_pool.cc:224] Handling call
0709 13:15:39.358219 (+3762386us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54003fe8d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.358484 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3554803584}
W20260709 13:15:39.360652 30922 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.003s	sys 0.003s
I20260709 13:15:39.360853 30923 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:39.363010 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:39.353430 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2016) took 3711 ms. Trace:
I20260709 13:15:39.357713 30876 rpcz_store.cc:276] 0709 13:15:36.890274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.890416 (+   142us) service_pool.cc:224] Handling call
0709 13:15:36.890671 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.160582 (+1269911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.356599 (+1196017us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001261d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:39.356941 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891705728}
I20260709 13:15:39.364233 30950 rpcz_store.cc:276] 0709 13:15:35.642455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.790724 (+1148269us) service_pool.cc:224] Handling call
0709 13:15:36.791007 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.791214 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:37.275561 (+484347us) log.cc:844] Serialized 14 byte log entry
0709 13:15:38.379878 (+1104317us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.352670 (+972792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.352801 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:39.352954 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.353081 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.353363 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740222,"prepare.queue_time_us":456101,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":3074,"raft.queue_time_us":1047952,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":11467,"thread_start_us":1807595,"threads_started":4,"wal-append.queue_time_us":271471}
I20260709 13:15:39.374960 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:39.378310 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:39.380188 30921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.012s	sys 0.001s
W20260709 13:15:39.389456 30921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.013s	sys 0.001s
I20260709 13:15:39.391528 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:39.393661 30950 pending_rounds.cc:85] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 5
I20260709 13:15:39.394121 30950 pending_rounds.cc:107] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:39.394534 30950 raft_consensus.cc:2889] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:39.395607 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:39.362473 30776 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 1 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 5 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.404727 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 589) took 1314 ms. Trace:
I20260709 13:15:39.405272 31023 rpcz_store.cc:276] 0709 13:15:38.090262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.345065 (+254803us) service_pool.cc:224] Handling call
0709 13:15:39.404219 (+1059154us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540007c954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.404501 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970381184}
I20260709 13:15:39.407106 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:39.397365 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:39.409013 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:39.410974 31024 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:39.412876  1966 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.413753 31023 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:39.415263 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.394140 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:38.889639 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:39.379880  1965 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:15:39.418916 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2498) took 2674 ms (client timeout 2845 ms). Trace:
I20260709 13:15:39.420783 31026 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:39.411752 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 578) took 2530 ms. Trace:
W20260709 13:15:39.422345 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 576) took 2542 ms (client timeout 1564 ms). Trace:
I20260709 13:15:39.425400 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.429047 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.421211 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:39.432636 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:39.436058 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.000s	sys 0.008s
I20260709 13:15:39.451435 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 748) took 1826 ms. Trace:
I20260709 13:15:39.386075 30998 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:39.457902 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 580) took 2573 ms. Trace:
I20260709 13:15:39.474458 31024 rpcz_store.cc:276] 0709 13:15:36.880811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.410051 (+2529240us) service_pool.cc:224] Handling call
0709 13:15:39.410582 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.411437 (+   855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.411667 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:39.465293  1946 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.466187  1947 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.466899  1953 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.467525  1955 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.468655 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1014) took 3955 ms. Trace:
W20260709 13:15:39.474567 31032 rpcz_store.cc:269] 0709 13:15:36.880206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.008804 (+128598us) service_pool.cc:224] Handling call
0709 13:15:39.421896 (+2413092us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400146754. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.422159 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742380416}
I20260709 13:15:39.469292 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:39.465399 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.476203 31023 rpcz_store.cc:276] 0709 13:15:36.881388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.412411 (+2531023us) service_pool.cc:224] Handling call
0709 13:15:39.413169 (+   758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.445204 (+ 32035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.454421 (+  9217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:39.479521 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.001s	sys 0.009s
I20260709 13:15:39.475319 30880 rpcz_store.cc:276] 0709 13:15:37.624543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.734095 (+109552us) service_pool.cc:224] Handling call
0709 13:15:39.315914 (+1581819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:39.316689 (+   775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:39.316758 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:39.317636 (+   878us) log.cc:844] Serialized 26 byte log entry
0709 13:15:39.450218 (+132582us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:39.450261 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.450344 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.450390 (+    46us) raft_consensus.cc:1685] finished
0709 13:15:39.450400 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.451003 (+   603us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540039c1d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.451255 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137702,"spinlock_wait_cycles":3636724992,"thread_start_us":132102,"threads_started":1,"wal-append.queue_time_us":130031}
I20260709 13:15:39.481781 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:39.484241 30958 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:39.485909 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 64871.5us
I20260709 13:15:39.486917 30955 raft_consensus.cc:2368] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:39.486639 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.487579  1971 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:39.485934 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.483536 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:39.472510 31031 rpcz_store.cc:269] 0709 13:15:36.744408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.870675 (+126267us) service_pool.cc:224] Handling call
0709 13:15:39.418438 (+2547763us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54000c49d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:39.418701 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960718208}
I20260709 13:15:39.468806  1956 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.493618  1693 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.503243 30954 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:39.501868 30956 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:39.503846 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 161675us
I20260709 13:15:39.512455 31025 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:39.509665 30957 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.483526  1957 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.528342 31600 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.515710 30951 raft_consensus.cc:2376] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9. Re-sending same reply.
I20260709 13:15:39.516232 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.494639 31599 rpcz_store.cc:276] 0709 13:15:35.512740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.513472 (+   732us) service_pool.cc:224] Handling call
0709 13:15:35.513743 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:36.239044 (+725301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.239076 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:36.244848 (+  5772us) log.cc:844] Serialized 26 byte log entry
0709 13:15:36.385042 (+140194us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:36.385088 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.467861 (+3082773us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540014f0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:39.467944 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:39.468046 (+   102us) raft_consensus.cc:1685] finished
0709 13:15:39.468057 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.468430 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5494,"spinlock_wait_cycles":1667153152,"thread_start_us":122101,"threads_started":1,"wal-append.queue_time_us":390049,"wal-append.run_cpu_time_us":1840,"wal-append.run_wall_time_us":1123774}
I20260709 13:15:39.516891  1971 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:39.517480  1722 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.517819 30952 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:39.533316 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.503089  1956 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:39.534682  1956 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:39.537053 30848 connection.cc:256] RPC call timeout handler was delayed by -2.7057419239999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 13:15:39.537499 30848 connection.cc:256] RPC call timeout handler was delayed by -2.662957864999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:15:39.538482 30848 connection.cc:256] RPC call timeout handler was delayed by -2.4897205209999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:15:39.524448 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.539552  1798 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:15:39.540417 30848 connection.cc:256] RPC call timeout handler was delayed by -2.4402205210001284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 13:15:39.540663  1798 consensus_queue.cc:1243] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:15:39.540851 30848 connection.cc:256] RPC call timeout handler was delayed by -2.3934205210000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 13:15:39.541314 30848 connection.cc:256] RPC call timeout handler was delayed by -2.3844205210000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:15:39.541440  1798 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:39.541647 30848 connection.cc:256] RPC call timeout handler was delayed by -2.3502205209999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260709 13:15:39.541919  1798 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:39.544696  1808 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:39.542017 30848 connection.cc:256] RPC call timeout handler was delayed by -2.2080205209999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 13:15:39.544353  1947 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:39.545636 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:39.547346  1947 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:39.548053  1947 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:39.547963  1953 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:39.548933 30848 connection.cc:256] RPC call timeout handler was delayed by -2.1405205210000986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:15:39.549327 30848 connection.cc:256] RPC call timeout handler was delayed by -2.0892205210000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 13:15:39.549656 30848 connection.cc:256] RPC call timeout handler was delayed by -1.9821205210000699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 13:15:39.549938 30848 connection.cc:256] RPC call timeout handler was delayed by -1.94565786499993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2685s for a response
W20260709 13:15:39.550233 30848 connection.cc:256] RPC call timeout handler was delayed by -1.9188298950000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 13:15:39.550524 30848 connection.cc:256] RPC call timeout handler was delayed by -1.7870976530000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:15:39.550856 30848 connection.cc:256] RPC call timeout handler was delayed by -1.7424555960001271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 13:15:39.551039  1953 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:39.551165 30848 connection.cc:256] RPC call timeout handler was delayed by -1.4659597110000959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:15:39.551726 30848 connection.cc:256] RPC call timeout handler was delayed by -1.4659597110000959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:15:39.552124 31604 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:39.552140  1389 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:39.553701 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:39.552134 30848 connection.cc:256] RPC call timeout handler was delayed by -1.3795597110001836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:15:39.554862 30848 connection.cc:256] RPC call timeout handler was delayed by -1.1905597110001054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 13:15:39.555156 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0492597110001043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:15:39.534718  1883 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.515794 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.554701 31604 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:39.521654 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:39.538090  1955 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:39.539881 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.501823  1855 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.532198 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.569238 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:39.572750 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:39.573699 31027 raft_consensus.cc:2410] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:15:39.555929  1722 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:39.574819  1957 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:39.583207 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.584090 30958 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:39.584281 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:39.585126 31605 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:39.585261 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:39.557384 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:39.578372 30923 leader_election.cc:400] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8.
I20260709 13:15:39.590751 30923 leader_election.cc:403] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:15:39.584133 30955 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:39.584137  1688 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.593762 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:39.583612 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:39.596869 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.594799 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:39.580729  1722 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.596506 31599 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:39.687338 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:39.579137  1855 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:39.718183 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 134688us
I20260709 13:15:39.724540 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:39.727167  1869 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:39.727873  1688 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:39.729336 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 66831.5us
I20260709 13:15:39.718194  1815 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:39.732280 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.551985  1946 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:39.756479 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 208819us
I20260709 13:15:39.742544 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.761911  1952 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.198s
I20260709 13:15:39.762501 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.762307 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:39.763253 30874 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:39.763077 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:39.759848 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:39.768682 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 217808us
I20260709 13:15:39.763118 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.778466 30951 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.778288 30881 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:39.779524 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.196s	user 0.004s	sys 0.011s
W20260709 13:15:39.786851 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 401017us
I20260709 13:15:39.788101 31600 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:39.756999  1855 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:39.791191 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.004s	sys 0.012s
I20260709 13:15:39.562590  1968 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.327s
I20260709 13:15:39.794080 30956 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:39.797757 30958 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:39.805436  1869 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:39.808192  1798 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:39.809847  1798 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.812964 30954 raft_consensus.cc:2410] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:39.813532 30922 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:39.813942 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.814683 30954 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:39.815011 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:39.815918  1945 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.816295  1953 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.816706  1953 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.816555  1945 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:39.817070  1953 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.818743  1945 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:39.819278  1945 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.790683  1693 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8.
I20260709 13:15:39.820679 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:39.820994  1955 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:39.821471 31596 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:39.821583  1915 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:39.821986  1915 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.822312  1915 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.822927 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:39.823724 30878 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:39.815608 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.833284 30957 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:39.835691 30951 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:39.819604  1945 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:39.848393 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 52033.1us
W20260709 13:15:39.835228 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 1.52947e+06us
I20260709 13:15:39.852507 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.850400 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.851596 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.861878 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:39.861840 30955 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 6.
I20260709 13:15:39.795990  1811 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:39.859465 30957 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:39.849999  1966 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:39.848009  1869 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:39.855258  1945 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:39.925680 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.907465 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.865927 30998 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:39.867278 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.916935 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.917486 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 938) took 2292 ms. Trace:
W20260709 13:15:39.945062 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 83114.5us
W20260709 13:15:39.903172 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 43535.3us
I20260709 13:15:39.885180 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:39.956183 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 107069us
I20260709 13:15:39.956008 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:39.957659 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.958455 30955 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:39.959954  1976 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:39.961161  1946 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:39.961874 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.868461  1966 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:39.963030  1811 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:39.966635 30949 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:39.956071 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:39.967276 30956 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 5.
I20260709 13:15:39.864217  1971 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:39.970726 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:39.971529 30958 raft_consensus.cc:2368] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7.
I20260709 13:15:39.859581  1815 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:15:39.891561  1947 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:39.967736 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:39.902912  1955 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:39.976990  1976 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:39.974781 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:39.981141 30955 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:15:39.975538 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:39.983597 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 65306.7us
I20260709 13:15:39.990064 30956 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:15:39.972857  1869 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:39.991218 30958 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:39.976821  1947 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:39.945327 31598 rpcz_store.cc:276] 0709 13:15:37.625408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.626205 (+   797us) service_pool.cc:224] Handling call
0709 13:15:37.626596 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:37.626826 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:37.650107 (+ 23281us) log.cc:844] Serialized 14 byte log entry
0709 13:15:39.782314 (+2132207us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b1800455da0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:15:39.916789 (+134475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:39.916891 (+   102us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:39.917009 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:39.917123 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:39.917278 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21920,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":34,"raft.queue_time_us":652,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":222,"spinlock_wait_cycles":2371456,"thread_start_us":109705,"threads_started":1,"wal-append.queue_time_us":2299187}
W20260709 13:15:39.996518 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 76347.9us
W20260709 13:15:40.000957 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 219185us
I20260709 13:15:40.005089  1811 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.011862  1976 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:40.014894  1839 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:40.015353  1839 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.015690  1839 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:39.993600  1947 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.001271 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:40.024017 30957 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:40.035614  1440 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:40.037873 30881 raft_consensus.cc:2410] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:40.041603 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:40.046809 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 54857.7us
I20260709 13:15:40.032096  1957 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.060052  1695 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:40.060722  1695 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:40.061537  1839 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.061895  1695 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.064862 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:40.001578  1955 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.066761  1849 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.067680 30951 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:40.067538  1839 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:40.068586  1839 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:40.056351  1869 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:40.068861 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:40.067814 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 98985.8us
I20260709 13:15:40.052198 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.073447 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:40.071084  1956 consensus_meta.cc:287] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.004s
I20260709 13:15:40.035588  1953 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.080019 31596 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:40.082348 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:40.085630  1535 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.087237  1953 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.091564 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.092730  1976 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.093957 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:40.094462  1976 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:40.096558  1908 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:40.097061  1940 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.717s	user 0.018s	sys 0.013s
I20260709 13:15:40.097427  1908 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:40.099236  1908 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:40.042080  1915 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.072947  1839 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:40.108153 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.109175 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:40.111621 30956 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 6: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:40.117295 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.117012 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.116130 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.165649 31601 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:40.126652 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 82486.8us
I20260709 13:15:40.129329 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 933) took 2728 ms. Trace:
I20260709 13:15:40.114392 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.097069  1976 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:40.132213 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 63469.2us
I20260709 13:15:40.124240 30776 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 4 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:40.126623 31597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 936) took 2599 ms (client timeout 2229 ms). Trace:
W20260709 13:15:40.174330 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 63417.5us
I20260709 13:15:40.166500 31602 rpcz_store.cc:276] 0709 13:15:37.401002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.401140 (+   138us) service_pool.cc:224] Handling call
0709 13:15:37.401550 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:38.751493 (+1349943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.128736 (+1377243us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400541354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:40.129112 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2983993728}
I20260709 13:15:40.183872 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.184211 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.184723 30950 raft_consensus.cc:2410] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:15:40.185058 31605 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:40.109795  1839 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.179477 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:40.180595 31597 rpcz_store.cc:269] 0709 13:15:37.527389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.570745 (+ 43356us) service_pool.cc:224] Handling call
0709 13:15:40.126080 (+2555335us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400459cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:40.126376 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415270144}
W20260709 13:15:40.125440  1928 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 2.793s	user 0.013s	sys 0.029s
I20260709 13:15:40.196686  1389 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.197351 30957 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:15:40.197651 30997 leader_election.cc:336] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.581s (SENT)
I20260709 13:15:40.200042 30953 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:40.201570  1945 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:40.206291 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 124105us
I20260709 13:15:40.206774  1869 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:40.207938 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 98834.4us
I20260709 13:15:40.208680  1976 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:40.217088 30923 leader_election.cc:400] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11.
W20260709 13:15:40.208693 30780 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 246) took 21738 ms (client timeout 15000 ms). Trace:
I20260709 13:15:40.128278  1610 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:40.090983  1956 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.114193  1881 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.116096  1950 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:40.191855 30776 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 4 to 5, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 7 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:40.192312  1957 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.115662  1722 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.219393  1976 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:40.125924  1983 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.101s
W20260709 13:15:40.230093  1925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.894s	user 0.030s	sys 0.067s
I20260709 13:15:40.234164 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.222934  1610 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:40.243669 31570 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:40.243851 30953 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:40.248804 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:40.250403 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 200039us
I20260709 13:15:40.251363 31024 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:40.246863 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.256004 30954 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:40.233099 30776 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 6 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:40.240437  1976 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:40.243458  1925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.093s	user 0.031s	sys 0.068s
I20260709 13:15:40.270344 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.252691  1971 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:40.271754 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.256381  1955 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.277225 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.273116 31024 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:40.280285 31032 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:40.276851 30997 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.611s (SENT)
W20260709 13:15:40.289489 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 97073.8us
I20260709 13:15:40.296509 30997 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:40.293967 30776 catalog_manager.cc:5697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 5, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 5 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:15:40.255590  1695 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:15:40.291278 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.306033  1881 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:40.308144 30949 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.312155 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.314527 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.315199 30875 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:40.316201 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:40.316628 30878 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:40.317086 30876 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:40.317744 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:40.319109 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:40.324659  1924 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 2.989s	user 0.005s	sys 0.038s
I20260709 13:15:40.324185  1610 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.325567  1610 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.327096  1722 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.328353  1945 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.330232  1695 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:40.330651  1695 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:40.332074  1909 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:40.218434 30780 rpcz_store.cc:269] 0709 13:15:18.470629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:18.470934 (+   305us) service_pool.cc:224] Handling call
0709 13:15:40.208438 (+21737504us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:31.013405 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:31.042149 (+ 28744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:31.042203 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:15:31.042256 (+    53us) tablet.cc:662] Decoding operations
0709 13:15:31.043900 (+  1644us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:31.043986 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:31.044022 (+    36us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:15:31.045415 (+  1393us) tablet.cc:701] Row locks acquired
0709 13:15:31.045492 (+    77us) write_op.cc:260] PREPARE: finished
0709 13:15:31.045678 (+   186us) write_op.cc:270] Start()
0709 13:15:31.045855 (+   177us) write_op.cc:276] Timestamp: P: 1783602931045611 usec, L: 0
0709 13:15:31.045879 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:15:31.156456 (+110577us) log.cc:844] Serialized 6159 byte log entry
0709 13:15:31.799480 (+643024us) op_driver.cc:464] REPLICATION: finished
0709 13:15:32.831236 (+1031756us) write_op.cc:301] APPLY: starting
0709 13:15:32.831344 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:32.831754 (+   410us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:32.831929 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:33.012450 (+180521us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:33.012957 (+   507us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:15:33.013026 (+    69us) write_op.cc:312] APPLY: finished
0709 13:15:33.013624 (+   598us) log.cc:844] Serialized 107 byte log entry
0709 13:15:33.398721 (+385097us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:33.424590 (+ 25869us) write_op.cc:454] Released schema lock
0709 13:15:33.458759 (+ 34169us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:33.527701 (+ 68942us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:33.527731 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":164,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":1019164,"apply.run_cpu_time_us":26048,"apply.run_wall_time_us":670308,"num_ops":15,"prepare.queue_time_us":444759,"prepare.run_cpu_time_us":30281,"prepare.run_wall_time_us":409280,"raft.queue_time_us":57682,"raft.run_cpu_time_us":16169,"raft.run_wall_time_us":173616,"replication_time_us":726333,"thread_start_us":959735,"threads_started":5,"wal-append.queue_time_us":699470,"wal-append.run_cpu_time_us":9783,"wal-append.run_wall_time_us":2246179}]]}
I20260709 13:15:40.317811 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:40.304598 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:40.341678 30883 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:40.346025 31597 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:40.315480 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:40.367353 31599 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:40.367929 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:40.304642 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.347155 31601 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:40.269598  1957 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:15:40.388620 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.388540 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.392803 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:40.394181 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.328388  1915 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:40.397214 31024 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.407965 31596 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:40.409427 30957 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.409933 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.410925 30880 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:40.385111 30776 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 3 to 4, term changed from 4 to 6, 74f5a5b7556240508983221981af4ab4 (127.29.5.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 6 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.425652 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.336743  1971 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:40.335626  1484 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.188s
I20260709 13:15:40.302614  1952 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:15:40.337085  1855 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.331627  1695 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:40.490860 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 123006us
I20260709 13:15:40.487875 30874 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:40.492187 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1029) took 2928 ms. Trace:
I20260709 13:15:40.492115 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.444137 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:40.533723 30958 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:40.488930 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:40.446166 30951 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:40.518379 30957 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:40.533221 31603 rpcz_store.cc:276] 0709 13:15:37.563671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.586455 (+ 22784us) service_pool.cc:224] Handling call
0709 13:15:37.586823 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:38.145576 (+558753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.388162 (+2242586us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b540049a7d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:40.491959 (+103797us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1145965440}
I20260709 13:15:40.396687  1982 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:40.535997 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:40.472900 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:40.536903 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 190183us
W20260709 13:15:40.537673 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 309721us
W20260709 13:15:40.537938 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 222524us
W20260709 13:15:40.462028 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 223562us
I20260709 13:15:40.540627 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:40.513669  1966 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.006s
I20260709 13:15:40.370954  1869 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.496327 30776 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 6 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 7 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.555585 30953 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.495549  1464 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:40.550729  1947 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.009s
I20260709 13:15:40.494118  1883 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:40.558265 30881 raft_consensus.cc:2376] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8. Re-sending same reply.
I20260709 13:15:40.549839  1484 consensus_queue.cc:1243] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:15:40.555819 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.493919  1340 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.556263  1722 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.425153 31032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:15:40.560149 30883 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:40.549672  1956 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.564292  1693 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:40.564814  1991 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:15:40.426810  1811 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:15:40.553059  1915 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.568717  1877 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:40.614449 30883 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:40.614615 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:40.569456 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.615288 31600 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.570531 31032 raft_consensus.cc:606] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:15:40.569993 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.554920  1966 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.569317 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.569159 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.574127 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 710) took 1104 ms. Trace:
I20260709 13:15:40.618592 30949 rpcz_store.cc:276] 0709 13:15:39.469516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.974504 (+504988us) service_pool.cc:224] Handling call
0709 13:15:40.307956 (+333452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.308589 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.573931 (+265342us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400256550. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:40.574064 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748792704}
I20260709 13:15:40.619982 31032 raft_consensus.cc:614] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:40.573491 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 307054us
W20260709 13:15:40.596951 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 56347.6us
I20260709 13:15:40.570611 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.570399 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:40.622350 31024 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:40.580449  1843 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:40.623263  1843 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:40.623327  1877 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:40.624583  1877 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:40.568461  1464 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.626935  1464 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.573160  1971 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:40.571803  1855 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.602484  1695 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.628477 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.580268 30776 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 4 to 6, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 6 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.570271  1883 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.629962 30776 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:15:40.631127  1883 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.570868  1722 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.633574  1722 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.590054 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet adb189bd941147e0924cc38c9f01bd11 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51632
W20260709 13:15:40.634644 30997 leader_election.cc:336] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 3.183s (SENT)
I20260709 13:15:40.642397 31600 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
W20260709 13:15:40.612171 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45037.3us
W20260709 13:15:40.581766  1849 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.005s
W20260709 13:15:40.648489 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.636850 30776 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 5 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.603012  1989 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:40.562812  1947 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.660805 31597 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.662037 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.662694 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.663532 30874 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:40.666838 30952 raft_consensus.cc:2410] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:15:40.668406 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.568982  1982 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:15:40.596558  1340 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:40.673642 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 107522us
I20260709 13:15:40.621927  1915 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.677707 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.669644 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:40.682667 30955 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.683214 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:40.683424 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.683723 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.656155  1993 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:40.690560 30879 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:40.684199  1982 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:40.684345 30848 leader_election.cc:336] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.924s (SENT)
I20260709 13:15:40.690635 31603 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:40.689388 30876 raft_consensus.cc:2376] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8. Re-sending same reply.
I20260709 13:15:40.675635 30776 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 4 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 5 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
W20260709 13:15:40.676477  2002 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:15:40.700838 30875 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:40.701293 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1620) took 1178 ms. Trace:
I20260709 13:15:40.701553 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.673098  1998 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.668752  1464 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.704113 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:40.705930  1966 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.693820 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:40.708595 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.708891 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:40.656610  1989 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:40.710011 30875 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:40.707883  1915 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:40.710127 30952 rpcz_store.cc:276] 0709 13:15:39.523047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.532976 (+  9929us) service_pool.cc:224] Handling call
0709 13:15:40.701062 (+1168086us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540024ca54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:40.701212 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594891008}
I20260709 13:15:40.804256  1843 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:40.803965 31571 leader_election.cc:336] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.575s (SENT)
I20260709 13:15:40.805641  1843 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:40.806422  1971 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:40.807693 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 123387us
W20260709 13:15:40.724007 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.786741 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 152141us
W20260709 13:15:40.716981 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.721099 31601 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:15:40.821486 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 117457us
I20260709 13:15:40.820314 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:40.714485 31570 leader_election.cc:400] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:40.824307 31570 leader_election.cc:403] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:15:40.680783  1976 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.672480  2005 tablet_replica.cc:333] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
W20260709 13:15:40.715109  1995 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:15:40.831967 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:15:40.676704  1883 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.833647 31024 raft_consensus.cc:606] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:40.836769  1915 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
W20260709 13:15:40.861409 30848 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.165s (SENT)
I20260709 13:15:40.861922 31024 raft_consensus.cc:614] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:40.862690 31571 leader_election.cc:336] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.688s (SENT)
I20260709 13:15:40.828050  1966 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:40.867713 31026 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:40.695825  1982 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:40.864387 30776 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 7 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.864912 30875 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.805524  1989 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:40.872468 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 177983us
I20260709 13:15:40.872735 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:40.690285  1839 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.868814  1722 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.893077  1722 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:40.895005  1839 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:40.895991 31598 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:40.895547  1722 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:40.896792  1989 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:40.898561 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.898850  1811 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:40.899268 31032 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:40.890825  1958 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.891800 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:40.891857  1899 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.906335 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.908563 30875 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:40.909754 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89517.1us
I20260709 13:15:40.911481 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.864516  1950 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:40.908437  1855 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:40.916116  1839 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:15:40.919021 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.919260 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.920190 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.899377  1811 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.921505 31597 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:40.918510 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.918584 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:40.920706 31032 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:15:40.923197 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:40.919024  1855 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.920950 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.931757 31023 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:15:40.905398  1966 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:40.936038 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.934052 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:40.949417 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 119552us
I20260709 13:15:40.952163 31028 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:15:40.951383 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:40.933350  2003 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:15:40.955183 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.955471 31027 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:40.953274 30877 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:40.958519 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:40.873916  1464 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.952389 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:40.920343  1839 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:15:40.971928 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:40.963068 30776 catalog_manager.cc:5697] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 5, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 5 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:40.972265 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53755.5us
I20260709 13:15:40.935422  1950 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:40.868692  1998 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.974730 31032 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:40.960878  1915 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:40.980556 30848 leader_election.cc:336] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.191s (SENT)
I20260709 13:15:40.923322  1899 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.966686 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:40.981006 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:40.957645  1340 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:40.982012 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45009.6us
I20260709 13:15:40.982980 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:40.983567 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.987960  1997 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:40.996239  1997 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.996742  1997 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.001055  1998 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:41.001351  1811 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:40.969636  1947 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.001663 31596 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:40.987515 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:40.990060 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:41.003085 31027 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:40.935910  1958 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:40.991065 31597 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:40.989984 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:40.988411  1440 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:40.992470  1966 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.993783  1950 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.977348  1971 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:15:40.959982  1883 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:40.996268 30776 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:41.004766 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:41.013057 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.016350 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.021783 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:41.022166 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.022564 30955 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:41.022758 30952 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:41.019451 31025 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:41.015372  1440 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.024290 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.017948 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:41.028587 31027 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:41.017686 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:41.030139 31570 connection.cc:256] RPC call timeout handler was delayed by -1.392695071999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:15:41.030706 31570 connection.cc:256] RPC call timeout handler was delayed by -1.3224950720000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:15:41.003919  1976 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.039892 31032 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:40.968608  1982 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.045032 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.045878 30883 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:41.032667 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:41.031756 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:41.034298 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.035385  1440 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:41.016486  1952 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:41.016340  1957 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.028441  1839 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:41.043993 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 67767.1us
I20260709 13:15:41.011823  1993 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.052299 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.072813 30955 raft_consensus.cc:2410] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:41.046792 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:41.031293 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.053380 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.053968 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.051509  1695 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:15:41.060124  2005 raft_consensus.cc:2243] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:41.078181  2005 pending_rounds.cc:70] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Trying to abort 2 pending ops.
I20260709 13:15:41.078496  2005 pending_rounds.cc:77] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Aborting op as it isn't in flight: id { term: 5 index: 6 } timestamp: 7305637497731088384 op_type: NO_OP noop_request { }
I20260709 13:15:41.078940  2005 raft_consensus.cc:2889] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:41.079331  2005 pending_rounds.cc:77] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Aborting op as it isn't in flight: id { term: 4 index: 5 } timestamp: 7305637466018156544 op_type: NO_OP noop_request { }
I20260709 13:15:41.062887  1915 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:41.065939 31603 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:41.070984 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:41.040127  1983 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:41.076969 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:41.076504 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 65853us
W20260709 13:15:41.081066 30848 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.233s (SENT)
I20260709 13:15:41.052551 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.085382 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.070433 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:41.094130 31032 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:41.094238 31023 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.081471 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.095116 30877 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.079998  1915 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:41.085386 30924 connection.cc:256] RPC call timeout handler was delayed by -2.1186129089999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 13:15:41.086084  1877 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.086035 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:41.099854 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:41.100387 31025 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:41.100627 31026 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.087961 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:41.101395 31028 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:41.088129  1440 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:41.102312  1440 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:41.082368  1881 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:15:41.103255  1440 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.104476 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.105014  1958 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:41.105154 30883 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:41.088714 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:41.091427  1982 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:41.089465 31570 leader_election.cc:336] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.602s (SENT)
I20260709 13:15:41.106927 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.107302 30878 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:41.090857  1899 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.092471 30875 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:15:41.109231 30875 pending_rounds.cc:85] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 10
I20260709 13:15:41.109493 30875 pending_rounds.cc:107] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:15:41.109740 30875 raft_consensus.cc:2889] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:41.079608  2004 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.161s	user 0.001s	sys 0.002s
W20260709 13:15:41.097894 30924 connection.cc:256] RPC call timeout handler was delayed by -2.0952129089998834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:15:41.113903 30924 connection.cc:256] RPC call timeout handler was delayed by -2.0484129090000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
W20260709 13:15:41.114295 30924 connection.cc:256] RPC call timeout handler was delayed by -1.8513129089999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 13:15:41.114566 30924 connection.cc:256] RPC call timeout handler was delayed by -1.8144129089998842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:15:41.114842 30924 connection.cc:256] RPC call timeout handler was delayed by -1.7073129089999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 13:15:41.115191 30924 connection.cc:256] RPC call timeout handler was delayed by -1.3059129089999715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26280000000000003s for a response
I20260709 13:15:41.116878 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.117933 30952 raft_consensus.cc:2410] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:41.119041 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:41.120172 30848 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.233s (SENT)
I20260709 13:15:41.072507  1855 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.120491 30923 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.120646 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.051707  1952 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:41.129380 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:41.079699  2005 raft_consensus.cc:2889] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:41.106889  1883 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.142062 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:41.143265 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:41.145363 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 127727us
I20260709 13:15:41.146998 30953 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:41.149919 30952 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:41.121605  1958 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:15:41.157549 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68111.4us
I20260709 13:15:41.151532 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.160890 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.163372 31571 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.168007  2015 consensus_queue.cc:1059] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:41.141798  1952 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.141177  1976 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:41.173714 30877 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:41.176420 30953 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:15:41.148077  2005 raft_consensus.cc:2272] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:41.175928 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:41.188762 31570 leader_election.cc:336] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.662s (SENT)
I20260709 13:15:41.179134 30955 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:41.179884 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:41.180688  1484 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:41.181533  1947 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:41.182895 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.183375 31026 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:41.128021  1983 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.099871  1877 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.193219 30952 raft_consensus.cc:2410] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:41.196472 30954 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:15:41.158485  1958 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:41.197134 30951 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:41.223438  1958 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.197142 30957 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:41.189076 30950 raft_consensus.cc:2376] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11. Re-sending same reply.
I20260709 13:15:41.156638  1998 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.204039 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.225704 30955 raft_consensus.cc:2410] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:15:41.193635  1966 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.208060  1464 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.208096 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:41.227468 30953 raft_consensus.cc:2376] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8. Re-sending same reply.
I20260709 13:15:41.212374 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.214509  1997 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.221329  1983 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:41.222177 31570 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.674s (SENT)
I20260709 13:15:41.229264 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:41.229945  1993 raft_consensus.cc:3055] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:41.230383  1993 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:41.231297 31570 leader_election.cc:336] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.692s (SENT)
W20260709 13:15:41.233403 31570 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.768s (SENT)
I20260709 13:15:41.234367  1877 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.236202  1947 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:41.236434  1997 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:41.236608  1947 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:41.237648  1947 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:41.238870  1947 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:41.242408  1722 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:41.244570 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:41.246821 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:41.191573  1839 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:41.196832 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.232066  1983 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.191890  1855 raft_consensus.cc:2706] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Received pre-election callback for term 6 while not running: Illegal state: RaftConsensus is not running: State = Stopped
W20260709 13:15:41.249491 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 168113us
I20260709 13:15:41.256597 31023 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
W20260709 13:15:41.290846 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 199794us
W20260709 13:15:41.291018 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 164983us
I20260709 13:15:41.292186 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:41.292702 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:41.294010 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 97299.6us
I20260709 13:15:41.193156  1484 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:41.295902 30997 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.550s (SENT)
I20260709 13:15:41.296761 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:41.262105  1839 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.231231  1993 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.249571  1849 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.268262  1877 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.262262  2015 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:41.361594 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.362664 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 242507us
I20260709 13:15:41.360994  1839 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.359990  1722 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.291939  1966 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:15:41.364166  1899 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.397599  1484 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.400416  1966 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:41.400843  1966 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:41.401808  1966 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.403159  1966 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:41.405380 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 90930.4us
I20260709 13:15:41.408413  1915 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.410620  1915 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:41.308269  1464 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:15:41.367206  2017 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:41.378352  2016 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:15:41.392987 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.396103 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 103165us
I20260709 13:15:41.403596 31027 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:41.421128 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:41.415022  1998 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:41.387952 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.423823 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.407613 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:41.366082  2015 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.425694 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:41.427431 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.429198 31032 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:41.378213  1877 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:41.428083 31601 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:41.438099 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.399608  1958 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.443512 31603 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:41.443683  1958 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.444856 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:41.446141 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:41.446786 31025 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:41.447624 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:41.448663  1958 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:41.449069  1958 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:41.449437  1958 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:41.450361 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.451282  1947 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:41.452190  1947 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:41.452939  2005 ts_tablet_manager.cc:1916] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:41.453074  1947 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:41.456030 31026 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:15:41.459636 31028 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:41.452467 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:41.466285 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 419550us
I20260709 13:15:41.470744 31025 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:41.471412 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 181670us
I20260709 13:15:41.490743 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:41.493970 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 54084.1us
I20260709 13:15:41.494664 31031 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:41.427201  2015 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.439149  1877 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.438086  2017 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:41.499864 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:41.501621 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 289316us
W20260709 13:15:41.502351 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.506914 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:41.509920 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.462031  1855 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.514115 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:41.515270 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.461724  1998 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:41.518350 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:41.526901 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.497638  1849 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.528970 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.530460 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.543931  2020 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.529045 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:41.548908 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45943.1us
I20260709 13:15:41.549849 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:41.530076 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 98792.9us
I20260709 13:15:41.550920 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.551685 31603 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:41.506539  1877 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.546931 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.555938 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:41.556768 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 293789us
I20260709 13:15:41.520045  1722 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.557911 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.544091  1881 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.569892 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.548857  1849 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.568202  1792 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:15:41.573889  1849 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.574771  2033 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.575946  2017 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:41.577411 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.577327 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:41.578693 30924 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.579509  1722 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.580427  1722 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.581344  1440 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:41.581913  1440 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:41.582863 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.582937  1440 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.512109  1966 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:15:41.588560 30924 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.594565 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.594619 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.595233 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.595356 30879 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:41.605928 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 43716.8us
I20260709 13:15:41.612409 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.561630  2031 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:41.593735  1855 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.630676 31029 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:15:41.616009  1881 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.617704  1722 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:41.621431  1966 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:41.626070  2031 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:41.676730 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 81573.9us
W20260709 13:15:41.677973 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46525.6us
I20260709 13:15:41.678176 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:41.681396 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.684963 31602 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:41.687211 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.670960  1966 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.689707 30876 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:41.690157 30876 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:41.688549  1440 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.694195 30876 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:41.694936  2036 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:15:41.695456 30876 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.694612 30883 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:41.701301 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.702626 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.702929  1839 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.626499  1998 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.677111  2031 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:41.708969  1484 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.708649  1958 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.693282  1966 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:41.710242 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.737445 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:41.702950 30876 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:41.719254 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.646965  1695 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:15:41.711655 30883 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:41.735526 30874 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:41.734344 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:41.711751  1855 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:41.742342 31605 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:41.683451  1881 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.745396  2043 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:41.746510  1971 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:41.743234  1855 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.748288  1855 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:41.743690 31600 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:41.752852 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.753726 30883 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:41.743264  1792 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.756822  1792 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.757257  1839 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:41.759023  1792 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.760049  1976 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:41.760923  1881 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.770849 30874 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:41.776208 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.778555  1792 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:15:41.779060 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.779352 30953 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:15:41.809029 30954 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:41.763998  1971 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:15:41.780143 30955 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:41.778625 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.782048 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.782529  1947 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.784009 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.784258  1855 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:41.785226  1952 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 13:15:41.766691  1340 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:41.770653  1993 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:41.768188  2030 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:41.787988 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 53720.9us
I20260709 13:15:41.788215  1849 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:41.790520  2033 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:41.782636 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.793114  1958 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:41.794322  2031 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.796645 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.799821 30875 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:15:41.800186  1966 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:41.805747 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.806406  1969 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:41.809216 30953 pending_rounds.cc:85] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 3
I20260709 13:15:41.809158 30952 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:15:41.819167 30950 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:41.821583 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:41.818077 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:41.818688 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:41.834057 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.863464 30879 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:41.842578 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:41.790126  2015 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.867028  1340 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.862958  1952 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:41.872442  1849 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:41.878132 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:41.880304 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:41.886253 31597 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:15:41.898988 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.936666 30953 pending_rounds.cc:107] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:15:41.842674  2030 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:41.834674  2016 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:41.886068 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 107550us
W20260709 13:15:41.938409 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.939910 30949 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:41.937762 30951 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:41.939203 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:41.937355 30880 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:41.942605 30953 raft_consensus.cc:2889] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:41.881422  1989 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:41.956799 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:41.958356 30878 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:41.957736 31599 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:41.964339 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:41.885367  2033 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:41.961853  1881 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:41.951220  2030 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:41.972388 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 162902us
I20260709 13:15:41.960166  2028 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:41.941779  1877 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:41.987723 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.984342 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 162839us
I20260709 13:15:41.966372  2043 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.991250 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:41.992362 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 112193us
I20260709 13:15:41.970124  1989 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:41.998667 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:42.000290 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:42.003974  1881 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.004588  1881 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:42.005102  1881 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.004992 30997 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:42.010264 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:41.973028  2005 ts_tablet_manager.cc:1929] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:15:41.981841  1971 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:41.986713  1792 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:42.014927 30882 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:41.992810  2028 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:41.999991  1843 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:42.032529 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:42.034173  2027 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:15:42.034736  1855 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.039139  2005 log.cc:1199] T adb189bd941147e0924cc38c9f01bd11 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/adb189bd941147e0924cc38c9f01bd11
I20260709 13:15:42.043712  1958 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:15:42.052284  2005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51632 (request call id 89) took 1513 ms. Trace:
I20260709 13:15:42.052968 31602 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:42.053133  1947 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.053666  1855 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:42.054075  1855 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.054417  1855 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:42.054565  1849 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:42.032909  1792 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.055410  1792 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.052778  2005 rpcz_store.cc:276] 0709 13:15:40.563455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.589692 (+ 26237us) service_pool.cc:224] Handling call
0709 13:15:40.671827 (+ 82135us) ts_tablet_manager.cc:1151] Deleting tablet adb189bd941147e0924cc38c9f01bd11
0709 13:15:40.671963 (+   136us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:15:41.788815 (+1116852us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.965728 (+176913us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:42.052191 (+ 86463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195188,"tablet-delete.queue_time_us":37155,"thread_start_us":36614,"threads_started":1}
W20260709 13:15:42.039160  2040 log.cc:927] Time spent T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:15:41.996934  2043 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:42.073509 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet adb189bd941147e0924cc38c9f01bd11 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:15:42.041266  2051 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:15:42.079823  2031 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.080729  2028 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.079492  1989 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.088726  2053 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:42.089282  2053 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:42.114990 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53390.4us
W20260709 13:15:42.115870 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 143020us
I20260709 13:15:42.073774  1957 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:42.087430  2043 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:42.140341 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 140127us
I20260709 13:15:42.144932 30924 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:42.089725  2053 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:42.112466  1340 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.153842 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:42.161756 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:42.162429 30876 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.117489  1966 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:42.173913 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:42.177613 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 167615us
I20260709 13:15:42.174688 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:42.126765  1811 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:42.173885  2051 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.173741  2015 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:15:42.184991  2051 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.167397  2043 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:42.185601  2051 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.185935  2043 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.186405  2043 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:42.188063 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:42.044806  2033 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:42.189253  2050 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:15:42.189577 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:42.190222 31030 raft_consensus.cc:2376] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9. Re-sending same reply.
I20260709 13:15:42.192086 30949 raft_consensus.cc:1217] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-9.6]   Dedup: 5.4->[7.5-9.6]
I20260709 13:15:42.192663 30949 pending_rounds.cc:85] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 4
I20260709 13:15:42.192921 30949 pending_rounds.cc:107] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:15:42.193192 30949 raft_consensus.cc:2889] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.194133 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:42.195242 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:42.196403 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:42.204672 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:42.205477 30951 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:42.207414 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:42.207995  2054 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.208272 30957 raft_consensus.cc:2368] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:42.208513  2054 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.207518  1849 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.204705 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:42.215027 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:42.216051 31023 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:42.217572 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:42.217304 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:42.221526 30954 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:42.221225  2066 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:15:42.222550 30950 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:42.226987 31030 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:42.233490 30876 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:42.193925  1340 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.240324 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:42.226570  2048 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.120s	user 0.000s	sys 0.003s
I20260709 13:15:42.166679  2013 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.163s
W20260709 13:15:42.244067 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 125699us
W20260709 13:15:42.248024 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69529.4us
I20260709 13:15:42.249253 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:42.191567  2030 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.262382 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:42.267584 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:42.270296 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:42.271178  2052 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:15:42.271572  1989 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:42.272042  1989 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.272410  1989 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.276568 30879 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:42.278226 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:42.241101  1877 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.222923  1849 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.260500  1811 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:42.297783 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:42.281783  2017 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:42.298918 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:42.309755 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:42.277890  1966 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:42.258556  2058 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:42.333235 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 84079.3us
I20260709 13:15:42.335172 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:42.340374 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:42.266155  1997 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:15:42.265640  1993 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:15:42.349565 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:42.251991  1340 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.327570  2031 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:42.259498  2055 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:15:42.281275  1881 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:42.393020 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:42.451998 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 117054us
W20260709 13:15:42.385426 30848 connection.cc:256] RPC call timeout handler was delayed by -1.4334578309999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 13:15:42.454767 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2219578309998269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 13:15:42.398079 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:42.453857 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:42.383452 30950 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:15:42.398633 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:42.422287 30956 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:42.431075 30879 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:15:42.338568  2054 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.458273 30879 pending_rounds.cc:85] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 9
I20260709 13:15:42.461145 30951 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:42.462615 30879 pending_rounds.cc:107] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:15:42.463032 30879 raft_consensus.cc:2889] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:42.348526  1811 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:42.431080  2017 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:42.470775 30950 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:42.356302  1957 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:42.468160 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:42.382648  1877 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:42.452207  1839 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:42.473346 31027 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:15:42.393123  2031 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:42.346477  1966 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.500169 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:42.522715  2070 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:42.524000 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.521677  1957 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:42.464603  2065 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:42.524788 30954 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:42.530036 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.526840 30950 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:15:42.469604  1811 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:42.470644  2017 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:42.534353 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:42.538820 30875 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:42.492238  1839 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:42.564698 30950 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:42.564993  2031 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:42.565997  1792 consensus_meta.cc:287] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 13:15:42.566437  1792 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.577385 30954 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:42.530373  2070 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:42.533540  1811 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:42.594009  1849 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.594156  2087 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:42.601456  1340 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:42.602245  2079 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:15:42.605545  2067 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 13:15:42.606598  2069 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:15:42.607558  1855 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 13:15:42.526623  2061 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.285s
I20260709 13:15:42.570628  1877 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:42.640054  1792 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:42.640725  1792 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:42.641245  1792 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.588135  1839 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.643982  1839 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:42.645339 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:42.646584 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:42.648129 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:42.650238  2072 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:15:42.647619 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:42.598721  2053 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:42.622689  1855 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:42.654116  2030 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:42.739329 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 256422us
I20260709 13:15:42.625254  2043 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:42.871692  1982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.009s	sys 0.004s
W20260709 13:15:42.872435  1982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.009s	sys 0.004s
I20260709 13:15:42.835050  2087 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:42.889714 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 148674us
I20260709 13:15:42.906512 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1070) took 1319 ms. Trace:
I20260709 13:15:42.886826  2087 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:42.951251  2077 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 13:15:42.906972 31600 rpcz_store.cc:276] 0709 13:15:41.559069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.566334 (+  7265us) service_pool.cc:224] Handling call
0709 13:15:41.566782 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:41.752732 (+185950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.877749 (+1125017us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400642dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:42.878013 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406237440}
I20260709 13:15:42.959566 30952 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:42.831758  2065 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.851154  1881 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:42.960508  2072 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:15:42.621330  2017 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.654382  2070 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:42.995147  2065 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.082657  1989 consensus_meta.cc:287] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.005s
I20260709 13:15:43.109196 30953 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:43.110432 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.111068  1947 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.112291  1855 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:43.127317 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.129076 30955 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:43.131974 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.153378 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:43.156141 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:43.157810  2102 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.160084 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:43.161896  2102 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:43.176995 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1859) took 1601 ms. Trace:
W20260709 13:15:42.977793 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.007s
I20260709 13:15:43.117704  2091 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:15:43.118613  2037 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.367s	user 0.019s	sys 0.017s
W20260709 13:15:43.179699 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.005s	sys 0.007s
I20260709 13:15:43.180969 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1858) took 1719 ms. Trace:
I20260709 13:15:43.109364  1989 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.120612  1966 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.122030  2017 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:43.126360 30954 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:43.177639 30878 rpcz_store.cc:276] 0709 13:15:41.576074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.576370 (+   296us) service_pool.cc:224] Handling call
0709 13:15:41.576729 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.958842 (+382113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.176647 (+1217805us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54000a05d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:43.176908 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877167488}
I20260709 13:15:43.181392 30881 rpcz_store.cc:276] 0709 13:15:41.461127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.492452 (+ 31325us) service_pool.cc:224] Handling call
0709 13:15:41.503572 (+ 11120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:41.503917 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:41.503946 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:41.504371 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.615256 (+110885us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:41.615320 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.615527 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.118044 (+1502517us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:43.180636 (+ 62592us) raft_consensus.cc:1685] finished
0709 13:15:43.180659 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.180894 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2001,"raft.queue_time_us":1820,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4557,"spinlock_wait_cycles":22215424,"thread_start_us":63749,"threads_started":1,"wal-append.queue_time_us":209577}
I20260709 13:15:43.189845 30953 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:15:43.189436 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:43.192837 30955 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.105739  2059 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.111716  1947 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.191268  2013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.023s	sys 0.053s
I20260709 13:15:43.200469 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2053) took 1009 ms. Trace:
I20260709 13:15:43.115646 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 952) took 1691 ms. Trace:
W20260709 13:15:43.180188 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 703985us
I20260709 13:15:43.231643 31599 rpcz_store.cc:276] 0709 13:15:41.424065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.424370 (+   305us) service_pool.cc:224] Handling call
0709 13:15:41.452117 (+ 27747us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:41.962247 (+510130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.115419 (+1153172us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400468cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:43.115593 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162109312}
I20260709 13:15:43.233358 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:43.233516 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.234030 30877 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:43.230374 30949 rpcz_store.cc:276] 0709 13:15:42.191325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.191450 (+   125us) service_pool.cc:224] Handling call
0709 13:15:42.191839 (+   389us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:42.211043 (+ 19204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:42.211072 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:42.211740 (+   668us) log.cc:844] Serialized 52 byte log entry
0709 13:15:42.455964 (+244224us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:42.456002 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.456077 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.200203 (+744126us) raft_consensus.cc:1685] finished
0709 13:15:43.200222 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.200394 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3754,"raft.queue_time_us":55158,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":18724,"thread_start_us":212500,"threads_started":1,"wal-append.queue_time_us":273394}
I20260709 13:15:43.248456 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.252099 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:43.253089 30875 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:43.260401  2083 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.489s	user 0.000s	sys 0.001s
I20260709 13:15:43.262280 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2014) took 1042 ms. Trace:
I20260709 13:15:43.262511 30875 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:43.271227 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2348) took 1581 ms. Trace:
I20260709 13:15:43.272156  1947 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.235072  2053 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:43.198272  2059 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.237381  1877 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.262718 31026 rpcz_store.cc:276] 0709 13:15:42.220174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.226895 (+  6721us) service_pool.cc:224] Handling call
0709 13:15:42.242624 (+ 15729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.277910 (+ 35286us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:42.299982 (+ 22072us) log.cc:844] Serialized 14 byte log entry
0709 13:15:42.349647 (+ 49665us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.380838 (+ 31191us) log.cc:844] Serialized 26 byte log entry
0709 13:15:42.381005 (+   167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:42.381049 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.381117 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.262040 (+880923us) raft_consensus.cc:1685] finished
0709 13:15:43.262064 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.262215 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22405,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":7317,"raft.queue_time_us":70420,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6209,"spinlock_wait_cycles":14474496,"thread_start_us":49089,"threads_started":1,"wal-append.queue_time_us":296729}
I20260709 13:15:43.287729 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.310014 31600 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:43.289384 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:43.315348 30955 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:43.289781 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 740190us
I20260709 13:15:43.311656 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:43.291740 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:43.319015 31598 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.325390 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.271783 30882 rpcz_store.cc:276] 0709 13:15:41.689790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.695060 (+  5270us) service_pool.cc:224] Handling call
0709 13:15:41.943635 (+248575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.032137 (+ 88502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.270971 (+1238834us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54000d39d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:43.271151 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558093184}
I20260709 13:15:43.288025 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.327061 31602 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
W20260709 13:15:43.251536  2013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.023s	sys 0.053s
I20260709 13:15:43.330801 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.334008 30879 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:15:43.279735  1839 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.635s	user 0.005s	sys 0.001s
W20260709 13:15:43.275710  2051 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.089s	user 0.010s	sys 0.000s
W20260709 13:15:43.336781 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.342105 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.348131 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:43.349438 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:43.350111 30875 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.286218  2016 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:43.368744 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 135929us
I20260709 13:15:43.368993  2023 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.301425  2043 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.300498  2059 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.302268  1440 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.281318  1989 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.288571  2081 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.288381  2066 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:43.352402  2031 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.325374  1966 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.389148 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:43.444303 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.370338  2051 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.444868 30875 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:43.445492 30958 raft_consensus.cc:2368] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:43.445885 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:43.437265 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2056) took 1242 ms (client timeout 1618 ms). Trace:
I20260709 13:15:43.446934 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:43.388680 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.328301  1695 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.328457  2107 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.346436  1877 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.345840  1947 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.456686 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 126921us
I20260709 13:15:43.448125 30875 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:43.449828 31602 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:43.448568 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:43.447204 30952 rpcz_store.cc:269] 0709 13:15:42.194621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.195015 (+   394us) service_pool.cc:224] Handling call
0709 13:15:43.437012 (+1241997us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54001e0854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:43.437189 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742343424}
I20260709 13:15:43.452258 31598 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:15:43.456036 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 122905us
W20260709 13:15:43.460194 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 148609us
I20260709 13:15:43.461697 30875 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:43.461656  2066 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.462972 30874 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:43.463073  1464 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.463439  1464 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:43.463860  1464 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.465358  2066 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.456735  1695 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:43.468770  1340 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.468993  2057 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.469309  1340 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.469496  2057 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.458197 30877 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:43.471473 31601 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:15:43.454959 30923 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.049s (SENT) [suppressed 42 similar messages]
I20260709 13:15:43.370427  2016 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:43.481740 31601 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:43.487499 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.495347 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.496346 31601 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:43.477944  2043 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:43.502647 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.503403 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:43.505645 31571 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.682s (SENT)
I20260709 13:15:43.387820  2100 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:15:43.511269  1957 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:43.509485  2066 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:43.521898  1340 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.522545  2097 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:43.523550 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:43.524416  1982 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.499325  2053 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:43.589373 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.470829  2107 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:43.495626  1695 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.526109  2043 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:43.528008  1811 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.002s
I20260709 13:15:43.528350  2059 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.483232  2034 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:15:43.477710  1971 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:15:43.484757  1989 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:43.436337  2081 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.391995  1440 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.579298 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 130773us
I20260709 13:15:43.624969 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.579715 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.626713 30877 raft_consensus.cc:2410] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:43.446781  2031 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.585530 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 78639.6us
W20260709 13:15:43.586064 30847 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 2.229s (SENT)
I20260709 13:15:43.476797  1947 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:43.524880  2013 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.595273 31602 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:43.456992  1966 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.484339  1877 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:43.604652 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.612524 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 117247us
W20260709 13:15:43.634164 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48141.6us
I20260709 13:15:43.529755  1899 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:15:43.617017  2097 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:43.617441  1340 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:43.613571 31028 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.006s	sys 0.018s
W20260709 13:15:43.637526 31028 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.018s
I20260709 13:15:43.637132  1340 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:43.646142  1340 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:43.618790  1811 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:43.649308  1947 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.680493 30877 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:15:43.622129  2059 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.727792 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 92985.6us
W20260709 13:15:43.718866 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.718025 31596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 951) took 2298 ms (client timeout 2229 ms). Trace:
I20260709 13:15:43.724222 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:43.730152 31596 rpcz_store.cc:269] 0709 13:15:41.419680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.436447 (+ 16767us) service_pool.cc:224] Handling call
0709 13:15:43.682084 (+2245637us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b5400459cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:43.717920 (+ 35836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091767680}
W20260709 13:15:43.736217 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 103795us
W20260709 13:15:43.731657 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 105521us
I20260709 13:15:43.742362 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2013) took 1520 ms. Trace:
I20260709 13:15:43.726951  2092 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:15:43.747843  2130 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:43.748775  2043 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.748728  2130 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:15:43.749713  2130 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:43.740240  1464 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.753450  1464 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:43.753072 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 229589us
I20260709 13:15:43.755158 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.756120 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.756850 31600 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:43.627183  1989 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.763195 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.767516 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.770887 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.743501 31028 rpcz_store.cc:276] 0709 13:15:42.213580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.213762 (+   182us) service_pool.cc:224] Handling call
0709 13:15:42.221248 (+  7486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.221501 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:42.328204 (+106703us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.638568 (+1310364us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.725090 (+ 86522us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.733247 (+  8157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:43.733311 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:43.733390 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.733486 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.733640 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136856,"prepare.queue_time_us":596913,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":139161,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":6919,"thread_start_us":1284650,"threads_started":5,"wal-append.queue_time_us":212399,"wal-append.run_cpu_time_us":1151,"wal-append.run_wall_time_us":1025168}
I20260709 13:15:43.693352  2102 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:43.773720  2051 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.753752  2015 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:43.780642 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.778918 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:43.782301 31600 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.740145  2084 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:43.789458 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.774324  1440 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.835276 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:43.768596  2112 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:43.845240 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64710.6us
W20260709 13:15:43.845695 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56360.9us
W20260709 13:15:43.851583 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 119281us
I20260709 13:15:43.840749 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:43.778121  2096 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.779670  2015 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:43.835203  1957 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.778033  2113 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.835386  1899 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.774202  2102 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.845013  2057 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:43.863816  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.809s	user 0.007s	sys 0.032s
I20260709 13:15:43.869481 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.872599 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:43.837102  2130 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:15:43.881248  2130 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:43.882302  2130 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:43.864380  1982 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:43.884562  1982 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:43.885109  1982 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.859930  2129 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.865819  2107 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.889920 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:43.894657 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2016) took 1669 ms. Trace:
I20260709 13:15:43.895186 31602 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.859443  1464 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 13:15:43.878963  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.830s	user 0.007s	sys 0.032s
I20260709 13:15:43.895359 31027 rpcz_store.cc:276] 0709 13:15:42.225645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.226114 (+   469us) service_pool.cc:224] Handling call
0709 13:15:42.240635 (+ 14521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.491917 (+251282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.894348 (+1402431us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002d4e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:43.894580 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534390016}
I20260709 13:15:43.881961 31599 raft_consensus.cc:2410] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:43.898000  2015 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.900144  2033 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:43.873813  1899 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.926153  2059 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.869065  1957 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.771533  2097 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.930609 31600 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
W20260709 13:15:43.934146 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 61610.3us
I20260709 13:15:43.944087 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:43.944655 31600 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:43.864012  2112 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:43.864790  2096 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.962702  2131 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:43.962864  2102 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.963732  2126 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:43.962774  1899 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.971511  2031 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.979460  2074 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:43.980027  2074 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:43.980942 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:43.981904 31603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 993) took 1337 ms (client timeout 1577 ms). Trace:
I20260709 13:15:43.964346  1340 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:43.982311 31603 rpcz_store.cc:269] 0709 13:15:42.643960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.662724 (+ 18764us) service_pool.cc:224] Handling call
0709 13:15:43.980710 (+1317986us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:43.981802 (+  1092us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109465984}
I20260709 13:15:43.984223  1340 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:43.968665  1610 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:43.988168  1610 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:43.989116  1610 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:43.990044  2094 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.814s	user 0.003s	sys 0.009s
I20260709 13:15:43.990551  1610 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:43.936375  1877 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:43.994266 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:43.938052  2107 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:43.987517  1792 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:43.965052  2109 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:15:44.010942 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:43.967829  2124 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:15:43.940263  1971 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:15:44.012181  1695 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:15:43.959553  2081 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.016108 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.016312 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.033444 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:44.018939 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 156531us
I20260709 13:15:43.967439  1957 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:43.970628  1982 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.024415 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:43.975814  1440 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:44.038950 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.039876 31031 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:44.040434 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.040664 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.041229 31030 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:44.041538 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.042985 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.045625 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.046231 31032 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:44.047938 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:43.940290  2014 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:15:44.049073 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.048549 31028 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:44.021632  1811 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:44.032701  1695 consensus_queue.cc:1243] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:43.964475  2132 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.201s
W20260709 13:15:44.064651 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.044978  1440 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:44.038297  1877 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.066663  2075 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:15:44.067744  2139 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:44.024497  1976 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:44.015712  2141 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:44.070194  2138 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:44.069088 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:44.080026 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55685.1us
I20260709 13:15:44.046423  1989 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.048790  1957 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.092221 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.092346 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.101460 31027 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:44.087293  2034 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.068650  1982 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.124563  2096 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.124332  1982 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.126647  1982 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:44.099056 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.128232 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.128993 31599 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:44.129827 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.130568 31599 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:44.097954  2141 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.133389 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:44.134160  2141 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.134661 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:15:44.134963  2105 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.512s	user 0.001s	sys 0.000s
I20260709 13:15:44.093394 31030 raft_consensus.cc:2410] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:15:44.135746 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.136646 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:44.137823  2017 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.944s	user 0.008s	sys 0.003s
I20260709 13:15:44.139379 31603 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:44.139657  2112 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.100688  2020 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.090945  1877 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:44.136670  2121 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 13:15:44.143112  1877 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.102910 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.144421  1843 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.144898 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.145052  1843 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:44.145370 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.145888 30848 leader_election.cc:400] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:44.146009 31600 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:44.146196 30848 leader_election.cc:403] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.146987  1695 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:44.005532  2074 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.148178  2074 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.148341  2081 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.095199  1976 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.103747  1440 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.152729  1440 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.153460  1976 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:44.101370 31031 raft_consensus.cc:2376] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7. Re-sending same reply.
I20260709 13:15:44.115986  2031 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.112097 30957 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:15:44.120368 30951 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.156032  2031 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:44.157254 30957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 725) took 1819 ms (client timeout 2092 ms). Trace:
W20260709 13:15:44.157639 30957 rpcz_store.cc:269] 0709 13:15:42.337472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.337889 (+   417us) service_pool.cc:224] Handling call
0709 13:15:44.157072 (+1819183us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54003fe8d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:44.157197 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4051016448}
I20260709 13:15:44.157981  2031 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.158591 31024 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.147550  1695 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:44.160049 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.160413 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.160693 31023 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:44.160964 31027 raft_consensus.cc:2376] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8. Re-sending same reply.
I20260709 13:15:44.161569 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.161854 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.162038  1966 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.162416 31027 raft_consensus.cc:2376] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7. Re-sending same reply.
I20260709 13:15:44.095142  2138 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:44.138343 31030 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:44.163741  2138 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.164203 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.164904 31030 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.164974  2138 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.146126  1843 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:44.165617 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.166626  2096 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.160879  1695 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.168121  1695 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.165700  1843 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:44.168660  1843 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.169121 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.170329 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.170857 31029 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.146982 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.164276 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.159696  2033 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.172807  2033 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.105885  2129 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.176723 31602 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:44.178566 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.163307 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.180078 31027 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.181088 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.181780 30879 raft_consensus.cc:2368] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9.
I20260709 13:15:44.177065 31024 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:44.131292 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:44.120299 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 729) took 1726 ms (client timeout 1848 ms). Trace:
I20260709 13:15:44.162117 31023 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.177870 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2358) took 2001 ms. Trace:
I20260709 13:15:44.182835 30848 leader_election.cc:400] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:44.184731 30848 leader_election.cc:403] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:15:44.185717 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:44.186982 30998 leader_election.cc:400] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9.
I20260709 13:15:44.191726 30998 leader_election.cc:403] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:44.183823 30958 rpcz_store.cc:269] 0709 13:15:42.393698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.393832 (+   134us) service_pool.cc:224] Handling call
0709 13:15:44.119995 (+1726163us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54002909d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:44.120214 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272957184}
I20260709 13:15:44.184644 30880 rpcz_store.cc:276] 0709 13:15:42.176984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.189152 (+ 12168us) service_pool.cc:224] Handling call
0709 13:15:42.189482 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.414882 (+225400us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:42.471177 (+ 56295us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.977587 (+1506410us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b180037eb20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:15:44.042702 (+ 65115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.050928 (+  8226us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.052015 (+  1087us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:44.056452 (+  4437us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.081332 (+ 24880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.081651 (+   319us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.148099 (+ 66448us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b180037eb20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:44.162759 (+ 14660us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b180037eb20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:44.177643 (+ 14884us) raft_consensus.cc:1685] finished
0709 13:15:44.177663 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.177800 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53171,"prepare.queue_time_us":15856,"prepare.run_cpu_time_us":5777,"prepare.run_wall_time_us":24513,"raft.queue_time_us":157181,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":16202,"spinlock_wait_cycles":27493760,"thread_start_us":242501,"threads_started":2,"wal-append.queue_time_us":1554344}
I20260709 13:15:44.194995  1815 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9.
I20260709 13:15:44.202762  2107 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:44.186172  2014 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:15:44.215600 31026 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:44.211437 31027 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:44.218163 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:44.221381 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.221812 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.225739 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:44.226786 31029 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:44.224787 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.230686 31023 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:44.234095  2013 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.234601  2084 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:44.234570  2013 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.235162  1843 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.230942  2107 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.236238  2107 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.236696  2013 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.237370 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.240186  1843 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.241338 31031 raft_consensus.cc:2410] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:44.244751 30882 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:44.246677  2099 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.133s	user 0.004s	sys 0.000s
I20260709 13:15:44.238240  2107 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.249231 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 734) took 1785 ms. Trace:
I20260709 13:15:44.249794 30951 rpcz_store.cc:276] 0709 13:15:42.463912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.464834 (+   922us) service_pool.cc:224] Handling call
0709 13:15:44.120160 (+1655326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.156226 (+ 36066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.248660 (+ 92434us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54002909d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:44.249148 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3767630592}
I20260709 13:15:44.235194  2084 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.254663 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.260433 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.261372 30874 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:44.261570  2033 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.265018 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.267251 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.267359 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.268602 30955 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:15:44.268333 30952 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:44.268858 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.270402 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.272897 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.273663 30958 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:44.275708  1966 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.276034 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.276170  1855 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:44.276473  1966 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:44.277465 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.277573  1966 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.278780 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.279052 30956 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:15:44.279373 30957 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 3.
I20260709 13:15:44.280248 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:44.280616 30950 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:44.280805 30878 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.283951 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.284543 30958 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:44.285306 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.285835 30958 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.286556  2054 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:44.288640 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.291469 30997 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:44.297377 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.299523 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.300491 30883 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:44.301898 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.287122  2054 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.305182 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.305466 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:44.305807 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.306560 30956 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:44.302963 30952 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:44.313062 30957 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:44.274624  2100 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.313772 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.317421 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.318017 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:44.318111 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.302410  1610 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.321774 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.326963 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.325939 30958 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:44.340756 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.342085 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.342149 30955 raft_consensus.cc:2410] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:15:44.314121  2033 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:44.348595 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.345336 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.340763 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.350813 30958 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:44.349282 30951 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 5.
I20260709 13:15:44.354554 30878 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:44.321745  1695 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:44.323573  1610 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.357228 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.358566  2053 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.359812 30997 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.364934 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1868) took 1023 ms. Trace:
I20260709 13:15:44.340128  2097 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.326335  1484 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:44.370801 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.367478 30875 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:44.367939 30876 rpcz_store.cc:276] 0709 13:15:43.341339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.466338 (+124999us) service_pool.cc:224] Handling call
0709 13:15:43.466615 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.470954 (+  4339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.470984 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:43.471029 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:43.471074 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.364694 (+893620us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b54002ab054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:44.364755 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.364877 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9290624}
I20260709 13:15:44.372771 31023 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.353440  2033 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:44.357950  1881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.239s	user 0.000s	sys 0.036s
I20260709 13:15:44.375133 30997 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.366325 30955 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:15:44.377614  2148 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:15:44.386879 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.365881  1610 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.324872  2100 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.389686 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.389418 30955 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:44.376183  2033 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.391887 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:44.390252  1815 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.392123  2081 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:44.370572  1982 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.374500  2129 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.402583 30950 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:44.393510  2054 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:44.376329  1881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.000s	sys 0.036s
I20260709 13:15:44.399056 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.403568  1815 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:44.410288  1952 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.394905  1976 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.426191 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:44.400173  2049 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.428262  2049 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:44.429235  2125 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.783s	user 0.001s	sys 0.002s
I20260709 13:15:44.430657  2049 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.430780  2065 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:44.415457  2149 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:15:44.425285  2128 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.436146 30922 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.436299  1815 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.437196 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.438997 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.427696  1982 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:44.401744  2097 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:44.441023 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.445434  2054 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:44.464221 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.463107 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:44.442018  2031 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:44.465786  2031 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.466243  2031 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.470788  2016 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.474920  2031 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.471465  1610 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.462101  1982 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.483675  2049 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:44.489019  2129 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:44.489787  1969 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:44.490767 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.491418  1855 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.460307  2096 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.457863  2084 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.494117 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.441471  2059 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:44.483345  2097 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.502286  2101 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.334s	user 0.002s	sys 0.000s
I20260709 13:15:44.497076  2129 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.530818  2129 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.508657 31032 raft_consensus.cc:2376] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8. Re-sending same reply.
I20260709 13:15:44.509075 31023 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.510471 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.538551 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.510700  1855 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:44.511678 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 964) took 1014 ms. Trace:
I20260709 13:15:44.511947 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:44.513127 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 476001us
I20260709 13:15:44.541015 31570 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.513633  2113 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:44.514654 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.544957 31570 leader_election.cc:400] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:44.515486 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.497087  2049 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:44.518050 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.518361  2065 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:44.518918 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.519992  2140 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:15:44.520341  2158 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:44.521137  2161 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:44.521615 31027 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:44.523283  2100 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.524895  1610 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.495447  1982 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:44.487884  2054 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:44.564894 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 46014.4us
I20260709 13:15:44.566685 30954 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:44.567005 30949 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:44.525398  2053 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.543965  2102 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.545432 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.571117 31598 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:44.546417 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 997) took 1640 ms. Trace:
W20260709 13:15:44.548141 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.548965 31600 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.550490  2049 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:44.549177 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.551295 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.540258 31601 rpcz_store.cc:276] 0709 13:15:43.497683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.497923 (+   240us) service_pool.cc:224] Handling call
0709 13:15:43.498311 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.498583 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:43.777541 (+278958us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.974526 (+196985us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.142237 (+167711us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b18004555c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:44.511177 (+368940us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b18004555c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:44.511341 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.511391 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:44.511437 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.511506 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.511622 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48595,"prepare.queue_time_us":137482,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":17862,"raft.queue_time_us":637378,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":34211,"spinlock_wait_cycles":36286080,"thread_start_us":381147,"threads_started":3,"wal-append.queue_time_us":156290}
I20260709 13:15:44.553663 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.540575  2059 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:15:44.552119  2140 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:44.562588 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.545861  2110 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:44.549787  1440 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:15:44.571666 31597 rpcz_store.cc:276] 0709 13:15:42.906501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.909530 (+  3029us) service_pool.cc:224] Handling call
0709 13:15:44.515341 (+1605811us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:44.546357 (+ 31016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601216}
I20260709 13:15:44.540074  1855 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:44.537230  2097 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.575883 30922 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.568524  1950 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:44.576287 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.577950 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:44.547367  2130 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:15:44.554603  2031 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.550304  2112 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:15:44.582298 31598 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.586135 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:44.587349 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.553759  2065 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.590583 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.592366 30953 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.566349  2017 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:15:44.626077 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.621902  1950 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:44.653240 31025 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
W20260709 13:15:44.655062 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 92230.6us
I20260709 13:15:44.653288 31597 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:15:44.585165  1855 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.656980 31597 pending_rounds.cc:85] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 7
I20260709 13:15:44.664425 31597 pending_rounds.cc:107] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:15:44.593442  1877 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:44.668371 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.657562 31600 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.668780 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.669479 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:44.669768 31025 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.665014 31597 raft_consensus.cc:2889] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:44.670058 31032 raft_consensus.cc:2376] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7. Re-sending same reply.
I20260709 13:15:44.673699  1950 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:44.675488  2098 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.522s	user 0.000s	sys 0.003s
I20260709 13:15:44.675505 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.676608  2141 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.677167  2141 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.677757 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:44.658087 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 70851.9us
I20260709 13:15:44.679425  2141 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.671321  2033 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.587086  2110 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:44.679639 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.667812  1440 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:44.666891  2054 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.699867  1440 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.702025  1440 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.681792 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 989) took 2039 ms. Trace:
I20260709 13:15:44.665414  2031 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.704267  2141 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:44.705101  2141 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:44.705442  2141 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:44.706552 31025 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:44.706346  2141 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.706741 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.707474 31031 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:44.736258  1440 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.693713  2084 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:44.722733 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.754212 30874 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:44.694387  2017 consensus_queue.cc:1243] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:15:44.710116  2129 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.737195  2065 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.702523 31605 rpcz_store.cc:276] 0709 13:15:42.642686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.647871 (+  5185us) service_pool.cc:224] Handling call
0709 13:15:42.648229 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.648596 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.648623 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.649111 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:15:42.959395 (+310284us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:42.959450 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.959544 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.674903 (+1715359us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:44.681502 (+  6599us) raft_consensus.cc:1685] finished
0709 13:15:44.681526 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.681732 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5575,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":39844,"spinlock_wait_cycles":182013440,"thread_start_us":309855,"threads_started":1,"wal-append.queue_time_us":503417}
I20260709 13:15:44.734724  2110 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.756543  2129 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.666647  1877 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.730630 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.709945 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.759155  1877 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.759456 31023 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:44.711336 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.707430 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.707523  2141 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.718796 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:44.764477  1722 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:15:44.764590 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45904.6us
I20260709 13:15:44.764849 31025 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:44.765004  1722 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:44.716748 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.766216 30956 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.766438 31025 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:44.766007  1722 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.711076 30951 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:44.728578 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1073) took 3018 ms. Trace:
I20260709 13:15:44.671074  2140 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.767987  2140 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:44.748489 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.749564  2066 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:44.749794 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:44.750591 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.771844 30876 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:44.772046 31032 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:44.751101 30953 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:44.772146 30997 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:44.759424 31028 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:44.721262 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:44.774511 30880 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.775094 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:44.719758 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.774168 31031 raft_consensus.cc:2410] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:15:44.775204 31025 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:44.750294 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:44.783042 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.784595 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:44.794988 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:44.795799 30953 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:15:44.797477 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:44.798552  2084 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:44.799054  2084 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.799495  2084 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:44.786188  2017 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:44.800275  2017 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:44.801152  2017 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.803279  2070 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:44.770252  1440 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.804461  2015 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:44.805907  1440 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:44.767644 31604 rpcz_store.cc:276] 0709 13:15:41.710484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.736675 (+ 26191us) service_pool.cc:224] Handling call
0709 13:15:41.736999 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.114160 (+1377161us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:43.114492 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.507106 (+392614us) log.cc:844] Serialized 14 byte log entry
0709 13:15:43.507282 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:43.507332 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:43.507634 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.134427 (+626793us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:44.728286 (+593859us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400800a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:44.728350 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.728503 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120622,"prepare.queue_time_us":264439,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":4090,"raft.queue_time_us":212035,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":22758,"spinlock_wait_cycles":3171715200,"thread_start_us":281066,"threads_started":2,"wal-append.queue_time_us":392301}
I20260709 13:15:44.792573 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:44.753410  2033 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:44.771183  2066 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:44.811631 31600 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:44.821384 30876 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:44.823966 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:44.825098 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:44.824196 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:44.820175 30880 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:44.784624  2065 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:44.827287  2134 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:44.827721  2134 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.828130 31028 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:15:44.826578 30958 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:44.784027  2129 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:44.834122 30956 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:44.835029  2178 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:44.835179 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:44.780719  1982 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.842612 30997 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:44.794139  2130 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.843956 31023 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:44.844033  2053 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:44.844558  2138 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:44.844635  2053 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:44.845701  2053 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:44.851459  2033 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:44.852221  2033 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:44.853672  1877 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:44.853536  2033 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:44.854399 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 497822us
W20260709 13:15:44.862567 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.837946  2134 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:44.865154 31605 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:44.866256 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.866801 30879 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:15:44.863581 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:44.868738 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.872191 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.841526 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:44.878753 31598 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:15:44.911547 30879 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:44.917524 30958 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:44.953366 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.954313 30876 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:44.984458 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:44.985345 30876 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
W20260709 13:15:45.000463 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 139863us
I20260709 13:15:45.001502 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:45.001590 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:45.004281 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:45.004628 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 163169us
I20260709 13:15:45.005541 30882 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:45.008536 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.010399 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:45.014019 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.032013 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:45.033622 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:45.034276 31031 raft_consensus.cc:2376] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7. Re-sending same reply.
I20260709 13:15:45.035240 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:45.036845 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:45.039743 30880 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:15:45.046768 31031 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:44.843708  1982 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.058382 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:45.058660 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.863565  2049 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.184193 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:44.953207  2130 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:45.185029 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:45.194528 31024 raft_consensus.cc:2376] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8. Re-sending same reply.
I20260709 13:15:45.030983  2110 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:45.041230  2081 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:45.209465 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:45.050055  1877 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.050973  2142 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:45.236819 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1883) took 1240 ms. Trace:
I20260709 13:15:45.259014 30875 rpcz_store.cc:276] 0709 13:15:43.995959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.996156 (+   197us) service_pool.cc:224] Handling call
0709 13:15:45.236531 (+1240375us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400196754. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:45.236716 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762091264}
I20260709 13:15:45.183799  1440 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:45.271636 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:45.191397  2015 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:45.190881  1989 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:44.860098  2066 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.185709  2065 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 13:15:45.286136  2129 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:45.290562  2016 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.369072 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2023) took 1156 ms. Trace:
I20260709 13:15:45.369680 31025 rpcz_store.cc:276] 0709 13:15:44.212224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.770561 (+558337us) service_pool.cc:224] Handling call
0709 13:15:44.774903 (+  4342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.780675 (+  5772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.368765 (+588090us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5400147150. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:45.368984 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7388416}
I20260709 13:15:45.372141 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1663) took 1089 ms. Trace:
I20260709 13:15:45.372731 30950 rpcz_store.cc:276] 0709 13:15:44.282701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.290016 (+  7315us) service_pool.cc:224] Handling call
0709 13:15:45.371856 (+1081840us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54001941d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:45.372057 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188111616}
I20260709 13:15:45.272303  2142 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.228747  2062 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 13:15:45.177628  2133 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.344s
I20260709 13:15:45.386763  2133 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:45.387270  2133 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:45.388440  1484 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:45.388154  2133 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.389038  1484 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:45.389705  2133 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.390204  1484 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:45.392853  2049 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.380396  2129 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:45.394327  2129 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.403868  2064 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:45.404451  2064 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:45.405517  2064 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.406791  2064 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:45.287714  1440 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.309767  1989 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.420328 31028 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:45.382395  1877 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.436028 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.441200  1440 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:45.442996 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2533) took 1424 ms. Trace:
I20260709 13:15:45.443516 31026 rpcz_store.cc:276] 0709 13:15:44.018886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.019011 (+   125us) service_pool.cc:224] Handling call
0709 13:15:45.442760 (+1423749us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001bf654. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:45.442918 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354871040}
I20260709 13:15:45.448486 31029 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:45.449045  2142 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:45.459087 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.447559  2084 consensus_meta.cc:287] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.000s
W20260709 13:15:45.548409 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 275249us
I20260709 13:15:45.375751  1722 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.550388 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:45.411913  2130 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.571856 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:45.573076  1989 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:45.436483  1877 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.554261  2092 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:45.552673  2178 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:45.610131  2178 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.550133  2084 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.596136  2110 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:45.571221  1722 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.649281  2110 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.654076  2084 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:45.626950  2171 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:15:45.640203  2113 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:45.642406  2126 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:45.644320  2070 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.840s	user 0.006s	sys 0.006s
I20260709 13:15:45.647984 30877 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:45.656837 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:45.658190 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.669970 31026 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:45.671892 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:45.661000 30881 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:15:45.630368  2140 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.862s	user 0.006s	sys 0.007s
W20260709 13:15:45.662228 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.667548 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:45.676563 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.680142  2027 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.683089  2027 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.680944 31599 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:45.662375  2113 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:45.712759  1998 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:45.713361  1998 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:45.714417  1998 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:45.715102 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.716850  1815 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.717507  1815 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.666215  2126 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:45.728235  2097 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.731406 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 620) took 1633 ms. Trace:
I20260709 13:15:45.669942  1952 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.731896 31023 rpcz_store.cc:276] 0709 13:15:44.098332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.760408 (+662076us) service_pool.cc:224] Handling call
0709 13:15:44.760716 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.844390 (+ 83674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.731094 (+886704us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b54003f52d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:45.731331 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191029120}
I20260709 13:15:45.680274  2016 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:45.715529  1998 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:45.685536  1983 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.684389  1989 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.721689  1855 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.050s	user 0.011s	sys 0.000s
W20260709 13:15:45.762573 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.011s	sys 0.030s
W20260709 13:15:45.772107 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.011s	sys 0.031s
W20260709 13:15:45.772521 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 585434us
W20260709 13:15:45.770845 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:45.778904 30921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.015s	sys 0.038s
I20260709 13:15:45.798657 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:45.801036 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.006s	sys 0.040s
I20260709 13:15:45.773183  1983 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:45.846637 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.826364 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:45.852376 31023 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:45.798738 30921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.015s	sys 0.038s
I20260709 13:15:45.766938  1952 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:45.803356 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.040s
W20260709 13:15:45.864468 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 807115us
I20260709 13:15:45.869619 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:45.782387  2016 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.779196  1989 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.874107 30952 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:45.796901  1722 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.825006  2027 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:45.779307  1855 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.880291 30954 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:45.823630  1877 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.884781 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:45.887754 30957 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:45.932984 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:45.933890 30957 raft_consensus.cc:2393] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:45.939610 30956 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:15:45.892591  1815 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:45.946288 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 746) took 1384 ms. Trace:
I20260709 13:15:45.829203  2126 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.948801 30951 rpcz_store.cc:276] 0709 13:15:44.561834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.561975 (+   141us) service_pool.cc:224] Handling call
0709 13:15:44.562264 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.767417 (+205153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.945975 (+1178558us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003fe8d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:45.946213 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341836032}
I20260709 13:15:45.950937 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:45.948093 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:45.965919 30957 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:15:45.952466  2066 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:45.961494 30877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 1880) took 2226 ms (client timeout 2206 ms). Trace:
W20260709 13:15:45.967226 30877 rpcz_store.cc:269] 0709 13:15:43.735367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.770786 (+ 35419us) service_pool.cc:224] Handling call
0709 13:15:45.961271 (+2190485us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54002ab554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:45.961408 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4162880384}
W20260709 13:15:45.951287  2134 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.082s	user 0.011s	sys 0.000s
I20260709 13:15:45.973867 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:45.803462  2113 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.976073  2188 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:45.976536  2188 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.976559  1989 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:45.976963  2188 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:45.977835  2070 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:45.977653  1989 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:45.995136 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 128196us
W20260709 13:15:45.998303 31599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1092) took 1889 ms (client timeout 2212 ms). Trace:
W20260709 13:15:45.998723 31599 rpcz_store.cc:269] 0709 13:15:44.108509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.131063 (+ 22554us) service_pool.cc:224] Handling call
0709 13:15:45.998136 (+1867073us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540069e954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:45.998249 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3443868032}
I20260709 13:15:45.970968  2027 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:15:46.004086 31602 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:45.991811  2070 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:46.010215 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 274667us
I20260709 13:15:46.006498 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:46.004235  1989 consensus_queue.cc:1243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:45.975121  2134 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:45.998071  2113 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:46.009945  2064 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.005s
W20260709 13:15:46.058288 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 84517.5us
I20260709 13:15:46.015084  2070 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:46.061254 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.061956 30957 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:46.063454  1952 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.064193  1952 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.064664  1952 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.065469 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:46.066130 31031 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:46.066725  1952 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.067375  1952 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.059566  2034 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.051877  2129 raft_consensus.cc:2764] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:15:46.072906 31031 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:46.073343 30957 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:15:46.074743 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 275120us
I20260709 13:15:46.076817 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:46.005558  2081 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:15:46.004052  2092 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:15:46.077008 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.012401  2084 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:15:46.006695  1815 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:15:46.113055 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 1.60702e+06us
I20260709 13:15:46.095502  1989 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.068301  2034 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.123275 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:46.125519 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:46.126340 31599 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:46.127635 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:46.132342 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:46.123689 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.133708 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.075845  1952 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.122448  1989 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.136497  1989 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.137753  1952 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.138398  1952 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:46.138760  1952 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:46.140957 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.111891  2016 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.111830  2185 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:46.106418  2064 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:15:46.099577  2110 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:15:46.146260 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:46.165097 31598 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:46.124737  2102 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.156734 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:46.158438 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.120793  2081 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:15:46.204445  2197 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:15:46.164234  2185 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.207170 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:46.208875 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:46.210454 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:46.211658  2064 consensus_queue.cc:1243] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:46.213076 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:46.213938 31596 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:46.215163 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:46.215987  2178 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:46.216526  2178 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:46.217427  2178 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.220018  2110 consensus_queue.cc:1243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:46.124040  2203 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:15:46.221643 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:46.222180 31599 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:46.228303 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 92628.9us
I20260709 13:15:46.229315 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.232234  2034 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.147291  1877 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:46.148132  1966 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.165526  1722 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:46.164090  2016 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:46.139608  1952 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:46.248221 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 203216us
I20260709 13:15:46.231449 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:46.252625 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:15:46.264452 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.166659  1855 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.269760 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:46.270689 31028 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:46.270587  1998 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.271649 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:46.233028  2074 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.272765 31023 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.232616  2134 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:46.280447 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:46.272528 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48400us
I20260709 13:15:46.276350 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:46.290282 31032 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:46.292963 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:46.293681 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.321935 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:46.325935 31025 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:46.232103  2184 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:46.264696  1982 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.292649 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:46.327172 31030 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:46.232859  2187 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.227715  2102 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.293874 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.337224 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.245507  1966 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:46.275681  1877 raft_consensus.cc:2764] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:15:46.294404 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 231065us
W20260709 13:15:46.359558 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66676.7us
W20260709 13:15:46.367985 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75425.4us
W20260709 13:15:46.390671 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2021) took 2189 ms (client timeout 1730 ms). Trace:
I20260709 13:15:46.398263 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:15:46.392753 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 55625.6us
W20260709 13:15:46.363240  2053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.044s	sys 0.056s
W20260709 13:15:46.398658 31027 rpcz_store.cc:269] 0709 13:15:44.201239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.224541 (+ 23302us) service_pool.cc:224] Handling call
0709 13:15:46.390397 (+2165856us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b540007bf54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:46.390572 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674687744}
I20260709 13:15:46.326726  1855 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:46.328363  1952 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.249854  2064 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.432186  2064 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.434188  2064 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.404569 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:46.434849 31027 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:46.439955  1855 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:46.441079  1855 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.401177 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:46.402746 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 108938us
I20260709 13:15:46.444087 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:46.398447 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:46.287292  2185 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:46.359732  2207 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:46.449177  2216 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:46.449313  2207 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:46.449746  2216 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.450140  2216 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.450381  2207 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.403900  2211 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:46.453156  2070 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:46.402271  2053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.045s	sys 0.056s
I20260709 13:15:46.401103  2187 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.430914  2223 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:46.431411  2102 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:46.444324 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 117018us
I20260709 13:15:46.402755 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:46.464073 31028 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.447525 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.441599  2214 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:15:46.448516  2134 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:46.448633  2066 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:46.329180  2081 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:46.296887  1998 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:46.460029 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 61656.1us
I20260709 13:15:46.322431  2074 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.461371 31604 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:46.397257  1966 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.398408  2215 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.454680  2016 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:46.412211  1695 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.466298 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 68343.5us
W20260709 13:15:46.469030 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.469280 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:46.471962 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:46.486276 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.451678  2207 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.477958 31026 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.488034 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.392508  1982 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.485636 30998 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:46.459794  2064 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:46.492568 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.475487  2102 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:15:46.495465 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.475924  2081 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:46.474568  2189 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:46.507330 30923 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.493345  1877 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:46.493052  2031 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:46.494141  2134 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:46.497591  2184 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.512776 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:46.496913  1950 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:15:46.534323 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 136178us
I20260709 13:15:46.506323  2066 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:46.492799  2016 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.549338 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.550532 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.511705  2214 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:46.509071  2223 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.590991 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:46.552009 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.531879  2205 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:46.537261  2212 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.545804  1950 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:46.537635  2134 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:46.508879  2064 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.580848  2187 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.581133  2218 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.523501  1877 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:46.568406  2033 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:46.587046 31599 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:46.524092  2110 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:46.594115 30882 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:46.566671  2066 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:46.594587  2186 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:46.604535 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55313.8us
I20260709 13:15:46.618862  2033 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.493073  2215 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.502408  2222 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:15:46.590173  2140 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:46.593405  2214 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.595604  2062 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:15:46.620036 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.549428  2031 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:46.495808  1695 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.535971  2070 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.594754  2178 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.514878  2189 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.592929  1989 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:46.623378 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 125867us
I20260709 13:15:46.598001  2205 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:46.615159  2113 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.003s
W20260709 13:15:46.628477 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 159232us
I20260709 13:15:46.582075  1982 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.627483  2033 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.623965  2110 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.635040  2064 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:46.635274  2224 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:15:46.635663  2134 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.597641  2102 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:46.618714  2130 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:15:46.647223 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.624395  2066 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.646076  2016 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.624049  2227 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.657361 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 614) took 2577 ms. Trace:
I20260709 13:15:46.630681  2140 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:46.700749  2140 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.648568  2214 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.697921  2227 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:46.707525  2227 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.660015  1998 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:46.657078  2074 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.710129  1989 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.712903  1839 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:46.713321  1839 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:46.714077  1839 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.715302  1839 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:46.715091  2066 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.719358  2227 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.722704  2227 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.723582  1855 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.724197  1855 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.726197 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.727366 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.791038 30879 raft_consensus.cc:2410] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:46.651223  2062 consensus_queue.cc:1243] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:15:46.659067  2188 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.002s
I20260709 13:15:46.792387  2188 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.795171  2188 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.652913  1811 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.796079  1811 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.681483 31025 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:46.686450 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.798617  1811 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:46.686748 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:46.802877 31027 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:46.802752 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:46.803325 31023 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.803902 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:46.804489 31025 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:46.806038 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:46.806604 31031 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:46.622556  2218 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.808156 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.808785  2218 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.619587  2081 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:46.696376 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.809619 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:46.810310 30952 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:46.811632 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.660363  2205 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.812525 30950 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:46.803545  2097 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:46.816355 30877 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:46.816606  2097 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:46.817471 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.818282 30877 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:46.727563 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.728273  1855 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.728459 30874 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:46.818976  2102 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:46.819203 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:46.723414  2066 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.819720  2102 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.820906 31025 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:46.821285 30878 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:46.822362  2102 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.822415 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.819010 30880 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:46.823434 30883 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:46.698110 31029 rpcz_store.cc:276] 0709 13:15:44.074252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.238384 (+164132us) service_pool.cc:224] Handling call
0709 13:15:45.448228 (+1209844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.449032 (+   804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.651891 (+1202859us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001bf650. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:46.652022 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781555456}
I20260709 13:15:46.739507  2033 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.829674  2033 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.831620 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 969) took 1970 ms. Trace:
I20260709 13:15:46.832160 31602 rpcz_store.cc:276] 0709 13:15:44.861467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.888624 (+ 27157us) service_pool.cc:224] Handling call
0709 13:15:45.038423 (+149799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.005344 (+966921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.831321 (+825977us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54000104d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:46.831543 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220237184}
I20260709 13:15:46.836107  1484 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.840328  1983 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:46.850194 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.850582 30877 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.852483 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:46.855988  1722 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:46.857813  1883 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:46.858352  1883 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.858806  1883 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.862133  2034 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:46.862711  2034 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:46.870062  2205 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.741362  2031 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.675143  2226 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.874233  2226 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.615617  2212 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.877662  2212 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.687600  2070 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:15:46.659297  1950 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.671959 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:46.880286 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 208396us
I20260709 13:15:46.782981  2126 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:46.880285  1881 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:46.788916  2170 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.518s	user 0.004s	sys 0.000s
I20260709 13:15:46.887694 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 748) took 2325 ms. Trace:
I20260709 13:15:46.888155 30949 rpcz_store.cc:276] 0709 13:15:44.562690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.579152 (+ 16462us) service_pool.cc:224] Handling call
0709 13:15:44.584585 (+  5433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:44.587506 (+  2921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.587537 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:44.599696 (+ 12159us) log.cc:844] Serialized 52 byte log entry
0709 13:15:44.823020 (+223324us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:44.827639 (+  4619us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.033460 (+205821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.033569 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:46.788172 (+1754603us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:46.887309 (+ 99137us) raft_consensus.cc:1685] finished
0709 13:15:46.887446 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.887620 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3827,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":8046,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":15548,"spinlock_wait_cycles":10727808,"thread_start_us":363383,"threads_started":2,"wal-append.queue_time_us":426598}
I20260709 13:15:46.896816  2081 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:46.820096 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:46.697652  2130 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:46.729104  2237 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:46.682117  2185 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:15:47.022042 30879 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:47.022567 30879 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:46.907230  1950 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:46.739797  2110 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:46.913520  2226 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:46.914755 31023 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:46.916061  1815 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:46.919030  2205 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:46.922289  1722 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:46.719663 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.747511  2215 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:46.930739 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.931371 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:46.931833 30954 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.930756 30951 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:15:46.932260 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.936190 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.817766  2097 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:46.941220 30877 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:46.948829 30949 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:47.070955 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.950093 30957 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:47.007165  2033 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:15:47.073385 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:47.074434 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.029017  2126 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:46.935572 30955 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.960294 30779 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 9, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:46.966929  2216 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
W20260709 13:15:46.981735 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44099.5us
I20260709 13:15:47.091871 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:46.943648 31028 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:46.985265 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 351275us
W20260709 13:15:46.994233 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 186546us
I20260709 13:15:47.009125 30883 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:47.018738 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.915529  2189 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:47.103725 30952 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:15:47.027045 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:47.030047 30880 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:46.984668  2140 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.105119 30878 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:47.023715 30879 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:47.108855 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:46.994232  1811 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:47.016948  2054 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.059360 30958 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.060671 30950 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:47.032231  2207 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
I20260709 13:15:47.065420 30874 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:46.771307  1695 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.077598 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:47.078279 31599 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:15:47.078837 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.079195 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:47.034444  2184 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:47.088188 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.070999  2214 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.148442 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.149662 30881 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:47.083892 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.089253 30779 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 7, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:15:47.089890 31605 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:47.098831 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:47.101037 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:47.153215 31600 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.101143 31596 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:47.101207 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:47.102075 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.102708 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.109418 30879 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:47.109526 30953 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:47.083226  2215 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.161262 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:47.050101  2178 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:47.103214 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:47.111946 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:47.066589  2226 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.116263 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:47.116940 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:47.117396 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.117733 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.168256 31027 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:47.169576 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 70797.9us
I20260709 13:15:47.041365  2084 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.178036 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.113049 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.112526  2033 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:47.179015 31029 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:47.179051 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.136032 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.136070 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:47.181113 30950 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:15:47.136370 30776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54998 (request call id 323) took 25088 ms (client timeout 15000 ms). Trace:
I20260709 13:15:47.138787 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.183058 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:47.139394 31598 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:47.139829 30875 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:47.082886  1983 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:47.185197 31598 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:47.139711 31599 pending_rounds.cc:85] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:15:47.140898 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet adb189bd941147e0924cc38c9f01bd11 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:51632
I20260709 13:15:47.142798  1811 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:47.146945  2223 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.003s
I20260709 13:15:47.061813  2112 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:47.151641 30779 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 3 to 8, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.157006 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.200518 30955 raft_consensus.cc:2410] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:15:47.157006 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.163447 30878 raft_consensus.cc:2410] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:15:47.057904  1815 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:47.164381 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.164674 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:47.174135 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 71047.3us
I20260709 13:15:47.174932 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:47.206107 31601 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:47.167587 31032 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:47.108644  2097 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:47.137187 31603 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
W20260709 13:15:47.160205 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d95504ff00154bdf99a5de1ad11f4f58 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:47.186452 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:47.186764 31599 pending_rounds.cc:107] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:15:47.007962  2034 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.189738 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.191092 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:47.183508 31604 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:47.202453 30958 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:47.199501 30779 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.208293 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:47.092456  2126 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.209843 31600 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:47.110960  1877 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:15:47.187350  2237 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:47.244189 31605 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:47.245352 30779 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
W20260709 13:15:47.259116 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.016s
W20260709 13:15:47.259466 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.016s
W20260709 13:15:47.259732 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 666733us
W20260709 13:15:47.260440 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69453.9us
I20260709 13:15:47.262120 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:47.264276 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:47.265008 31031 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.242163 31571 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:47.268534 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:47.272604 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 89649.8us
I20260709 13:15:47.273665 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:47.119146  2110 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:15:47.187474  2027 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:47.295001 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.294896 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:47.295655 31025 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.249622 31599 raft_consensus.cc:2889] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:47.250984 30955 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.212513 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.297420 30951 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:47.298318 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.298828 30951 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:47.108155  2216 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.194540  2033 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.137073  2185 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:15:47.181792 30776 rpcz_store.cc:269] 0709 13:15:22.048205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:22.048393 (+   188us) service_pool.cc:224] Handling call
0709 13:15:22.759706 (+711313us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5400002490. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b36640 00007f2740a0db76 00007f2740b17c3e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc 00007f273efd7392 00007f2738f9548c 00007f2738f948c6
0709 13:15:47.136246 (+24376540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:41.669073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:41.749984 (+ 80911us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:41.750033 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:15:41.750050 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:41.751374 (+  1324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:41.751451 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:41.751477 (+    26us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:15:41.780567 (+ 29090us) tablet.cc:701] Row locks acquired
0709 13:15:41.780619 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:15:41.780793 (+   174us) write_op.cc:270] Start()
0709 13:15:41.780949 (+   156us) write_op.cc:276] Timestamp: P: 1783602941780724 usec, L: 0
0709 13:15:41.780975 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:15:41.781702 (+   727us) log.cc:844] Serialized 5623 byte log entry
0709 13:15:42.906162 (+1124460us) op_driver.cc:464] REPLICATION: finished
0709 13:15:43.495312 (+589150us) write_op.cc:301] APPLY: starting
0709 13:15:43.504315 (+  9003us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:43.650655 (+146340us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:43.740112 (+ 89457us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:43.980039 (+239927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:43.980393 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:15:43.980457 (+    64us) write_op.cc:312] APPLY: finished
0709 13:15:43.980866 (+   409us) log.cc:844] Serialized 101 byte log entry
0709 13:15:44.092337 (+111471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.098697 (+  6360us) write_op.cc:454] Released schema lock
0709 13:15:44.178893 (+ 80196us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:44.208925 (+ 30032us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:44.210352 (+  1427us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":786756,"reported_tablets":38,"spinlock_wait_cycles":34214144,"child_traces":[["op",{"apply.queue_time_us":458566,"apply.run_cpu_time_us":46091,"apply.run_wall_time_us":742869,"num_ops":14,"prepare.queue_time_us":474154,"prepare.run_cpu_time_us":20009,"prepare.run_wall_time_us":332642,"raft.queue_time_us":234033,"raft.run_cpu_time_us":25709,"raft.run_wall_time_us":817472,"replication_time_us":951463,"thread_start_us":1106878,"threads_started":5,"wal-append.queue_time_us":434503,"wal-append.run_cpu_time_us":27719,"wal-append.run_wall_time_us":2617305}]]}
I20260709 13:15:47.254469 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:47.255509 30874 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
W20260709 13:15:47.256023 30767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 95866.3us
I20260709 13:15:47.158145  2188 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:15:47.279100 30883 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:15:47.280002 30880 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:47.280965 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.279386 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:47.314450 30958 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.206094  2112 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:47.258574  2219 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.149012  2054 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.173288  2215 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.299548 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.299366 31024 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:47.301082 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:47.301843 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 63260.9us
I20260709 13:15:47.367184 30955 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:47.309413 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.308727 30879 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:15:47.317816 31569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.001s	sys 0.020s
W20260709 13:15:47.368510 31569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.001s	sys 0.020s
I20260709 13:15:47.287550 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.369547 30950 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:47.369753 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.370625 31604 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:47.288595 30779 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 5 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:15:47.371238 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:47.372634 30779 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:47.193315  2084 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.326570 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:47.179713  2226 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:47.194345  1983 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.280984  2129 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:15:47.300469 31027 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:47.386269 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.383543 31571 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:47.350404 30876 raft_consensus.cc:2368] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:47.213366  2223 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:47.312485  2211 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:47.312070  2033 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.378293 30779 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 6, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.307438  2076 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.314783  1695 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.307468  2238 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:47.386940 31604 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:47.309160  1998 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:47.345449  2023 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:47.324420  2214 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:47.317708  2190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.007s
I20260709 13:15:47.374562  2027 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.437597 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.438630 31032 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13.
I20260709 13:15:47.437909 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.476564 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.479389 30955 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:47.479907 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.481045 30952 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:47.457772 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.481383 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.479561 31597 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:47.482956 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.435793 30779 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 4, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 4 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.484990 30779 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:47.486737  2140 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:47.357118  2219 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:47.309482  2237 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:47.387439 30957 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:47.476521 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.513340  2076 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:47.389523  1983 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:47.487650 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:47.449465  2238 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:47.525166  2238 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.528147  2207 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:47.509361  2023 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.528590  2207 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.528982  2207 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.530174  2023 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.533004  2216 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.488154  2027 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.450449  2112 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.536731  2226 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:47.537165  2112 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:47.538627  2207 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.496541 31604 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:47.542889  2130 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:47.544503  2126 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:47.545192  2219 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:47.548390  1811 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.382593  2102 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
W20260709 13:15:47.549136  1883 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
I20260709 13:15:47.549682  1883 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.378852  2184 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:15:47.380466  2070 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 13:15:47.459842  2129 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:15:47.553725  2207 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.554127  2237 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.557142  2220 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:47.560431  1815 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:47.516888  2211 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.562285  2211 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.521768  1998 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:47.565805  1998 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.567576 30954 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:47.570597 30954 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:47.572491  2241 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:15:47.573055  2034 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.575286  2084 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:47.482287  2190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.011s	sys 0.015s
I20260709 13:15:47.487552  2110 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:47.521252 30952 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:47.521838 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.434056  2092 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.559505  2054 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.579494 30956 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:47.535586  2027 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:47.507678 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.557667  2220 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:47.593663 30954 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:47.519248 30779 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:47.583384 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:47.498888 30958 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 4.
W20260709 13:15:47.604964 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.613584 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:47.621253 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:47.599725 31025 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:47.608785 30956 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:47.624382 30952 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:47.614845 30779 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 3 to 7, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 7 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:47.622357 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:47.643680 30954 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:47.644193 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.644598 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.651697 30779 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 7 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:47.656104 30848 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.027s	sys 0.016s
W20260709 13:15:47.656591 30848 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.027s	sys 0.016s
I20260709 13:15:47.653680 30996 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:47.656862 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 544632us
W20260709 13:15:47.621750  1989 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.008s
I20260709 13:15:47.610761  1952 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.667693 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.642189  1839 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.924s	user 0.008s	sys 0.004s
I20260709 13:15:47.679477 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:47.687201 30880 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:47.632323  2027 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:47.690042 31601 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:47.656144  2070 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:47.700165 30779 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 8, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.600188  1883 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:47.519863  1695 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:47.645100  2031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.000s	sys 0.013s
I20260709 13:15:47.638602  2188 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:15:47.674732  1989 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.004s	sys 0.008s
W20260709 13:15:47.714592 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 401377us
W20260709 13:15:47.683139 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.753801 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.683609  1881 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:47.702435 30779 catalog_manager.cc:5697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.657495  2134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.007s	sys 0.007s
I20260709 13:15:47.610396  2092 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.655840  2215 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:47.689137  2027 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.781608 30998 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:47.707777  2031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.000s	sys 0.013s
I20260709 13:15:47.756839 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:47.696882  2070 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:47.708696 30945 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.009s
I20260709 13:15:47.678752  1815 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:15:47.781054  2134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.007s	sys 0.007s
W20260709 13:15:47.790725  1950 consensus_meta.cc:287] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.000s
I20260709 13:15:47.689463  1952 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:47.803742 31031 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.000s
I20260709 13:15:47.779429  1881 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.817181 31031 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:47.785732  2188 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:47.799145 30945 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.005s	sys 0.010s
I20260709 13:15:47.792985  2027 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.777944  2216 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:15:47.799109  2070 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.705293  2220 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:47.822130  2081 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.802s	user 0.011s	sys 0.001s
I20260709 13:15:47.823421  1881 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:47.820667  1484 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:15:47.828944  1966 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.330s	user 0.011s	sys 0.002s
I20260709 13:15:47.797199 30779 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 6, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.844333 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:47.848526 30877 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:47.707547  2076 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:47.850095 31605 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.856982 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.857851 31597 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:47.850857 30779 catalog_manager.cc:5697] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 7, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 7 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.860103 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.860554 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:47.860746 31596 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:47.840165  2134 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.869431 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.868945 30996 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:47.873534 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:47.849366  1484 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.874145 31600 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:47.853977  2220 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:47.868608  2226 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:47.921499  1815 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:15:47.925271  2097 consensus_meta.cc:287] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.003s
I20260709 13:15:47.840732  1883 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:47.857164  1966 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:47.876965  1722 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.000s
I20260709 13:15:47.936465 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.968462 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.938077 30779 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 6, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.875837  1484 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:47.868305  2219 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:15:47.928856  2226 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.982158 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:47.840386  2232 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.023s
I20260709 13:15:47.983979 30950 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:47.873761  2134 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:47.943173 31600 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:47.986994 30949 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:47.987805 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:47.973402 30779 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.993304 30779 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 2 to 6, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 6 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.994146 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:47.985108  2226 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:47.986392  2232 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.013s	sys 0.023s
I20260709 13:15:47.985904  2097 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:47.987584  2219 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:15:48.014863 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.016s	sys 0.030s
W20260709 13:15:48.024545 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.988518  2142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.022s	sys 0.028s
W20260709 13:15:48.027804 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.016s	sys 0.031s
W20260709 13:15:48.028647 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.038947 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.032912 31598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.025s
I20260709 13:15:47.928493  2188 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:48.040835 31598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.009s	sys 0.025s
I20260709 13:15:48.046406 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:48.061193 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.062731 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:47.980162  1722 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:48.034529  2142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.022s	sys 0.028s
I20260709 13:15:48.085443 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.026342  1883 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:48.087883 30923 leader_election.cc:400] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13.
W20260709 13:15:48.088613 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.013302  2097 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:48.105154  2097 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.105398  2251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51632 (request call id 91) took 1010 ms. Trace:
I20260709 13:15:48.027275  2219 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:48.104636 30923 leader_election.cc:403] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.109975 30953 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:48.032966  2255 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:48.111392 31571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.011s	sys 0.020s
W20260709 13:15:48.114075 31571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.011s	sys 0.020s
I20260709 13:15:48.111150 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:48.066109  2092 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.072268  2076 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.081714  1952 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.126888 31605 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
W20260709 13:15:48.105433  2246 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
W20260709 13:15:48.129266 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.091483  2187 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:48.121852  2250 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:15:48.098799  2237 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.113387  2031 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13.
I20260709 13:15:48.113951  2255 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:48.143617 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:48.107295  1855 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:15:48.147490 31027 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:48.122581  2102 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:47.980453  2211 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:48.144841  2034 consensus_meta.cc:287] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:15:48.160614 31027 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
W20260709 13:15:48.114858 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 731406us
I20260709 13:15:48.173193 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1918) took 1128 ms. Trace:
I20260709 13:15:48.178752 30877 rpcz_store.cc:276] 0709 13:15:47.044607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.068817 (+ 24210us) service_pool.cc:224] Handling call
0709 13:15:47.069121 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.850290 (+781169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.172835 (+322545us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540005aad4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:48.173107 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791563008}
I20260709 13:15:48.105927  2251 rpcz_store.cc:276] 0709 13:15:47.095463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.101541 (+  6078us) service_pool.cc:224] Handling call
0709 13:15:48.104933 (+1003392us) ts_tablet_manager.cc:1151] Deleting tablet adb189bd941147e0924cc38c9f01bd11
0709 13:15:48.105028 (+    95us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:15:48.105310 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":907032,"thread_start_us":626447,"threads_started":1}
I20260709 13:15:48.189587 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:48.182530 30882 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:48.183629 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.190711 31027 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
W20260709 13:15:48.192572 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 411038us
I20260709 13:15:48.194083 31571 leader_election.cc:400] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:48.194491 31571 leader_election.cc:403] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.137019  2076 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.201723 30880 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:48.202806 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.206745  2258 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:48.207036  2031 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.207978  1815 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:48.208206 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:48.208048 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.248391 30883 raft_consensus.cc:2410] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:15:48.209689 30881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.011s	sys 0.008s
W20260709 13:15:48.248914 30881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.008s
W20260709 13:15:48.212376 31569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.003s	sys 0.015s
W20260709 13:15:48.249591 31569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.003s	sys 0.015s
I20260709 13:15:48.215062 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:48.215391 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d95504ff00154bdf99a5de1ad11f4f58 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:48.251375 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:48.226531  1883 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:48.227233  2023 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:48.256165 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.257187 30880 raft_consensus.cc:2410] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:15:48.177023  2216 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.262271 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:48.262948 30877 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.181157  2102 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:48.264220 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet adb189bd941147e0924cc38c9f01bd11 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
W20260709 13:15:48.278362 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.190867  2081 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.149551  2237 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.288663 31027 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:48.292863 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:48.242223  2215 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:48.266952  2247 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:15:48.241604  1966 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.325763 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.327907 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:48.336485 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:48.336897 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:48.337658 31600 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:48.312814 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.013s
W20260709 13:15:48.339985 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.008s	sys 0.014s
W20260709 13:15:48.340288 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 583484us
I20260709 13:15:48.340623 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.341212 31027 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:48.341430 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:48.194482  2238 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:15:48.317652 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2036) took 1207 ms. Trace:
I20260709 13:15:48.262585  1952 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.262794  2034 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:48.346769 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.430481 30874 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:48.204496  2268 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 13:15:48.176657  2219 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.453269 31600 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:48.281998  2257 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9.
I20260709 13:15:48.343801 31023 rpcz_store.cc:276] 0709 13:15:47.110418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.110574 (+   156us) service_pool.cc:224] Handling call
0709 13:15:47.141305 (+ 30731us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.141708 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.141738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.142320 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:15:47.472202 (+329882us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:47.986028 (+513826us) log.cc:844] Serialized 14 byte log entry
0709 13:15:47.991515 (+  5487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:47.991580 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.317311 (+325731us) raft_consensus.cc:1685] finished
0709 13:15:48.317341 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.317574 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5235,"prepare.queue_time_us":716103,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":16277,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":23224,"thread_start_us":821020,"threads_started":2,"wal-append.queue_time_us":641573}
W20260709 13:15:48.336644  1989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.035s
W20260709 13:15:48.477015  1989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.007s	sys 0.035s
I20260709 13:15:48.301187  2215 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:48.477921  2215 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:48.478075 31605 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:48.267412  2031 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.436470 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:48.439168 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 97796.4us
I20260709 13:15:48.280583  2216 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.342608  2134 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:48.454701 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:48.460088 31028 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:48.301494  2081 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:48.467425  2265 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:15:48.474346  2263 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:15:48.335423 30877 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:48.477378  1722 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.481689 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:48.448310  2034 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:48.493373  2031 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:48.494015  1484 consensus_meta.cc:287] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
W20260709 13:15:48.494598  2033 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.973s	user 0.007s	sys 0.002s
I20260709 13:15:48.494791  2237 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:48.498976  1881 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.001s
I20260709 13:15:48.507272 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2077) took 1570 ms. Trace:
W20260709 13:15:48.514381 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 78010.8us
I20260709 13:15:48.519050  2293 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:48.519395  2275 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:15:48.523362 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.294019  2255 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.540134 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.524240  2271 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:15:48.541405 31597 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:48.543511 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:48.456352  1883 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.448673  1952 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.499713  2216 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.556356 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:48.513672  2257 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.584625 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:48.525079 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1700) took 1411 ms. Trace:
I20260709 13:15:48.551848  2034 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:48.547722 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.600283 30952 rpcz_store.cc:276] 0709 13:15:47.113466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.605682 (+492216us) service_pool.cc:224] Handling call
0709 13:15:47.624150 (+ 18468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.625722 (+  1572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.524876 (+899154us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5400255650. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:48.525020 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41641216}
I20260709 13:15:48.505900  2219 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:48.590679 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:48.601914 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 58536.9us
I20260709 13:15:48.579605 30957 rpcz_store.cc:276] 0709 13:15:46.937033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.074211 (+137178us) service_pool.cc:224] Handling call
0709 13:15:48.507097 (+1432886us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400256a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:48.507212 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718535552}
I20260709 13:15:48.599937 31600 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:48.602272 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.480852  2102 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.582494  2293 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:48.588500  2070 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:15:48.559674  1484 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.611382 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.579981  1881 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.591060  2201 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:48.628633 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.629433  2292 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:15:48.560510  2033 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.588469  2205 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.673460 30880 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:48.607522  2084 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:48.674923 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2403) took 1189 ms. Trace:
I20260709 13:15:48.683141 30881 rpcz_store.cc:276] 0709 13:15:47.485446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.485589 (+   143us) service_pool.cc:224] Handling call
0709 13:15:47.485893 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.487067 (+  1174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.487096 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.487700 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 13:15:48.249301 (+761601us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:48.249338 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.249409 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:48.674628 (+425219us) raft_consensus.cc:1685] finished
0709 13:15:48.674657 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.674835 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":774,"raft.queue_time_us":15028,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7752,"thread_start_us":761212,"threads_started":1,"wal-append.queue_time_us":715130}
I20260709 13:15:48.613751  2216 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:48.603188  1998 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:48.672501 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 217860us
W20260709 13:15:48.769856 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 288240us
I20260709 13:15:48.623306  2276 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:48.774989 31031 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:48.665766  2027 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.001s
I20260709 13:15:48.607939  2257 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:48.782616 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 97026.6us
W20260709 13:15:48.783586 31598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.002s	sys 0.031s
I20260709 13:15:48.696743 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:48.754485 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
W20260709 13:15:48.787014 31598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.002s	sys 0.031s
I20260709 13:15:48.669935  1484 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:48.787976 30881 raft_consensus.cc:606] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:15:48.664326  2294 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:48.790978  2264 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:15:48.792786 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1692) took 1699 ms. Trace:
I20260709 13:15:48.795262 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 777) took 1159 ms. Trace:
W20260709 13:15:48.738646 31571 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.952s (SENT) [suppressed 14 similar messages]
W20260709 13:15:48.706508 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.804003 30880 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:15:48.806885 30880 pending_rounds.cc:85] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 8
I20260709 13:15:48.684914  2201 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:48.808786  2033 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.808434  2201 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.787919  2027 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.811738 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:48.807288 30880 pending_rounds.cc:107] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 8.9
W20260709 13:15:48.812723 31032 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.011s	sys 0.025s
I20260709 13:15:48.812973 30880 raft_consensus.cc:2889] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:48.804533 30954 rpcz_store.cc:276] 0709 13:15:47.636101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.683846 (+ 47745us) service_pool.cc:224] Handling call
0709 13:15:47.705121 (+ 21275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.705343 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:48.212247 (+506904us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.430732 (+218485us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.794953 (+364221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.795001 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:48.795057 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.795119 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.795213 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390931,"prepare.queue_time_us":472368,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":759573,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":625347,"threads_started":2,"wal-append.queue_time_us":262364}
I20260709 13:15:48.630939  2076 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.625128  2293 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:48.682405  2271 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:48.801261  2218 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:48.809243  1484 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.626818  2070 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:48.813431 31032 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.011s	sys 0.026s
I20260709 13:15:48.813989 30957 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:48.625217  2255 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.814679 30952 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:48.825059 30952 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:48.800199 30881 raft_consensus.cc:614] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:48.815438 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:48.802156  2280 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:15:48.803920 30955 rpcz_store.cc:276] 0709 13:15:47.093562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.484260 (+390698us) service_pool.cc:224] Handling call
0709 13:15:47.484504 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.484681 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:47.989521 (+504840us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.405387 (+415866us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.792344 (+386957us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b180021ce20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:48.792482 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.792527 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:48.792570 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.792628 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.792733 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":360537,"prepare.queue_time_us":686247,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":512868,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":58845,"spinlock_wait_cycles":89100032,"thread_start_us":880165,"threads_started":3,"wal-append.queue_time_us":445481}
I20260709 13:15:48.817312 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:48.685036  2258 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 13:15:48.830551 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.782435  2290 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:15:48.831180 30955 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:48.811683  1881 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:48.832299 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 775) took 1470 ms. Trace:
I20260709 13:15:48.834334 30955 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:48.837507 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:48.838327 31600 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:48.834542 30956 rpcz_store.cc:276] 0709 13:15:47.361635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.633412 (+271777us) service_pool.cc:224] Handling call
0709 13:15:47.633771 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.634008 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:48.072796 (+438788us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.795192 (+722396us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.831997 (+ 36805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.832043 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:48.832090 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.832150 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.832248 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":400349,"prepare.queue_time_us":510915,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":426740,"thread_start_us":778267,"threads_started":2,"wal-append.queue_time_us":448975}
I20260709 13:15:48.825837 30952 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.852681 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:48.853076 30952 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.833401 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1030) took 1730 ms. Trace:
I20260709 13:15:48.685640  2205 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.839941 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:48.853689 31601 rpcz_store.cc:276] 0709 13:15:47.102782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.212948 (+110166us) service_pool.cc:224] Handling call
0709 13:15:47.213319 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.690564 (+477245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.833160 (+1142596us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54006a54d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:48.833313 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095334656}
I20260709 13:15:48.835351 30955 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.828786  2031 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:48.833544  2097 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.003s
W20260709 13:15:48.833737  2220 consensus_meta.cc:287] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.952s	user 0.012s	sys 0.000s
I20260709 13:15:48.857823 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.860638 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:48.796373  1998 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.867597 30956 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:48.870186 30954 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:48.870944 31025 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:48.872578 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:48.833474  2076 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.879632  2190 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:48.880088  2190 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:48.880503  2190 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:48.881559  2218 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.882068  2218 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:48.884405  2027 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:48.884526 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:48.856930  2140 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:15:48.837245  2215 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.885316 31025 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:48.886260 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.887331 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.888161 31024 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8.
I20260709 13:15:48.889467 31023 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:48.891124 31027 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:48.895416 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 156817us
I20260709 13:15:48.902153  2218 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.857615  2216 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:48.905797 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:48.910418 31026 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:48.854447  2303 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:15:48.908640 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.908816 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:48.823555  2271 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.909161  2207 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:48.869234  2031 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.915144 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:48.871588  2097 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.916580 30952 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:48.832974  1484 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.867662  2283 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:48.815058  2294 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:48.919199 31028 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:48.904771  2218 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:48.909909  2274 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:15:48.918344  2140 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:15:48.862874  2304 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:48.910166  2216 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.910229  2027 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.854574  2276 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.984611 30956 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:48.914809 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:48.917384  2292 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.986536 30952 pending_rounds.cc:85] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:15:49.097254 30952 pending_rounds.cc:107] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:49.097543 30952 raft_consensus.cc:2889] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:48.907318  2076 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:48.981257 31026 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:15:49.109846 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 195101us
I20260709 13:15:49.092190  2304 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:49.120258  2304 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.124191 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:48.983242  2207 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:49.125222 30957 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:49.125671  2207 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:49.126365  2272 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:15:49.126742  2207 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:49.128415 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:49.128964 31026 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.129364 31025 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:49.131104 31025 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:15:49.132405 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:49.132946 31025 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.133244 31023 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:49.133421  2070 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.133981  2305 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:49.134636  2226 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.100s	user 0.009s	sys 0.000s
I20260709 13:15:49.134485  2305 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.132470 31027 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:15:49.125429  2309 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:15:48.994426  2283 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:48.983605  1952 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.137419 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:49.138778 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:49.148320 30957 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.124256  2257 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.136641 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.015954 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:49.096197  2307 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:15:49.157881 31026 raft_consensus.cc:2410] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:15:49.163182 30956 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:49.176541 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:49.172144 31025 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:49.161864 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.099013  2216 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.195349 31027 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:49.135052  2226 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:49.196605 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 60055.3us
I20260709 13:15:49.188210 31026 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:49.200507 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.199369 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:49.201813 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.198511 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:49.198956 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:49.201464 31025 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:49.203244 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:49.212953 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.213605 30957 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:49.141408  2218 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.211026 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:49.147877  2283 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.147409  2215 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:49.194101  2300 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 13:15:49.221822 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:49.218770 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:49.224443 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.193171  2303 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.193825  2297 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:49.205673  2257 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.199838  2211 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.237224 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 768) took 2286 ms. Trace:
I20260709 13:15:49.218459  2054 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:49.219292  2218 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:49.223112 30770 maintenance_manager.cc:419] P 9bcfacd34c704ab69ff2de017b2e1fb5: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033368
I20260709 13:15:49.140518  2027 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.218636  1855 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.219571  2256 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:49.149392  2070 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:15:49.218254  2288 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.096844  2292 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.265480 30949 rpcz_store.cc:276] 0709 13:15:46.951190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.083466 (+132276us) service_pool.cc:224] Handling call
0709 13:15:47.099991 (+ 16525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.989639 (+889648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.236968 (+1247329us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540008c5d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.237154 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039356800}
I20260709 13:15:49.225020  2223 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.271397 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 776) took 1636 ms. Trace:
I20260709 13:15:49.272145  2023 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:49.272670 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.272944 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:49.316289 30952 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:49.274626  2302 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 13:15:49.139978  2276 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.237855  2297 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.236945  2215 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.310544 30953 rpcz_store.cc:276] 0709 13:15:47.634558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.648364 (+ 13806us) service_pool.cc:224] Handling call
0709 13:15:47.684140 (+ 35776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.110466 (+426326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.271120 (+1160654us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b540027f954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.271321 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978789632}
I20260709 13:15:49.308377 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:49.235996 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 123352us
I20260709 13:15:49.224702  2102 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:15:49.230139  1722 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:15:49.330809  2323 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:15:49.275134  2218 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.269761  2140 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:49.279207  2308 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:15:49.367533  2076 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.345134 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.345625 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.369383 31601 raft_consensus.cc:2410] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 10 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:15:49.354506 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:49.356009  2327 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.349921  2290 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.371276  2290 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.372264 30951 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.375110  2290 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.376268  2256 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.377072  2256 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.265844  1883 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:15:49.358055 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1117) took 2260 ms. Trace:
I20260709 13:15:49.382265  2256 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.380889 31598 rpcz_store.cc:276] 0709 13:15:47.097459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.186080 (+ 88621us) service_pool.cc:224] Handling call
0709 13:15:47.186382 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.241666 (+ 55284us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:47.516094 (+274428us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18004c0f60. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:15:48.067280 (+551186us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.788297 (+721017us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.798356 (+ 10059us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.798502 (+   146us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:48.798530 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.798973 (+   443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.336859 (+537886us) raft_consensus.cc:1685] finished
0709 13:15:49.357779 (+ 20920us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.357974 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54652,"prepare.queue_time_us":871317,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2084,"raft.queue_time_us":54908,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":31628,"spinlock_wait_cycles":30004480,"thread_start_us":1225450,"threads_started":2,"wal-append.queue_time_us":767290}
W20260709 13:15:49.377660 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 155932us
I20260709 13:15:49.388715 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:49.313925  2023 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:49.314612  2294 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.262777  2190 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.352645  2297 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.278803  2054 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.356683  2223 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:49.350061  1695 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:49.397145 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 195355us
I20260709 13:15:49.258649  2303 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.404134 31571 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.405010 30951 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:49.405100  2303 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.405280  2215 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.405620 31571 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.329571  1855 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.406019 31029 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:49.397173 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.333976  2288 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:49.409741 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 648) took 1349 ms (client timeout 1594 ms). Trace:
I20260709 13:15:49.410167  2288 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.395712  2140 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:49.410130 31031 rpcz_store.cc:269] 0709 13:15:48.060656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.060848 (+   192us) service_pool.cc:224] Handling call
0709 13:15:49.409552 (+1348704us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54001bf654. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:49.409684 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628797824}
I20260709 13:15:49.411352  2140 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:49.413076 30848 connection.cc:256] RPC call timeout handler was delayed by -1.24635071900002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:15:49.413486 30848 connection.cc:256] RPC call timeout handler was delayed by -1.1338507190000655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:15:49.415936  2301 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:49.416460  2301 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.417196  2294 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.417779  2294 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.418496  2301 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.419081  2301 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.408257 30949 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:49.420836 30922 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:49.398228  2031 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.424036 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.424600 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.423030  1695 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:49.430862 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 115211us
W20260709 13:15:49.425814  2318 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:15:49.426381 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2404) took 1807 ms. Trace:
I20260709 13:15:49.434612 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:49.434834 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.425909  2321 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.430960 31601 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:49.431262 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.402474  2097 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.432854 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.419548  2301 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:49.423724  2313 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:15:49.430169 31598 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:49.431034 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.400854  1998 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.434695 30878 rpcz_store.cc:276] 0709 13:15:47.620435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.620555 (+   120us) service_pool.cc:224] Handling call
0709 13:15:47.620894 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:47.621245 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.621274 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:47.799246 (+177972us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b180038e180. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b3b2a6 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a
0709 13:15:49.008843 (+1209597us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b2c00000f48. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:15:49.094108 (+ 85265us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.276339 (+182231us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:49.276399 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.276507 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.426156 (+149649us) raft_consensus.cc:1685] finished
0709 13:15:49.426172 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.426322 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11673,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":17535,"spinlock_wait_cycles":42568192,"thread_start_us":82590,"threads_started":1,"wal-append.queue_time_us":132102}
I20260709 13:15:49.455838 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:49.424885  2294 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.453749 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.426954  2102 raft_consensus.cc:2764] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:15:49.422310  2271 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.438779 30952 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:49.423395  2215 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.407245  2223 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.458348  2031 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.435514  2070 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:15:49.462126  2293 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 13:15:49.462301  2027 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:49.463066  2317 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:15:49.464304  2276 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.437899  1695 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.435405  2238 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:49.427030  2256 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.433527 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:49.457334  2314 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:15:49.451181  2305 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:49.442687 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.474432 30767 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d95504ff00154bdf99a5de1ad11f4f58 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:49.468307 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.483515 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 653) took 1364 ms. Trace:
I20260709 13:15:49.481324  1695 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.504657 31032 rpcz_store.cc:276] 0709 13:15:48.119339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.119499 (+   160us) service_pool.cc:224] Handling call
0709 13:15:48.119932 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.824510 (+704578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.824733 (+   223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.837487 (+ 12754us) log.cc:844] Serialized 26 byte log entry
0709 13:15:48.908217 (+ 70730us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:48.908257 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.908356 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.483302 (+574946us) raft_consensus.cc:1685] finished
0709 13:15:49.483326 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.483455 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28918,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":21888,"thread_start_us":743946,"threads_started":2,"wal-append.queue_time_us":125412}
I20260709 13:15:49.477808  2329 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:15:49.506632  2329 consensus_queue.cc:1243] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:15:49.507826  2216 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.472589  2226 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.476317  2293 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.510146  2216 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.479607 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 810) took 1205 ms. Trace:
W20260709 13:15:49.483105  2034 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.870s	user 0.009s	sys 0.001s
I20260709 13:15:49.526779 30874 rpcz_store.cc:276] 0709 13:15:48.274622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.824072 (+549450us) service_pool.cc:224] Handling call
0709 13:15:48.851841 (+ 27769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.852191 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:48.867468 (+ 15277us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.239625 (+372157us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.239745 (+   120us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.240379 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.240539 (+   160us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:49.240768 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.240981 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.241055 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.479416 (+238361us) raft_consensus.cc:1685] finished
0709 13:15:49.479434 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.479554 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15115,"prepare.run_wall_time_us":47,"raft.queue_time_us":2875,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":27033,"spinlock_wait_cycles":97949824,"thread_start_us":267019,"threads_started":1,"wal-append.queue_time_us":470270}
I20260709 13:15:49.506528 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.507845  1484 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:49.510999 30882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 796) took 2700 ms (client timeout 1952 ms). Trace:
I20260709 13:15:49.471498  2215 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.512701  2293 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.474898  2330 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.562752  2330 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:49.477217  2322 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:15:49.514577  2190 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.453233  2321 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.484129  2054 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.516242  2292 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:49.514586  2270 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.891s	user 0.002s	sys 0.000s
I20260709 13:15:49.517416 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.518056 30877 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:49.441437  2288 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.491161 30951 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:49.482980 31596 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.500406 31600 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:15:49.570245 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.570676 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.571025 30951 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:49.571508 31600 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:49.480473  2256 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.573954 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.473099  2031 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:49.531373 30882 rpcz_store.cc:269] 0709 13:15:46.810976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.819860 (+  8884us) service_pool.cc:224] Handling call
0709 13:15:49.510819 (+2690959us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000a0fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:49.510934 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721030400}
I20260709 13:15:49.513134  1855 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.539222  2223 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.542250  2215 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.453248  2023 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.544091 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:49.545478  2081 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.595527 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.596392 30882 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:49.597653 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.598402 30882 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:49.546226 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.546442 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.547158 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.600996 31605 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:49.547848 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.548511 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.604149 31597 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:15:49.549154 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.606356 31604 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.554351  2304 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.560966 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2405) took 1919 ms. Trace:
I20260709 13:15:49.483448  2102 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:49.477501  2301 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.614851 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.615648 30880 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:49.575177  2256 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.568996 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:49.569095 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.576354  2031 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:49.575860 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 109091us
W20260709 13:15:49.576776 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 162510us
I20260709 13:15:49.623417 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:49.623660 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:49.624401 30950 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:49.579093 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1016) took 2502 ms. Trace:
I20260709 13:15:49.590353 30874 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.626959 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:49.591398 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.627753 30883 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:49.608932 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:49.628651 30949 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:15:49.607970 30876 rpcz_store.cc:276] 0709 13:15:47.641299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.641456 (+   157us) service_pool.cc:224] Handling call
0709 13:15:47.680364 (+ 38908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.784790 (+104426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.784831 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.785543 (+   712us) log.cc:844] Serialized 52 byte log entry
0709 13:15:48.132547 (+347004us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:48.132589 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.560487 (+1427898us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540005a0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.560543 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.560593 (+    50us) raft_consensus.cc:1685] finished
0709 13:15:49.560607 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.560893 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3961,"raft.queue_time_us":99,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5577,"spinlock_wait_cycles":239040768,"thread_start_us":307530,"threads_started":1,"wal-append.queue_time_us":637295,"wal-append.run_cpu_time_us":1671,"wal-append.run_wall_time_us":1020437}
W20260709 13:15:49.612052 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.599500 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.623266 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.605275 30847 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.579205  2201 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:49.631031 30847 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.625444 31602 rpcz_store.cc:276] 0709 13:15:47.076591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.078803 (+  2212us) service_pool.cc:224] Handling call
0709 13:15:47.110146 (+ 31343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:47.307757 (+197611us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:47.707943 (+400186us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.160628 (+452685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.160696 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:48.160763 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.497355 (+336592us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:49.558109 (+1060754us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b18003c01c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:49.578843 (+ 20734us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54005f0354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.578884 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.579035 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2754,"prepare.queue_time_us":835191,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":9143,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8432,"spinlock_wait_cycles":507090048,"thread_start_us":812451,"threads_started":2,"wal-append.queue_time_us":633884,"wal-append.run_cpu_time_us":3522,"wal-append.run_wall_time_us":1098426}
I20260709 13:15:49.616851 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.564422  2034 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.634496 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:49.630019 30882 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:49.566663 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 368184us
I20260709 13:15:49.635866 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.636627 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.636593 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.637372 30883 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:49.572561 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.621326 30956 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.640548 30951 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:49.600275 31598 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:49.634153 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.642985 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.646627 30998 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:49.648005  1811 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.648430  1811 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.648787  1811 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.649691 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:49.641601 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.645380 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2402) took 2417 ms. Trace:
I20260709 13:15:49.617555  2226 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.620791  2214 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.628219  1950 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.654770 31571 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.650538 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.652576 31599 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:49.659924 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:49.618253  2223 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.622609  2097 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.644230  2102 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:49.650460  2023 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.689139 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.654114  2216 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:49.695283 31604 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:49.664851 30956 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:49.661366 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:49.654505 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.667968 30878 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.668787 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:49.617833  2283 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.645848  2301 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.634066  2303 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:49.633793  2201 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.677968 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.669418  2257 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:49.672996  2214 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.669008  2226 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.644223  2081 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:49.687218  2205 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.688092  2097 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.724224  2214 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.724797  2329 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:49.725021  2097 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.655854  2298 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:49.725530  2329 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:49.725726  2298 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.726244  2298 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.726788  2329 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.651611  2190 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:49.731240  2190 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.731637  2190 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:49.673758 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.650846  1484 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:49.653635  2033 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:49.702613 31596 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:49.666013  1722 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:49.669549  2112 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:15:49.681461 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.749138 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:49.684628  2288 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:49.655242  2215 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:49.651667  1877 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:15:49.712617 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.654696  2293 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:15:49.651247  2297 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.760453  2034 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.712177  2336 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:15:49.762368  2297 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.763935  2283 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.676992  1855 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:15:49.764603  1855 consensus_queue.cc:1243] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:15:49.764832  2321 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.695533  2216 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:49.765910  2216 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:49.669991  2140 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:15:49.772053  2257 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:49.677035  2238 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:15:49.708397  2201 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.773141  2237 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:49.773555  2237 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:49.774371  2237 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.776157  2257 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:49.777431 31604 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:49.777087  2257 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.778899 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.708321  2027 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:49.713402  2292 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:49.693009  1950 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.689208  2223 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.691856  2218 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.753964 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.754426  2288 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:49.787081  2288 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.789242  1811 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:49.720111  2303 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:49.791334  1811 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.798202  2297 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:49.791740  2303 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.798844  2297 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:49.760027  2226 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:49.759929  2102 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:49.806134  2333 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.091s	user 0.002s	sys 0.000s
W20260709 13:15:49.772238  2207 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.645s	user 0.016s	sys 0.001s
I20260709 13:15:49.700078  2301 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.783739 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.810657  2301 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:49.793666  2218 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:49.784355 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.784400 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.748411  1722 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.775538  2237 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.748242  2112 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.799829  2297 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.768355  2330 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.801409  2027 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:49.810091  2140 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.815912  1722 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.819509  2112 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:49.815886  2304 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:49.824728  2027 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:49.852000  2276 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:49.861220  2298 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:49.652449 30875 rpcz_store.cc:276] 0709 13:15:47.228185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:47.377980 (+149795us) service_pool.cc:224] Handling call
0709 13:15:47.436570 (+ 58590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:47.477420 (+ 40850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:47.477456 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:47.478044 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 13:15:47.780374 (+302330us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b180038e360. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:15:48.161100 (+380726us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:48.161142 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.161226 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.513875 (+1352649us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:49.645169 (+131294us) raft_consensus.cc:1685] finished
0709 13:15:49.645189 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.645324 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2411,"raft.queue_time_us":45322,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":32352,"spinlock_wait_cycles":115128448,"thread_start_us":380516,"threads_started":1,"wal-append.queue_time_us":1028278}
I20260709 13:15:49.938864 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:49.940848 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.689805 30882 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:49.943747 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:49.945078 30882 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:49.945160 30877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 804) took 1700 ms (client timeout 2066 ms). Trace:
W20260709 13:15:49.946049 30877 rpcz_store.cc:269] 0709 13:15:48.245072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.537865 (+292793us) service_pool.cc:224] Handling call
0709 13:15:49.944549 (+1406684us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54003412d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:49.944904 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152411008}
I20260709 13:15:49.688102 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:49.952567 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 302771us
I20260709 13:15:49.697490 30883 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:49.954067 30924 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:49.955155 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 813) took 1679 ms. Trace:
W20260709 13:15:49.960480 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 299016us
I20260709 13:15:49.661513 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:49.970775 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 309178us
W20260709 13:15:49.973767 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 319159us
I20260709 13:15:49.975291 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.978008 31601 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:15:49.978873 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:49.980418 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.981478 31605 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:49.981958 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:49.983726 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.984867 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1927) took 1768 ms. Trace:
I20260709 13:15:49.985539 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:49.980851 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.998307 31599 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:49.985417 30879 rpcz_store.cc:276] 0709 13:15:48.216470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.216615 (+   145us) service_pool.cc:224] Handling call
0709 13:15:48.216961 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.501047 (+284086us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:48.549342 (+ 48295us) log.cc:844] Serialized 14 byte log entry
0709 13:15:48.974339 (+424997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.974401 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:48.974462 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.984328 (+1009866us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54000d43d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.984404 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.984650 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17245,"prepare.queue_time_us":129074,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":7191,"raft.queue_time_us":121557,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":28205,"spinlock_wait_cycles":652770688,"thread_start_us":468384,"threads_started":2,"wal-append.queue_time_us":445317}
I20260709 13:15:49.988075 31605 pending_rounds.cc:85] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:15:49.988224 31600 raft_consensus.cc:1217] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-9.9]   Dedup: 5.7->[7.8-9.9]
I20260709 13:15:49.989567 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 789) took 1171 ms. Trace:
I20260709 13:15:49.991762 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:49.993506 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:49.941150 30875 raft_consensus.cc:2410] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:15:49.994037 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:49.999392 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 786) took 1188 ms. Trace:
I20260709 13:15:49.818007  1484 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:50.000789 31600 pending_rounds.cc:85] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 7
I20260709 13:15:50.000834 30954 rpcz_store.cc:276] 0709 13:15:48.818503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.818756 (+   253us) service_pool.cc:224] Handling call
0709 13:15:48.819125 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.877188 (+ 58063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.989007 (+1111819us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54001941d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.989349 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102255360}
I20260709 13:15:50.000540 31605 pending_rounds.cc:107] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:15:50.028231 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:49.999379 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:50.036291 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:50.061079 31600 pending_rounds.cc:107] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:15:50.065452 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:50.061444 31605 raft_consensus.cc:2889] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.065148 31600 raft_consensus.cc:2889] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.068382 31601 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:50.080582 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.080771  1484 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:50.082163 30953 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:50.084152 31603 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:15:50.084797 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 88240.2us
I20260709 13:15:49.866287  2276 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:50.003983 30958 rpcz_store.cc:276] 0709 13:15:48.811323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.812770 (+  1447us) service_pool.cc:224] Handling call
0709 13:15:48.813049 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.813236 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:48.830995 (+ 17759us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.997917 (+1166922us) spinlock_profiling.cc:243] Waited 8.83 ms on lock 0x7b180022e100. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:15:49.998307 (+   390us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.998679 (+   372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.998762 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:49.998867 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.998958 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.999214 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31391,"prepare.queue_time_us":13476,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":7069,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":5725,"spinlock_wait_cycles":20851328}
I20260709 13:15:50.093500  2207 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:50.094126  2023 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.094422 30877 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:15:50.095377 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 96264.2us
I20260709 13:15:50.095084  2023 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.095747 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:50.096385 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:50.097087 30875 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.098011  2023 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.098455 30923 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:50.098620 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:50.100157  2255 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.101267  2255 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:50.103802 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.856786  2288 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.096679 30877 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:49.842227  2140 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.114415 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:50.127118  2223 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:50.128275 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 134964us
I20260709 13:15:50.129266  2342 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:15:50.130147  2186 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:50.130380 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 145372us
I20260709 13:15:50.122991 30879 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:50.133818 30882 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:50.140165  2330 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:15:50.141639  2292 raft_consensus.cc:2764] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:15:50.142274 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 68123.6us
I20260709 13:15:50.143306 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:50.131412 31571 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:50.162876 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:50.163683 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65423.4us
I20260709 13:15:50.164808 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:50.165674  2329 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:50.151648  2276 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.129376 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:49.955681 30881 rpcz_store.cc:276] 0709 13:15:48.275419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.895941 (+620522us) service_pool.cc:224] Handling call
0709 13:15:48.896222 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.135791 (+239569us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:49.341658 (+205867us) log.cc:844] Serialized 14 byte log entry
0709 13:15:49.652004 (+310346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.652055 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:49.652106 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.954009 (+301903us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18002f8180. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b3b2a6 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419
0709 13:15:49.954640 (+   631us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400124dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:49.954680 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.954953 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44201,"prepare.queue_time_us":286180,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":12176,"raft.queue_time_us":27086,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":31626,"spinlock_wait_cycles":494733568,"thread_start_us":440291,"threads_started":2,"wal-append.queue_time_us":365794}
I20260709 13:15:50.168263 30954 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.130188  2140 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.199091 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:50.167614  2276 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.197711 30883 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:50.205917 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:50.207991 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 64925.7us
I20260709 13:15:50.213229 30879 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:50.194867  2255 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.220657 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:50.127143  2076 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:15:50.223976  2140 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:50.248066  1950 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:50.249719 30874 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.009s
I20260709 13:15:50.249883 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1931) took 1667 ms. Trace:
I20260709 13:15:50.250298 30874 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:50.250356 30883 rpcz_store.cc:276] 0709 13:15:48.582604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.248487 (+1665883us) service_pool.cc:224] Handling call
0709 13:15:50.249055 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.249443 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.249473 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.249541 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:50.249587 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.249681 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.249804 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.251807  2339 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:15:50.217250  1998 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:50.253211 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 122034us
I20260709 13:15:50.253415 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:50.254334  2341 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:50.254639 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:50.254995  2316 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:50.255568  2322 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:15:50.256245  1839 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:50.256897  1839 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:50.257361 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 128196us
I20260709 13:15:50.258466  1839 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.260823  2329 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:50.264819 30882 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
W20260709 13:15:50.267051 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51690.5us
W20260709 13:15:50.256922 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.256966  2298 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.259080  2288 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.273084 30877 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:50.246447  2033 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:50.256899 30878 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.000s
I20260709 13:15:50.259573 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:50.283735 30878 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:50.286813  2293 raft_consensus.cc:2764] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:15:50.288024 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.288230 30924 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:50.288506 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2088) took 1016 ms. Trace:
I20260709 13:15:50.288954 30957 rpcz_store.cc:276] 0709 13:15:49.271846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.271984 (+   138us) service_pool.cc:224] Handling call
0709 13:15:49.272304 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.272519 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:50.154552 (+882033us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.287900 (+133348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.287993 (+    93us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:50.288095 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.288197 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.288319 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":769301,"prepare.queue_time_us":863597,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":12595,"thread_start_us":137903,"threads_started":2}
I20260709 13:15:50.291715 30957 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:50.307072  2102 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:50.308192 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:50.309799 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.307132  2342 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:50.312145  2334 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:50.312602  2033 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:50.313952  2033 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.316015  2288 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:50.317106  2288 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:50.317476  2288 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:50.317834  2288 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.307973  2102 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:50.327349 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 67731.5us
I20260709 13:15:50.327957  2297 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.328608  2297 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.329094 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:50.332384 31601 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:50.332645  1998 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.334771  2290 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:50.335170  2290 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.335495  2290 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.342222 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:50.344239  2339 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:50.344771  2339 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:50.354183 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.321448  2076 consensus_queue.cc:1243] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:15:50.355665 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:50.426146 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:50.303622  2341 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:50.312147  2342 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:50.394135  2339 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.433167  2304 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:50.433408 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:50.463822 31603 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
W20260709 13:15:50.465544  2031 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.822s	user 0.006s	sys 0.006s
I20260709 13:15:50.466092  2031 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.466521 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:50.468181 30998 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:50.468267  2271 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:15:50.469465  2216 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.013s
I20260709 13:15:50.469923  2216 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.470471  2102 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.472114  2339 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.474136 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.465579 31603 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:50.466544 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 207161us
W20260709 13:15:50.478199 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 145035us
I20260709 13:15:50.440253  2342 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.484737 30952 raft_consensus.cc:2368] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:15:50.484856  2303 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:50.486720  2341 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.492350 30951 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:50.439491  2304 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.466876  2226 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.507694  2216 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.509634  2238 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:50.511081  2031 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.512161  1950 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:50.512812  1950 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.515040  1950 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:50.515180  2201 consensus_meta.cc:287] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.741s	user 0.006s	sys 0.024s
I20260709 13:15:50.532606  2201 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.532500  2226 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.396591  1484 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.501843  2304 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.547596 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:50.510010 30875 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:50.524770  2303 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:50.515628  2292 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:15:50.576143  2253 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.585641  2253 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.586963  2303 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.583235  1950 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:50.588169  1950 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.588346 31597 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:50.588616  1950 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:50.569099  2326 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.576588 30880 raft_consensus.cc:2368] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:50.576166  2336 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.585947  2292 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:15:50.593665 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.596045 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.573467 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2411) took 1310 ms. Trace:
I20260709 13:15:50.569885  2271 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:50.616351 30954 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:50.598312 30875 rpcz_store.cc:276] 0709 13:15:49.262728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.035628 (+772900us) service_pool.cc:224] Handling call
0709 13:15:50.573388 (+537760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.591873  2326 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.595727  2292 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:50.614256  2271 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.628597 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.627108  2255 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:50.631435 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:50.627550 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:50.634343 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 99140.4us
I20260709 13:15:50.613320  2201 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:50.653522 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.663107 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:50.671597 30996 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:50.672266 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 44909.2us
I20260709 13:15:50.674021 30951 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.643361  2271 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.697638 31603 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:50.665635  2297 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:50.700357 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 49226.2us
I20260709 13:15:50.703940 30875 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:50.667361  2253 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.632917  2336 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.719476 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:15:50.722837 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.711359  1484 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:50.746150 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 169734us
W20260709 13:15:50.749218  2361 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:15:50.751210  2129 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:50.751914  2070 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:50.752601  2070 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:50.758841 30956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.013s	sys 0.020s
I20260709 13:15:50.746795  2201 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:50.769428  2257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.017s	sys 0.050s
I20260709 13:15:50.772487  2226 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:50.749280  2027 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.858s	user 0.015s	sys 0.003s
W20260709 13:15:50.780220 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 78931.9us
I20260709 13:15:50.754057  2102 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:50.758049  2129 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:50.778401  2257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.018s	sys 0.050s
W20260709 13:15:50.788385 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 110610us
I20260709 13:15:50.767195  2255 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:50.791663  2102 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.810722 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.809592 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:50.803306  2256 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.158s	user 0.011s	sys 0.002s
I20260709 13:15:50.813063 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.809834 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1932) took 2226 ms. Trace:
I20260709 13:15:50.814057 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1933) took 2230 ms. Trace:
I20260709 13:15:50.789465  2027 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:50.808504  2370 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:50.819432 31032 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:50.817188 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1934) took 2233 ms. Trace:
I20260709 13:15:50.838471 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1717) took 1340 ms. Trace:
I20260709 13:15:50.825605 30874 rpcz_store.cc:276] 0709 13:15:48.583033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.251266 (+1668233us) service_pool.cc:224] Handling call
0709 13:15:50.269301 (+ 18035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.460387 (+191086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.460431 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:50.522549 (+ 62118us) log.cc:844] Serialized 26 byte log entry
0709 13:15:50.673659 (+151110us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:50.673756 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.673900 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.809595 (+135695us) raft_consensus.cc:1685] finished
0709 13:15:50.809614 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.809754 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2519,"raft.queue_time_us":7980,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":44670,"thread_start_us":77971,"threads_started":1,"wal-append.queue_time_us":193074}
I20260709 13:15:50.831041 30882 rpcz_store.cc:276] 0709 13:15:48.583436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.265783 (+1682347us) service_pool.cc:224] Handling call
0709 13:15:50.266218 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.424462 (+158244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.424506 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:50.436865 (+ 12359us) log.cc:844] Serialized 26 byte log entry
0709 13:15:50.668505 (+231640us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:50.668555 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.668645 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.813856 (+145211us) raft_consensus.cc:1685] finished
0709 13:15:50.813874 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.814000 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59160,"raft.queue_time_us":164646,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":194753,"threads_started":1,"wal-append.queue_time_us":295678}
I20260709 13:15:50.836159 31598 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:50.870309 30881 rpcz_store.cc:276] 0709 13:15:48.583713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.266191 (+1682478us) service_pool.cc:224] Handling call
0709 13:15:50.266600 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.319379 (+ 52779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.319413 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:50.362879 (+ 43466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:50.660891 (+298012us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:50.660959 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.661056 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.816962 (+155906us) raft_consensus.cc:1685] finished
0709 13:15:50.816986 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.817131 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133777,"raft.queue_time_us":53995,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":5338,"thread_start_us":166784,"threads_started":1,"wal-append.queue_time_us":290859}
I20260709 13:15:50.753669  2070 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:50.835300  2369 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:15:50.820570 31031 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:15:50.822525 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:50.821200 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.786891  2201 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:50.889366  2342 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:50.832933  2112 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.002s
I20260709 13:15:50.794173  2292 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.892132  2112 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.894586  2112 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.896720 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:15:50.900005  2326 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.834671  2027 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:50.902505  2276 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.002s
I20260709 13:15:50.899567 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:50.817279 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:50.817390  2301 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.006s	user 0.009s	sys 0.008s
I20260709 13:15:50.880599  2226 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.815091 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.837116  1877 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:50.800701  2129 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.879963  2216 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.911105 31602 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:50.911924 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:50.917644 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.016s	sys 0.053s
W20260709 13:15:50.918004 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.016s	sys 0.053s
I20260709 13:15:50.852519 30875 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:50.872063 30956 rpcz_store.cc:276] 0709 13:15:49.498620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.696303 (+197683us) service_pool.cc:224] Handling call
0709 13:15:49.696637 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.708877 (+ 12240us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:50.079968 (+371091us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.777341 (+697373us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.777703 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.779521 (+  1818us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:50.836392 (+ 56871us) log.cc:844] Serialized 26 byte log entry
0709 13:15:50.836557 (+   165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:50.836590 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.836705 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.838234 (+  1529us) raft_consensus.cc:1685] finished
0709 13:15:50.838253 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.838415 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303033,"prepare.queue_time_us":496093,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":111,"raft.queue_time_us":30488,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":3965,"spinlock_wait_cycles":14747648,"thread_start_us":741593,"threads_started":2,"wal-append.queue_time_us":663093}
I20260709 13:15:50.867273 30951 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:50.919929 31025 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:50.832216  1998 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.838011  2336 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.924820 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.814752  1950 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.793642  2290 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.940892 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:50.819914  2256 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.945940 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.911417  2303 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.914019  2076 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:50.945187 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:50.950388 30874 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:50.950286  1722 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.809s	user 0.007s	sys 0.007s
I20260709 13:15:50.940197  2216 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.972160  2256 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.956079 30882 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:50.973454  2216 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.934413  2342 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:50.924263  2226 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.977061  2226 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.977694 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:50.979875  1950 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.980567  1950 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:50.980778 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:50.982334 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 801) took 1264 ms. Trace:
I20260709 13:15:50.982533 31028 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:15:50.983999  2076 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:50.982748 30950 rpcz_store.cc:276] 0709 13:15:49.718458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.311241 (+592783us) service_pool.cc:224] Handling call
0709 13:15:50.311688 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.494222 (+182534us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:50.521696 (+ 27474us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.724723 (+203027us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:50.748302 (+ 23579us) log.cc:844] Serialized 26 byte log entry
0709 13:15:50.748442 (+   140us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:50.748475 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.748547 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:50.982110 (+233563us) raft_consensus.cc:1685] finished
0709 13:15:50.982128 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.982280 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3752,"prepare.queue_time_us":27276,"prepare.run_wall_time_us":46,"raft.queue_time_us":26897,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":12336,"spinlock_wait_cycles":6990720,"thread_start_us":133226,"threads_started":1,"wal-append.queue_time_us":369891}
I20260709 13:15:50.984926  2382 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:50.985137  2076 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.985579  2382 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.986136  2102 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:50.957851 31023 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:50.958227  2034 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:50.958992 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 794335us
I20260709 13:15:50.988090  2201 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.988911 31024 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:50.990036  1722 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:50.990161 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1708) took 1557 ms (client timeout 1768 ms). Trace:
W20260709 13:15:50.991024 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 91545us
I20260709 13:15:50.971370 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:50.991889 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:50.992898 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:50.993507  2362 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.550s	user 0.002s	sys 0.000s
I20260709 13:15:50.993306  2304 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:50.991246 30952 rpcz_store.cc:269] 0709 13:15:49.432928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.467975 (+ 35047us) service_pool.cc:224] Handling call
0709 13:15:50.989950 (+1521975us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400256554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:50.990086 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197499136}
I20260709 13:15:50.995260  2216 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:50.995836 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:50.996150 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1938) took 2369 ms. Trace:
I20260709 13:15:50.996554 30874 rpcz_store.cc:276] 0709 13:15:48.585345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.913302 (+2327957us) service_pool.cc:224] Handling call
0709 13:15:50.948295 (+ 34993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.954897 (+  6602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.955164 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.973482 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1937) took 2388 ms. Trace:
I20260709 13:15:50.997370 30881 rpcz_store.cc:276] 0709 13:15:48.584583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.883197 (+2298614us) service_pool.cc:224] Handling call
0709 13:15:50.944436 (+ 61239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.957467 (+ 13031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.957496 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.973143 (+ 15647us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:50.973192 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.973263 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.973405 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.979483 31604 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:50.998610 30882 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:50.962802  2271 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.964342  2303 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:50.921645  2301 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.965878 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:50.967563 31032 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:50.968220 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:50.970803 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.971297  2237 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.151s	user 0.008s	sys 0.009s
I20260709 13:15:50.991653 30875 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.011067 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 815) took 2185 ms. Trace:
I20260709 13:15:51.011402 30875 rpcz_store.cc:276] 0709 13:15:48.825833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.944222 (+2118389us) service_pool.cc:224] Handling call
0709 13:15:50.991476 (+ 47254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.010818 (+ 19342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.011010 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.961369  2290 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:51.000905 31025 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:50.908474  2255 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:50.979635 30998 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:51.010190 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:51.013665 31603 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:15:51.006023  2034 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:51.032243 30881 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:51.033274 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2408) took 1795 ms. Trace:
I20260709 13:15:51.033576 30881 rpcz_store.cc:276] 0709 13:15:49.238274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.998186 (+1759912us) service_pool.cc:224] Handling call
0709 13:15:51.032067 (+ 33881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.033047 (+   980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.033219 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.015406  2271 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:51.017556 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2409) took 1779 ms. Trace:
I20260709 13:15:51.018263 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 798) took 1328 ms. Trace:
I20260709 13:15:51.044397 30958 rpcz_store.cc:276] 0709 13:15:49.689610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.164302 (+474692us) service_pool.cc:224] Handling call
0709 13:15:50.164882 (+   580us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:50.633732 (+468850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.640682 (+  6950us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:50.660891 (+ 20209us) log.cc:844] Serialized 52 byte log entry
0709 13:15:50.791290 (+130399us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:50.791883 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.791964 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.018050 (+226086us) raft_consensus.cc:1685] finished
0709 13:15:51.018068 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.018200 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61952,"raft.queue_time_us":94962,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":124,"thread_start_us":494891,"threads_started":2,"wal-append.queue_time_us":340871}
W20260709 13:15:51.019702  2190 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.288s	user 0.013s	sys 0.007s
I20260709 13:15:51.020701 30874 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:15:51.009305 31029 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:51.049228 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 818) took 2152 ms. Trace:
I20260709 13:15:51.049651 30874 rpcz_store.cc:276] 0709 13:15:48.896739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.006189 (+2109450us) service_pool.cc:224] Handling call
0709 13:15:51.020416 (+ 14227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.048927 (+ 28511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.049163 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.022467 30954 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:50.916985  2293 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:15:51.032193 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.038470 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:51.030771 31603 pending_rounds.cc:85] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 7
I20260709 13:15:51.055917 31603 pending_rounds.cc:107] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:15:51.056197 31603 raft_consensus.cc:2889] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:51.043567 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64056.3us
I20260709 13:15:51.044204 30876 rpcz_store.cc:276] 0709 13:15:49.238586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.016538 (+1777952us) service_pool.cc:224] Handling call
0709 13:15:51.016971 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.017184 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.017206 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.017274 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:51.017310 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.017366 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.017474 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.052000 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.021099  2207 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:51.054919 30879 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.057441 30875 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:51.059008 31025 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:51.062856 31601 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:51.026938  2382 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:51.068511 31597 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.070760 31030 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:51.074122 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:51.075412 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.044137  2034 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:51.062675 30951 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.069375 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.082154 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.088683 30949 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:51.088852 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.089815 30875 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:51.090548 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2412) took 1823 ms. Trace:
I20260709 13:15:51.090874 30875 rpcz_store.cc:276] 0709 13:15:49.267333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.066369 (+1799036us) service_pool.cc:224] Handling call
0709 13:15:51.089584 (+ 23215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.090246 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.090468 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.092643  2334 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.000s
I20260709 13:15:51.092796  2316 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:51.093375  2316 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.093765  2316 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:51.098798 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:51.104082 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:51.058924  2207 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:51.071972  2253 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:15:51.105170 30875 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:51.112514  2304 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:51.113515 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.114851 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:51.085500  2034 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:51.116336 31030 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:15:51.118176 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:51.093384  2334 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:51.102047  1722 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:51.067533  2190 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.133127 30881 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:51.126289 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.133973 31601 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.136838 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:51.129009  2288 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.003s
W20260709 13:15:51.140239 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.141165 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:51.149300 30877 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:51.149677 31603 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:51.162616 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.164083 31030 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:51.169916 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:51.173135 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.148296  2216 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:15:51.211102 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 112444us
W20260709 13:15:51.213943 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.215359 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.216085 31029 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
W20260709 13:15:51.221630  2381 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:15:51.239989 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1135) took 1464 ms. Trace:
I20260709 13:15:51.242163 31024 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:51.244125 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.237709 30952 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:51.148991  2288 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.247231 30952 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:51.243822 31598 rpcz_store.cc:276] 0709 13:15:49.775299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.775970 (+   671us) service_pool.cc:224] Handling call
0709 13:15:49.776268 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.887280 (+1111012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.239617 (+352337us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540014f0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:51.239898 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436598528}
W20260709 13:15:51.245222 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 250717us
I20260709 13:15:51.272579 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:51.279202 30875 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:51.237797  1722 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:51.255105  2301 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:51.271066 30952 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.280678  2303 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:51.316526 30952 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:51.307121  2070 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.313433  1998 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.219975  2207 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:51.340167 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 245460us
I20260709 13:15:51.312409  1722 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:51.355815  2389 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:15:51.342887  2293 consensus_queue.cc:1243] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:51.392596 30875 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:51.393507 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1941) took 1774 ms. Trace:
I20260709 13:15:51.393946 30875 rpcz_store.cc:276] 0709 13:15:49.619415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.306432 (+1687017us) service_pool.cc:224] Handling call
0709 13:15:51.356496 (+ 50064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.393147 (+ 36651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.393427 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.376080  2364 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.749s	user 0.000s	sys 0.010s
W20260709 13:15:51.401978 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 135431us
I20260709 13:15:51.365876  2303 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:51.352938  2400 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:15:51.365532  2070 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.411434  2070 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:51.414523  2390 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:15:51.405722  2255 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:51.446987 31570 leader_election.cc:336] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.594s (SENT)
I20260709 13:15:51.425874  2395 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:15:51.365532  2216 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:51.430423 31571 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.952s (SENT)
I20260709 13:15:51.454593 31571 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:51.431219 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1042) took 1447 ms. Trace:
I20260709 13:15:51.345830  1998 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.441919 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:51.445690 31601 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
W20260709 13:15:51.448702 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.402470  2190 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:51.461238 31597 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.419553 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:51.465109 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45613.7us
I20260709 13:15:51.488266 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.489076 31605 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:51.490154 31603 raft_consensus.cc:2410] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:15:51.485949 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:51.461625  1484 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.707s	user 0.002s	sys 0.010s
I20260709 13:15:51.454236  2207 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.455222 31600 rpcz_store.cc:276] 0709 13:15:49.983611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.986850 (+  3239us) service_pool.cc:224] Handling call
0709 13:15:49.987548 (+   698us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:15:50.141662 (+154114us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:50.214933 (+ 73271us) log.cc:844] Serialized 14 byte log entry
0709 13:15:50.437405 (+222472us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:50.458945 (+ 21540us) log.cc:844] Serialized 52 byte log entry
0709 13:15:50.479018 (+ 20073us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:50.479061 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.479129 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.263513 (+784384us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:51.430873 (+167360us) raft_consensus.cc:1685] finished
0709 13:15:51.430988 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.431152 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16548,"prepare.queue_time_us":1231,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":15409,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":8068,"spinlock_wait_cycles":6732800,"thread_start_us":257933,"threads_started":2,"wal-append.queue_time_us":352924}
I20260709 13:15:51.539799 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:51.561318 31601 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:15:51.541342 31598 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:51.485940  2255 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:51.485978  2288 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:51.728711 31031 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:15:51.754712 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 498418us
W20260709 13:15:51.767445 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.770772 30957 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:15:51.774386 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1942) took 2132 ms. Trace:
I20260709 13:15:51.774981 30875 rpcz_store.cc:276] 0709 13:15:49.622310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.403250 (+1780940us) service_pool.cc:224] Handling call
0709 13:15:51.458144 (+ 54894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.754014 (+295870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.754059 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.754130 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:51.754185 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.754278 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.754466 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.784490 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.785437 31600 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:51.793660 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 363282us
I20260709 13:15:51.742071  2336 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:51.801348 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 392945us
I20260709 13:15:51.815311 30883 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:51.816417 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2417) took 2190 ms. Trace:
I20260709 13:15:51.816828 30883 rpcz_store.cc:276] 0709 13:15:49.626413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.754734 (+2128321us) service_pool.cc:224] Handling call
0709 13:15:51.815015 (+ 60281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.816050 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.816330 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.818320 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:51.824303 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:51.792954  2070 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.830569  2070 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.833424  2070 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:51.834301 30878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 819) took 2936 ms (client timeout 1547 ms). Trace:
W20260709 13:15:51.834872 30878 rpcz_store.cc:269] 0709 13:15:48.897673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.455553 (+557880us) service_pool.cc:224] Handling call
0709 13:15:51.770397 (+2314844us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540039c1d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:51.834184 (+ 63787us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486370176}
I20260709 13:15:51.836548 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.842125  1877 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:51.842664  1877 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:51.843936  2374 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:15:51.848896 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1150) took 1507 ms. Trace:
I20260709 13:15:51.843829 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 826) took 2306 ms. Trace:
I20260709 13:15:51.851310 30874 rpcz_store.cc:276] 0709 13:15:49.537955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.112157 (+1574202us) service_pool.cc:224] Handling call
0709 13:15:51.140855 (+ 28698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.162757 (+ 21902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.162789 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.243459 (+ 80670us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.387351 (+143892us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:51.723427 (+336076us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.723856 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.723996 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.843528 (+119532us) raft_consensus.cc:1685] finished
0709 13:15:51.843558 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.843734 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":398829,"raft.queue_time_us":60002,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":39564,"thread_start_us":349208,"threads_started":2,"wal-append.queue_time_us":451100}
I20260709 13:15:51.861409 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.849308 31604 rpcz_store.cc:276] 0709 13:15:50.341593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.343397 (+  1804us) service_pool.cc:224] Handling call
0709 13:15:50.343808 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.998864 (+655056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.848615 (+849751us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54006decd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:51.848813 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461419392}
I20260709 13:15:51.872794  1998 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:51.872606  1877 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:51.875274  1877 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:51.877024 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 828) took 1938 ms. Trace:
I20260709 13:15:51.877584 30876 rpcz_store.cc:276] 0709 13:15:49.938990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.875876 (+1936886us) service_pool.cc:224] Handling call
0709 13:15:51.876325 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.876601 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.876638 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.876697 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:51.876741 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.876814 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.876945 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.885735  1881 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:51.886346  1881 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:51.886679 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 675) took 1004 ms. Trace:
W20260709 13:15:51.897275 30880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 823) took 2392 ms (client timeout 1952 ms). Trace:
W20260709 13:15:51.897794 30880 rpcz_store.cc:269] 0709 13:15:49.505347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.616570 (+111223us) service_pool.cc:224] Handling call
0709 13:15:51.897017 (+2280447us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000a0fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:51.897197 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075134208}
I20260709 13:15:51.899194 30880 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.705538  2395 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 13:15:51.887655  1881 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.907945  1881 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.879592 30876 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:51.910386 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2419) took 1924 ms. Trace:
I20260709 13:15:51.910696 30876 rpcz_store.cc:276] 0709 13:15:49.986417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.878976 (+1892559us) service_pool.cc:224] Handling call
0709 13:15:51.879354 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.910122 (+ 30768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.910320 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.911222 31602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 1008) took 2218 ms (client timeout 2082 ms). Trace:
W20260709 13:15:51.911618 31602 rpcz_store.cc:269] 0709 13:15:49.692687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.692908 (+   221us) service_pool.cc:224] Handling call
0709 13:15:51.910966 (+2218058us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54006a4854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:51.911120 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640814976}
I20260709 13:15:51.912305  1722 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:51.912281 30876 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:51.915369  1839 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:51.916544 31596 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
W20260709 13:15:51.918156 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.915944  1839 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:51.918582 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.764312  2255 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:51.918857 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1138) took 2135 ms. Trace:
I20260709 13:15:51.919454 30958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54278
I20260709 13:15:51.919975 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.928128  2304 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:51.928551  2304 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:51.928614 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.929267 31597 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:51.919253 31596 rpcz_store.cc:276] 0709 13:15:49.783034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.802781 (+ 19747us) service_pool.cc:224] Handling call
0709 13:15:51.916239 (+2113458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.916998 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.918679 (+  1681us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54006a4850. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:51.918783 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4859430144}
I20260709 13:15:51.930552 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2420) took 1943 ms. Trace:
I20260709 13:15:51.930931 30880 rpcz_store.cc:276] 0709 13:15:49.986776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.898626 (+1911850us) service_pool.cc:224] Handling call
0709 13:15:51.899005 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.899594 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.930496 (+ 30902us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:51.918473 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 121984us
I20260709 13:15:51.914458 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2422) took 1589 ms. Trace:
W20260709 13:15:51.918988 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.921411 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.922116 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:51.932042 30876 rpcz_store.cc:276] 0709 13:15:50.325472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.911782 (+1586310us) service_pool.cc:224] Handling call
0709 13:15:51.912075 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.914215 (+  2140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.914385 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.920360 30958 raft_consensus.cc:606] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:15:51.887231 31026 rpcz_store.cc:276] 0709 13:15:50.881992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.909566 (+ 27574us) service_pool.cc:224] Handling call
0709 13:15:50.919544 (+  9978us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:50.956904 (+ 37360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.956936 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:50.966979 (+ 10043us) log.cc:844] Serialized 52 byte log entry
0709 13:15:51.147903 (+180924us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.162182 (+ 14279us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.302714 (+140532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.302798 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.886223 (+583425us) raft_consensus.cc:1685] finished
0709 13:15:51.886253 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.886459 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":432,"prepare.queue_time_us":154549,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":264848,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":15474,"thread_start_us":306852,"threads_started":2,"wal-append.queue_time_us":271349}
I20260709 13:15:51.932997 30958 raft_consensus.cc:614] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:51.923827 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:15:51.927613 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.926949  1855 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:51.940937 30952 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260709 13:15:51.920207  1839 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:51.867678 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.942318 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.943377 30875 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:51.946305 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:51.948923 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:51.949893 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:51.950125 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:51.951025 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:51.951329 30951 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:15:51.951833 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:51.952198 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.952446 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:51.952467 30954 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:51.953369 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:51.953899 30876 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.956087 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:51.958529 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 817) took 3132 ms. Trace:
I20260709 13:15:51.958930 30882 rpcz_store.cc:276] 0709 13:15:48.826363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.973966 (+2147603us) service_pool.cc:224] Handling call
0709 13:15:50.974361 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:50.999006 (+ 24645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.958245 (+959239us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5400436554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:51.958468 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55213952}
I20260709 13:15:51.960124 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.961241 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.962214 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.962724 31026 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:51.963182 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:51.964496  1839 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:51.966377 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.966540  1855 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:51.967361 30952 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:51.965444  1839 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.969552 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:51.940841  2396 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.963500 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:51.981252 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:51.983336 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.984643 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:51.985517 30874 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:51.976625 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:51.992926 31032 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.964s	user 0.011s	sys 0.000s
I20260709 13:15:52.001041 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:52.001559 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:52.002985 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:52.003484 30951 raft_consensus.cc:2368] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9.
I20260709 13:15:52.003924 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.006675 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:52.006814 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1936) took 3422 ms. Trace:
I20260709 13:15:51.994318  2396 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.008538 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:52.009219 30958 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:15:52.028265 30877 rpcz_store.cc:276] 0709 13:15:48.584302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.278416 (+1694114us) service_pool.cc:224] Handling call
0709 13:15:50.395026 (+116610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.149743 (+754717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.006592 (+856849us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54000d3ed4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:52.006757 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734198016}
W20260709 13:15:52.009405 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1706) took 2577 ms (client timeout 3335 ms). Trace:
I20260709 13:15:52.010043 30951 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:52.014537 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:52.029874 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:52.031001 30953 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:15:51.990271  2336 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:52.029626 30949 rpcz_store.cc:269] 0709 13:15:49.432362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.650195 (+217833us) service_pool.cc:224] Handling call
0709 13:15:52.009179 (+2358984us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002b6e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:52.009331 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973526400}
I20260709 13:15:52.001041 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.030483 30952 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:52.032722 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:52.033419 30877 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:52.032393 30882 raft_consensus.cc:2376] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9. Re-sending same reply.
I20260709 13:15:51.996212 31032 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:52.035045 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:51.977026  2366 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.980935  1998 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:52.038640 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:52.019317 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:52.039754 31026 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:15:52.035290 31024 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: [4.5-7.7]
I20260709 13:15:51.935480 31605 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:52.028375 30878 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.976653  1839 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.045852 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.046116 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:52.046486 30877 raft_consensus.cc:2376] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11. Re-sending same reply.
I20260709 13:15:52.046161 30953 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:52.047314 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:52.050069 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:52.050565 31030 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:51.970558  2297 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:15:52.047356 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.048624 31598 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.048952 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 679) took 1134 ms. Trace:
I20260709 13:15:52.048339 31031 raft_consensus.cc:2368] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:52.052390 31032 rpcz_store.cc:276] 0709 13:15:50.901439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.918265 (+ 16826us) service_pool.cc:224] Handling call
0709 13:15:52.035610 (+1117345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.055217 30877 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.057152 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:52.058161 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:52.059149 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:51.919508  2255 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.072826 31026 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.067101 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.078096 31031 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:52.087860 31597 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:15:52.048406  1998 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:52.088902 31027 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:52.090212 30882 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:52.054222  1839 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:52.103844 30876 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
W20260709 13:15:52.105528 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.116896 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.111424  2190 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.128180 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:52.125417  2076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.015s	sys 0.026s
W20260709 13:15:52.132369 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 82815.1us
W20260709 13:15:52.129765  2076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.015s	sys 0.026s
I20260709 13:15:52.080577  2366 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:52.146484 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.147535 30881 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.126740  1855 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.158097 30955 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.168696 30950 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
W20260709 13:15:52.153177  2034 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.021s	user 0.008s	sys 0.005s
I20260709 13:15:52.181504  2366 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:52.182220  2417 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:15:52.188660  2414 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:15:52.190821  2396 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.192162 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 683) took 1289 ms. Trace:
I20260709 13:15:52.192585 31025 rpcz_store.cc:276] 0709 13:15:50.902869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.074565 (+171696us) service_pool.cc:224] Handling call
0709 13:15:51.100216 (+ 25651us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:51.318519 (+218303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.318568 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:51.342728 (+ 24160us) log.cc:844] Serialized 52 byte log entry
0709 13:15:51.576358 (+233630us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:51.712646 (+136288us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.712904 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.713005 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.191854 (+478849us) raft_consensus.cc:1685] finished
0709 13:15:52.191877 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.192065 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14264,"prepare.queue_time_us":142785,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":7143,"raft.queue_time_us":246799,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":52736,"spinlock_wait_cycles":31192960,"thread_start_us":396183,"threads_started":2,"wal-append.queue_time_us":679057}
I20260709 13:15:52.194669  2297 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.195287  2297 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.196516 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1935) took 3612 ms. Trace:
I20260709 13:15:52.151160  1998 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.196916 30879 rpcz_store.cc:276] 0709 13:15:48.584030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.347643 (+1763613us) service_pool.cc:224] Handling call
0709 13:15:50.348077 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.062374 (+714297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.196262 (+1133888us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54003e26d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:52.196453 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606095616}
I20260709 13:15:52.197476  2297 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:52.198428 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.200491 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:52.202555 31600 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:52.205687 31597 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:52.215730 31026 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:52.225831 30878 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:52.227844 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:52.233856 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:52.235164 30877 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:52.236332 30874 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
W20260709 13:15:52.204578  2290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.056s	sys 0.068s
W20260709 13:15:52.239490  2290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.065s	sys 0.068s
I20260709 13:15:52.242213 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:52.242972 30956 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:52.249034 30874 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:52.250082 30877 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:15:52.204123  2316 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.110s	user 0.015s	sys 0.000s
I20260709 13:15:52.252624 30882 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:52.256657 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1952) took 1220 ms. Trace:
I20260709 13:15:52.257315 30877 rpcz_store.cc:276] 0709 13:15:51.030337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.246636 (+1216299us) service_pool.cc:224] Handling call
0709 13:15:52.247032 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.250683 (+  3651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.250921 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:52.267316 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.292379 30955 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:52.293123 30955 pending_rounds.cc:85] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:15:52.293481 30955 pending_rounds.cc:107] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:52.293834 30955 raft_consensus.cc:2889] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:52.306497 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.204244  2034 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:52.321103 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1951) took 1291 ms. Trace:
I20260709 13:15:52.321674 30879 rpcz_store.cc:276] 0709 13:15:51.029957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.245684 (+1215727us) service_pool.cc:224] Handling call
0709 13:15:52.257867 (+ 12183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.317554 (+ 59687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.317594 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.320686 (+  3092us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:52.320752 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.320833 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.321025 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:52.323273 30848 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8.
I20260709 13:15:52.323717 30848 leader_election.cc:403] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:52.324510  2184 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.324640 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 790) took 3494 ms. Trace:
I20260709 13:15:52.325145  2184 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.325307 30955 rpcz_store.cc:276] 0709 13:15:48.830616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.830745 (+   129us) service_pool.cc:224] Handling call
0709 13:15:48.831061 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.979136 (+1148075us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b180019f080. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac95646 00007f273abcf58e 00007f273ac50f9e 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:15:52.157342 (+2178206us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b580087f5d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:15:52.318299 (+160957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.324527 (+  6228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2987672576}
I20260709 13:15:52.334235  1950 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:52.334687  1950 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:52.335915 31023 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:52.336766 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 680) took 1435 ms. Trace:
I20260709 13:15:52.337170 31023 rpcz_store.cc:276] 0709 13:15:50.901768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.987354 (+ 85586us) service_pool.cc:224] Handling call
0709 13:15:52.335106 (+1347752us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:15:52.335403 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.336448 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.336689 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28881152}
I20260709 13:15:52.338752 30875 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:52.339159 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1939) took 2720 ms. Trace:
I20260709 13:15:52.339752 30881 rpcz_store.cc:276] 0709 13:15:49.618768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.151491 (+1532723us) service_pool.cc:224] Handling call
0709 13:15:51.253458 (+101967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.148009 (+894551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.338865 (+190856us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54002ab054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:52.339075 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055625600}
W20260709 13:15:52.342048 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.260099  2316 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:52.344049  2397 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:52.344898  2076 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.345593  2316 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:52.346024  2397 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:15:52.346391  2271 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:52.346783  2271 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:52.347185  2303 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:52.347549  2303 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:52.347635  2271 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.348450  2303 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.348919  2271 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.352128 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:52.353262 30996 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:52.355268  2207 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.000s
I20260709 13:15:52.324635 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:52.345417  2076 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:52.357527 30876 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:52.335604  1950 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.360632 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:52.362984 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 129913us
I20260709 13:15:52.366288 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:52.368674 30877 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:15:52.369921 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 412349us
I20260709 13:15:52.376689 30880 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:52.385989  1881 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:52.386099  1811 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:15:52.386624  1881 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.387023  1881 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:15:52.391861 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 432739us
W20260709 13:15:52.399907 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 418709us
I20260709 13:15:52.394692 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:52.362232  2415 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:15:52.413286 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 53128.7us
W20260709 13:15:52.417683 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 51490.1us
W20260709 13:15:52.418664 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.375020  2396 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:52.421446 30874 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:15:52.391283  2023 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:15:52.428386 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.425897  2190 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:52.428995 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.439088 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 79025us
I20260709 13:15:52.384811  2276 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:52.457317 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 366146us
I20260709 13:15:52.430262 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:52.431126 30881 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:52.389593  1484 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.423419 31598 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:52.440275 30997 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:52.443516  2076 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:52.444633  2422 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:15:52.445122 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:15:52.464928 30879 raft_consensus.cc:606] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.465361 30879 raft_consensus.cc:614] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.447731  2409 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:15:52.448604 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 200068us
I20260709 13:15:52.460529 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:52.412835  2112 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:15:52.426877  2336 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:15:52.483613 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:52.483739 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:52.431020  2237 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:15:52.485551 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 55368.8us
I20260709 13:15:52.453729  2190 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:52.486037  2253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.024s	sys 0.030s
I20260709 13:15:52.460471  2366 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.508550 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.536567 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.537140 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.507318  2190 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.468063  1881 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.464542  1484 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:52.516522  2034 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:52.466496  2402 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:15:52.500059  2425 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:52.500590  2409 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:52.500864  2023 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.525580 31025 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:15:52.534212 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:52.486549  2255 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.535907  2418 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:15:52.523490  2253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.024s	sys 0.030s
I20260709 13:15:52.459908  2226 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
W20260709 13:15:52.615984 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.616300 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:52.462934  2276 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.617036 30954 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.619241 30874 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:15:52.596740 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45417us
I20260709 13:15:52.593947  1811 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.601418  1881 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:52.604514  2423 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:15:52.610249 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 175691us
I20260709 13:15:52.611167  2418 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:52.613137  1484 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:52.613790  2400 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:15:52.614985  2253 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:52.621079 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 226476us
I20260709 13:15:52.549445  2425 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.631440 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:52.637630  1855 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:52.641673 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 677) took 1741 ms. Trace:
I20260709 13:15:52.644071  2304 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:52.653633  2292 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.658995 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:52.660156 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:52.672309 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.554363  2366 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.659498 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:52.672542 30955 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.672636 30950 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:15:52.679425 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:52.685672 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 54318.5us
I20260709 13:15:52.621610  2415 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:15:52.693192 31605 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:52.662249  2418 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:52.673506  1855 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.698302 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:52.698974 31602 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:52.671301  2425 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:15:52.694883 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 277915us
I20260709 13:15:52.670123 31028 rpcz_store.cc:276] 0709 13:15:50.900683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.983558 (+ 82875us) service_pool.cc:224] Handling call
0709 13:15:51.000136 (+ 16578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.074202 (+ 74066us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:51.288363 (+214161us) log.cc:844] Serialized 14 byte log entry
0709 13:15:51.516836 (+228473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:51.516924 (+    88us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:51.516987 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.641346 (+1124359us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400146c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:52.641419 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.641579 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4524,"prepare.queue_time_us":40531,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":33,"raft.queue_time_us":33936,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":46,"spinlock_wait_cycles":133054336,"thread_start_us":374326,"threads_started":3,"wal-append.queue_time_us":119218,"wal-append.run_cpu_time_us":1130,"wal-append.run_wall_time_us":1004080}
I20260709 13:15:52.669504  2396 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:52.706432 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:52.673965  2237 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:15:52.692165  1881 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:52.725088 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 57107.1us
I20260709 13:15:52.723454 30954 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:52.728510  2112 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:52.729128 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:15:52.729492  2112 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:52.729727 30879 raft_consensus.cc:606] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.729907  2112 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:52.730041 30955 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:52.728729  2276 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:52.730937  2112 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.732779  2112 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.739459  2366 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.740113  2366 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:52.740592  2366 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:52.741008  1855 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.741631  2366 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.699522  1484 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.730119 30879 raft_consensus.cc:614] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:52.751022 31602 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:52.740609  2184 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.756513 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:52.708072  2429 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.758807 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.691946  2271 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:15:52.756114  2304 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:52.775355 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 48485.2us
W20260709 13:15:52.777354 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52084.9us
I20260709 13:15:52.780318 31571 leader_election.cc:400] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:52.780689 31571 leader_election.cc:403] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:52.795395 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 48796us
I20260709 13:15:52.816375 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2423) took 2328 ms. Trace:
I20260709 13:15:52.817018 30878 rpcz_store.cc:276] 0709 13:15:50.487846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.231101 (+1743255us) service_pool.cc:224] Handling call
0709 13:15:52.254144 (+ 23043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.319362 (+ 65218us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:52.423239 (+103877us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.797536 (+374297us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.816007 (+ 18471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.816062 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:52.816110 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.816180 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.816309 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18211,"prepare.queue_time_us":101721,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":29337,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":188,"thread_start_us":323140,"threads_started":1}
I20260709 13:15:52.821481 30878 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:52.824831 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:52.827035  2023 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:52.836068  2396 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:52.845273 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 65142.1us
I20260709 13:15:52.778867  2382 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.848860 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:52.850183 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52562.5us
I20260709 13:15:52.851918 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:52.774955  2418 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.853119  2418 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.853812 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.854722  2433 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:52.855471  2433 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:52.856127  2034 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:52.856465  2433 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:52.855448 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.863401 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:52.710181  2409 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.872648 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:52.778035  2429 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.881855  1855 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:15:52.887411 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2591) took 1790 ms. Trace:
I20260709 13:15:52.849398  2432 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:52.779237  2253 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:52.893941 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47954.7us
I20260709 13:15:52.894801 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:52.878494  2382 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:15:52.879355 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 440741us
I20260709 13:15:52.874239  2237 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:15:52.889582 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 230145us
I20260709 13:15:52.877983  2316 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:52.895927 31571 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:52.887862 31024 rpcz_store.cc:276] 0709 13:15:51.096513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.272845 (+176332us) service_pool.cc:224] Handling call
0709 13:15:52.035032 (+762187us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:52.045612 (+ 10580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.887190 (+841578us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002d5350. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:52.887346 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677918592}
I20260709 13:15:52.881366  2034 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:15:52.897163 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:52.886934 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:52.915809 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:15:52.917289 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.913103 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:52.923655 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:52.898343  2316 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.928553 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:52.911556  2027 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:52.919221  2216 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.898043  2112 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:15:52.924033  2237 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:52.935984  2436 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:52.956204 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2428) took 1032 ms. Trace:
I20260709 13:15:52.956650 30880 rpcz_store.cc:276] 0709 13:15:51.923446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.955839 (+ 32393us) service_pool.cc:224] Handling call
0709 13:15:52.956002 (+1000163us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540043c454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:52.956143 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965108480}
I20260709 13:15:52.937011  2442 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:15:52.958076  2416 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:52.958556  2416 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:52.959894 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.960043 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:52.961995  2394 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:15:52.962987  2023 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:52.964430 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:52.930476  2316 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:52.969010 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.971560 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2429) took 1043 ms. Trace:
I20260709 13:15:52.971958 30876 rpcz_store.cc:276] 0709 13:15:51.928146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.227453 (+299307us) service_pool.cc:224] Handling call
0709 13:15:52.971359 (+743906us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540039add4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:52.971503 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275445632}
W20260709 13:15:52.939476  2434 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:15:52.940979  2034 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:52.974006  2034 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:52.974298  2303 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.974964  2034 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.980540 30881 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:52.931622  2070 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:52.933617  2432 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:52.935547  2276 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:52.987028  2276 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.987401  2276 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:52.990592  2425 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.992141  2070 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:52.951578  2190 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.993095  2070 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.994405  2190 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.959491  2416 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.996008  2432 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:52.996822  2416 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:52.997018  2432 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.935683  2297 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:15:53.001900  2129 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.002393  2129 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:53.005332  1998 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:52.942430  2429 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:52.982196 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:52.935243  2440 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:15:53.009577  2419 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.857s	user 0.004s	sys 0.000s
I20260709 13:15:53.009783  1881 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:52.946667 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.976094 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:53.010433  1881 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:52.948015  2216 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.011427  2255 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:52.984575  2207 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8.
I20260709 13:15:52.985828  1950 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:52.948762  2237 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:52.986285  2415 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:15:53.030422 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66071.9us
I20260709 13:15:53.031229 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:53.023872 31599 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:52.980278 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2425) took 1057 ms. Trace:
I20260709 13:15:53.012132 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2590) took 1915 ms. Trace:
W20260709 13:15:53.029512 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 155542us
I20260709 13:15:53.016587 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.032255 30778 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:15:53.061772 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.066817 31026 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:53.065861 30882 rpcz_store.cc:276] 0709 13:15:51.922741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.256405 (+333664us) service_pool.cc:224] Handling call
0709 13:15:52.311625 (+ 55220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.358215 (+ 46590us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:15:52.776494 (+418279us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.979425 (+202931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:52.979505 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:52.979579 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.980014 (+   435us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.980190 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120606,"prepare.queue_time_us":79940,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":53893,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":467602,"threads_started":2}
I20260709 13:15:53.068303 31602 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:15:53.026072  2255 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:53.071923 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:53.012770  2216 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:53.032467  2429 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.032485  2297 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:53.130477 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 59381.1us
I20260709 13:15:52.991644  2316 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:53.100114 30848 leader_election.cc:400] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:15:53.133059 30848 leader_election.cc:403] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:53.064298 31029 rpcz_store.cc:276] 0709 13:15:51.096253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.270589 (+174336us) service_pool.cc:224] Handling call
0709 13:15:51.305538 (+ 34949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.344815 (+ 39277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.344853 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.378740 (+ 33887us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.933855 (+555115us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:51.933906 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.933971 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.008950 (+1074979us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:53.011840 (+  2890us) raft_consensus.cc:1685] finished
0709 13:15:53.011865 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.012070 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1865,"raft.queue_time_us":99623,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"spinlock_wait_cycles":4273024,"thread_start_us":481404,"threads_started":1,"wal-append.queue_time_us":730020}
W20260709 13:15:53.109084 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.029733  1839 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:53.063885  2184 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:53.150717 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.075488  2336 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.060086  2442 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:53.133949 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.003316  2129 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:53.135085 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 211503us
I20260709 13:15:53.139353 30997 leader_election.cc:400] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:15:53.150216  2316 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.134343  2190 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.151996  2207 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
W20260709 13:15:53.151685 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 51820.3us
I20260709 13:15:53.147908  1839 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.160051  2184 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:53.054059  2425 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:53.026594  2366 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 13:15:53.054910  2027 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:53.075810  2440 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:53.011540  1881 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.072899  1811 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:53.140188  2255 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.075140  2394 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:15:53.180176  2442 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:53.256171 30778 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 7 to 8, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 8 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.177338  2023 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.180653 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:53.266201 31602 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:53.241217 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 102013us
I20260709 13:15:53.179888  2304 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.256246  2027 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:53.197757  2184 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:53.258244 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 345203us
I20260709 13:15:53.166828  2433 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:53.167263  2297 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.242575  2129 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.177695  2336 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:53.182544 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.181093 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.255004 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:53.314620 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.277261 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 380145us
W20260709 13:15:53.198271  2303 consensus_queue.cc:1175] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bda0856a7efd4d0e96615b66bef383c6" responder_term: 10 status { last_received { term: 10 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 7 } }
I20260709 13:15:53.256369  2440 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:53.373715 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.344734 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 89807.8us
I20260709 13:15:53.397220 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:53.270934  2415 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:53.267572  2304 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.398332  2396 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.397754 31602 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:53.344422 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:53.421834 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 489086us
I20260709 13:15:53.411028 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:53.271217  2425 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:53.436565 30953 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:53.458555 31597 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:53.346421  2455 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:53.459913 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 441299us
W20260709 13:15:53.462158 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.344998  2316 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:53.271525  2023 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.343897  2255 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:53.399078  2415 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:53.414666  2366 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.469386 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:53.472908  2451 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:15:53.475584  2448 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:15:53.476442  2445 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 13:15:53.476733  2449 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
W20260709 13:15:53.480199 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 66279.2us
I20260709 13:15:53.480362  2402 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:15:53.484417  2460 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 13:15:53.485445 31599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1048) took 2474 ms (client timeout 2077 ms). Trace:
I20260709 13:15:53.485663  2297 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.490291  2442 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.490932  2304 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:53.494933  1839 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:53.496002  2454 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:53.541528 31602 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:53.498392  2184 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.345935  2276 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:53.519687 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50376.2us
I20260709 13:15:53.514899 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:53.483563  2336 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:53.529456 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 218555us
W20260709 13:15:53.528764 31599 rpcz_store.cc:269] 0709 13:15:51.010764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.010891 (+   127us) service_pool.cc:224] Handling call
0709 13:15:53.485237 (+2474346us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400541354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:53.485354 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4484042496}
W20260709 13:15:53.531116 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.468912  2425 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:53.538686 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 78409.1us
I20260709 13:15:53.528965  2402 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:53.574605 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.515754  2366 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.524392  2027 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:53.590596  2459 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:15:53.592005  2425 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.500532  2455 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:53.579624 30997 connection.cc:256] RPC call timeout handler was delayed by -2.2300217169997723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3335s for a response
I20260709 13:15:53.587726 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:53.589056 31603 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:15:53.592092 31605 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:53.546795  2070 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:53.595700 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:53.582535  1950 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:15:53.603363 31598 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:53.604957 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.598603 31604 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:53.567142  1811 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:53.573381  2297 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.600587 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.609900 31601 raft_consensus.cc:2393] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:53.610512 31602 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:53.611245 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.611938 31025 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:53.613183 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.608946 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.621906 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.623155 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:53.586478  1881 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.594671  2336 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.578979  1998 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:15:53.628414 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:53.620783 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:53.540961  2440 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.652176 31599 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:53.655936 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.657109 30954 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:53.604480  2027 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.610805  2070 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.648707  2184 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:53.674737  2070 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.675916  2023 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:53.676410 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 60375.9us
I20260709 13:15:53.676923 31024 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:15:53.668540 31026 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:53.571973  2454 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:53.679495  1839 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.680110  2454 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.669656 30778 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 6 to 8, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 8 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.680269  1839 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:15:53.681485 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 270520us
I20260709 13:15:53.681581  1839 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:15:53.682132 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:53.682662  2034 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:53.683190  2034 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:53.683245 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:53.683890  2316 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:53.691005  2316 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:53.684405  2207 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:53.684257  2034 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:53.687269 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 175185us
I20260709 13:15:53.688301  2453 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:53.704407 31602 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:53.649103  2450 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:15:53.711472 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.727799 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:53.728570 31597 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:53.713946 31025 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
W20260709 13:15:53.720672 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.729568 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.729961 30922 connection.cc:256] RPC call timeout handler was delayed by -1.4232755450000241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 13:15:53.658412  2441 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:53.732535 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.741540 31026 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:53.648396  2473 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:53.735448 31600 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:15:53.738507  2452 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:15:53.739063 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.751137 30874 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:53.751291 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.739840 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 828) took 1063 ms. Trace:
I20260709 13:15:53.713584  2304 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:53.616333  2297 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.750063 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.751871 30956 rpcz_store.cc:276] 0709 13:15:52.676636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.697259 (+ 20623us) service_pool.cc:224] Handling call
0709 13:15:52.710035 (+ 12776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.908188 (+198153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.908226 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.927606 (+ 19380us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.191655 (+264049us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:53.191708 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.191818 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.739580 (+547762us) raft_consensus.cc:1685] finished
0709 13:15:53.739608 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.739758 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31496,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":62,"thread_start_us":385910,"threads_started":2,"wal-append.queue_time_us":335477}
I20260709 13:15:53.741032 30882 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:53.702983  2433 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.724623  2440 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:53.755731 30954 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:15:53.752619 30877 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:53.783139 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.784574 31025 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
W20260709 13:15:53.839730 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 160805us
I20260709 13:15:53.790477  2366 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:53.792692  2455 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:53.851008 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 302958us
W20260709 13:15:53.857877 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45799.6us
I20260709 13:15:53.727133  2207 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:53.740969  2441 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:53.788460  2276 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:53.803520 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:53.733207  2453 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:53.869740  2453 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.871548  2473 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:53.747915  2476 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:15:53.654253  1811 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.704418  1881 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:53.840512 31605 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:53.811813 31024 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:53.841790 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.934566 30876 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:53.810325  2304 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:53.670621  2336 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.593922  2415 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:53.855518 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:53.858163 31570 leader_election.cc:336] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.544s (SENT)
I20260709 13:15:53.856294 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:53.864096 30778 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.873476  2433 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:53.941320 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.942099 31024 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 6: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:53.874269 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.943019 30880 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:15:53.803540  2076 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.879438  2441 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.883402 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:53.884076 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.949219 30883 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:53.883104  2207 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.873005  1484 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.953153 31603 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:53.886539 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.887223 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.954456 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.955009 31030 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:53.892169 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:53.892534 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.893973 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1971) took 1026 ms. Trace:
I20260709 13:15:53.892870 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.896128 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:53.896903 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:53.892169 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:53.956781 30878 rpcz_store.cc:276] 0709 13:15:52.867227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.867487 (+   260us) service_pool.cc:224] Handling call
0709 13:15:52.879591 (+ 12104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.880011 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:52.880054 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.891383 (+ 11329us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.259556 (+368173us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:53.259598 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.259668 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.893751 (+634083us) raft_consensus.cc:1685] finished
0709 13:15:53.893773 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.893910 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6999,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6472,"thread_start_us":334619,"threads_started":1,"wal-append.queue_time_us":503714}
I20260709 13:15:53.957923 31031 raft_consensus.cc:2376] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11. Re-sending same reply.
I20260709 13:15:53.903944 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:53.626742  2402 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.910055 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 827) took 1234 ms. Trace:
I20260709 13:15:53.963029 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.961921 30957 rpcz_store.cc:276] 0709 13:15:52.676139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.676373 (+   234us) service_pool.cc:224] Handling call
0709 13:15:52.695313 (+ 18940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.905229 (+209916us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:53.400183 (+494954us) log.cc:844] Serialized 14 byte log entry
0709 13:15:53.908060 (+507877us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800138e80. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287
0709 13:15:53.908165 (+   105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.908656 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.908808 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:53.908843 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.908909 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:53.909797 (+   888us) raft_consensus.cc:1685] finished
0709 13:15:53.909883 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:53.910000 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79541,"prepare.queue_time_us":743603,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":236982,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":41109,"spinlock_wait_cycles":23967360,"thread_start_us":1045518,"threads_started":4,"wal-append.queue_time_us":213337}
W20260709 13:15:53.910254 30848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.502s (SENT) [suppressed 27 similar messages]
W20260709 13:15:53.918392  2469 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:15:53.920672  2478 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:53.919992 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 61171.5us
W20260709 13:15:53.927893 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44932.6us
I20260709 13:15:53.749760  2454 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:15:53.847223 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.032088 31025 raft_consensus.cc:2376] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8. Re-sending same reply.
I20260709 13:15:54.033138 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.034192 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:53.857081  2461 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
W20260709 13:15:53.937119 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 231568us
I20260709 13:15:53.937270 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.946159 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:53.950677 30778 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 8 to 9, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 9 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.867549  2112 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
W20260709 13:15:53.905100 30779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 351) took 15717 ms (client timeout 15000 ms). Trace:
I20260709 13:15:54.043023 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:53.960165 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:53.963362 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 105245us
I20260709 13:15:54.043877 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.044202 31024 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 6: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:53.956310 31028 raft_consensus.cc:2376] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9. Re-sending same reply.
I20260709 13:15:53.953055 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:54.045617 30880 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:15:54.046106 30878 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:53.964040 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:54.028743 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.933403  2396 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:15:53.945225  2462 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:54.068086 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:53.933766  1855 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:15:54.074596 30877 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:54.042635 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.056257 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:54.061183 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 97209.9us
W20260709 13:15:54.063265 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.040664 31605 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:54.070595  2478 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:53.947367  2471 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:15:54.068764 31028 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:54.078184 30924 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:15:54.091948 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.092454 30778 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 6 to 11, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.092772 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:54.092118 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 525945us
I20260709 13:15:54.101837 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:54.104765 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:54.104334 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 67226us
I20260709 13:15:54.105264 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.105572 31605 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:54.105876 31032 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:54.106277 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:54.108870 31597 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:53.950846  2076 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:54.110934 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.092506 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:54.111013 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.112962 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.118002 31028 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:54.111155 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:54.120298 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.120625 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.120919 31024 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:54.119668 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:54.075445  2442 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:53.953073  2433 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.118602 31031 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:15:54.124940  2418 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:15:54.126044  2076 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:54.054840  2394 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:15:54.083238  2480 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:15:54.126595 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.149338 31028 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:54.114264  2455 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:15:54.127687  2468 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:15:54.121517  2237 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:54.164573 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.121243 31023 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:54.076279  2402 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:54.068195  2462 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:54.147226 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46712.5us
I20260709 13:15:54.154506 30778 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 9, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 9 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.964568  1484 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.158573 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:54.163101 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.165508 31028 raft_consensus.cc:2410] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:54.069607  2190 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 13:15:54.167387 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.174153 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.179328 31031 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:15:54.176863 30877 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:54.178177 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.196288 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.095826  2476 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:15:54.129756  2484 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.156132  2027 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:54.208299 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.208671 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:54.209435 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.210003 31028 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:54.211591 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:54.212031 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 97810us
W20260709 13:15:54.213676 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 107493us
I20260709 13:15:54.129386  2395 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:15:54.221544 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101963us
I20260709 13:15:54.216882 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:54.222165 31032 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
W20260709 13:15:54.218278 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 65201us
I20260709 13:15:54.223515 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1963) took 1834 ms. Trace:
I20260709 13:15:54.223945 30875 rpcz_store.cc:276] 0709 13:15:52.388851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.400873 (+ 12022us) service_pool.cc:224] Handling call
0709 13:15:52.430164 (+ 29291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:52.454077 (+ 23913us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:52.506091 (+ 52014us) log.cc:844] Serialized 14 byte log entry
0709 13:15:52.960373 (+454282us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b18002258e0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:15:53.253331 (+292958us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.254390 (+  1059us) log.cc:844] Serialized 26 byte log entry
0709 13:15:53.254569 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:53.254615 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:53.254710 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.206932 (+952222us) raft_consensus.cc:1685] finished
0709 13:15:54.223314 (+ 16382us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.223452 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7408,"prepare.queue_time_us":46562,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":18432,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":9034,"spinlock_wait_cycles":22460672,"thread_start_us":292605,"threads_started":1,"wal-append.queue_time_us":793746}
I20260709 13:15:54.226068 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:54.226632 30875 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:54.227434 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:54.229226 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:54.229914 31027 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:54.230420 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:54.218878  2442 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:54.239009 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:54.215131  2255 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.720s	user 0.003s	sys 0.007s
I20260709 13:15:54.148010  2316 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:15:54.245493 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:54.043394 30779 rpcz_store.cc:269] 0709 13:15:38.187794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.188156 (+   362us) service_pool.cc:224] Handling call
0709 13:15:39.337596 (+1149440us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b5400002490. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b360b2 00007f2740aafa89 00007f2740a47da6 00007f2740a19088 00007f2740b1737e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc
0709 13:15:53.904862 (+14567266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.815746 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:49.091829 (+276083us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:49.095282 (+  3453us) write_op.cc:435] Acquired schema lock
0709 13:15:49.097438 (+  2156us) tablet.cc:662] Decoding operations
0709 13:15:49.515332 (+417894us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:49.515402 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:49.515434 (+    32us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:15:49.549074 (+ 33640us) tablet.cc:701] Row locks acquired
0709 13:15:49.549096 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:15:49.549289 (+   193us) write_op.cc:270] Start()
0709 13:15:49.549411 (+   122us) write_op.cc:276] Timestamp: P: 1783602949549235 usec, L: 0
0709 13:15:49.549445 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:15:49.550191 (+   746us) log.cc:844] Serialized 7780 byte log entry
0709 13:15:49.870356 (+320165us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.888581 (+ 18225us) write_op.cc:301] APPLY: starting
0709 13:15:49.888664 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.890049 (+  1385us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.890169 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.891290 (+  1121us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.891499 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=40
0709 13:15:49.891530 (+    31us) write_op.cc:312] APPLY: finished
0709 13:15:50.082787 (+191257us) log.cc:844] Serialized 139 byte log entry
0709 13:15:50.101970 (+ 19183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.102569 (+   599us) write_op.cc:454] Released schema lock
0709 13:15:50.102745 (+   176us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:50.103523 (+   778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:50.103554 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142720,"reported_tablets":43,"spinlock_wait_cycles":11740928,"child_traces":[["op",{"apply.queue_time_us":17959,"apply.run_cpu_time_us":5801,"apply.run_wall_time_us":214814,"num_ops":20,"prepare.queue_time_us":495230,"prepare.run_cpu_time_us":33028,"prepare.run_wall_time_us":908657,"raft.queue_time_us":98281,"raft.run_cpu_time_us":9230,"raft.run_wall_time_us":22120,"replication_time_us":320735,"thread_start_us":491485,"threads_started":4,"wal-append.queue_time_us":199964,"wal-append.run_cpu_time_us":17258,"wal-append.run_wall_time_us":1352813}]]}
I20260709 13:15:54.258912 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:54.258986 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.263819 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:54.267912 31029 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:54.213290  2027 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:54.263586 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:54.273042 30875 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:54.177549  2237 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:54.323487 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64665.2us
I20260709 13:15:54.332406 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:54.243634  2442 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:54.338523 31024 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:15:54.346652  2366 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:54.275447 31027 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
W20260709 13:15:54.278548  2498 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:15:54.279397  1998 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.280912 30877 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:15:54.281306  2466 log.cc:927] Time spent T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:15:54.270190  2297 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:54.288241  2027 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:54.284880  2336 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:54.285913  2472 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:54.258093  1881 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:54.148379  2304 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.220700  2467 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:54.282814  2023 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.238945  2471 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:15:54.357664 30880 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:15:54.342144 30778 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:54.366291 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 456026us
I20260709 13:15:54.368919 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:54.328502  2112 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:54.217199  2484 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.348062  2292 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:54.395750 30778 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 6, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 6 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.351414  2394 raft_consensus.cc:2764] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:54.409968 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.415181 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.403038 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.418388 30954 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:15:54.423475 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 273054us
I20260709 13:15:54.358860  2473 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:15:54.429116 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.376408  1811 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:54.387941  2472 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:54.398545  2292 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:54.437850 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 221721us
I20260709 13:15:54.443277 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:54.444160 30954 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.394408  2478 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:54.448976 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.380038  1998 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.478909 30954 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:54.480242 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:54.340325  2462 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:54.482738 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.483386 30957 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 4.
I20260709 13:15:54.399494  2297 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:15:54.391971  2023 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.437340  2494 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:54.433538  2112 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:54.446061  2292 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:54.488404 30778 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 6, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 6 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.500594 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:54.501592  2489 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:15:54.502632 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:54.445194  2255 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:54.509392 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 168597us
I20260709 13:15:54.520974 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:54.511533 30954 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:54.550966 30953 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:54.556147 30953 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:54.550024 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:54.556216 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 83474us
I20260709 13:15:54.557178 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:54.484987  2433 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:54.551980  2482 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:54.514005  2303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.006s	sys 0.013s
I20260709 13:15:54.570029 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:54.571652 30957 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8. Ops: []
W20260709 13:15:54.573001 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52131.8us
I20260709 13:15:54.583202 30778 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 6, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 6 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.584049 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:54.494652  2494 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:54.510833  2463 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.305s
W20260709 13:15:54.577618  2485 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:15:54.624318 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:54.581341  2303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.008s	sys 0.013s
I20260709 13:15:54.592170 30949 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:54.636613 31027 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:54.578406  2482 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.645224 31024 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:54.646561 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:54.468220  2442 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:54.655532 30950 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:15:54.658912  2482 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:54.586525  2473 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:54.624383  2496 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:15:54.581633  2433 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.663160  2486 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:15:54.663614  2487 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
W20260709 13:15:54.664546  2491 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:15:54.664842  2502 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:15:54.665333 30778 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.665861  2076 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:15:54.644436  2237 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:54.667855  2494 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:54.669111  2492 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
W20260709 13:15:54.670761  2129 consensus_meta.cc:287] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.354s	user 0.009s	sys 0.000s
I20260709 13:15:54.580782  2255 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:54.757982 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 173080us
W20260709 13:15:54.666738  2497 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:15:54.577453  2112 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:54.590164  2472 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:54.855628 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.959599 31028 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.000s
I20260709 13:15:55.012811 31028 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:15:55.013314 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.981103 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 358350us
I20260709 13:15:54.939366 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1066) took 1332 ms. Trace:
I20260709 13:15:54.924476 31596 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:15:54.936617 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 355557us
I20260709 13:15:54.973289 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:55.014562 31598 rpcz_store.cc:276] 0709 13:15:53.607210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.609177 (+  1967us) service_pool.cc:224] Handling call
0709 13:15:53.609540 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.629342 (+ 19802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.629385 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.629925 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.048713 (+418788us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:54.048762 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.048825 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.939137 (+890312us) raft_consensus.cc:1685] finished
0709 13:15:54.939155 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.939305 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47180,"raft.queue_time_us":19467,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":126,"thread_start_us":322174,"threads_started":1,"wal-append.queue_time_us":741502}
W20260709 13:15:54.969945 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.875519  2433 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:54.829704 31599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.005s
W20260709 13:15:54.829591 30878 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.005s
I20260709 13:15:55.038532 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:55.039269 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:54.972879 30874 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:15:54.978840 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 855) took 1097 ms. Trace:
I20260709 13:15:54.751545  2454 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.014149 31028 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:54.752091  2034 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.347s
I20260709 13:15:55.136487 30778 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:55.138396 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.138861 31599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.010s	sys 0.014s
W20260709 13:15:54.829351  2207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.000s	sys 0.011s
W20260709 13:15:55.139974 30878 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.005s	sys 0.019s
W20260709 13:15:55.140658 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 126127us
I20260709 13:15:55.171692 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2080) took 1095 ms. Trace:
I20260709 13:15:55.172290 31028 rpcz_store.cc:276] 0709 13:15:54.042060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.013605 (+971545us) service_pool.cc:224] Handling call
0709 13:15:55.013975 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.137154 (+123179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.137358 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:55.173995 31025 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:54.931414  2494 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:55.179725 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 140543us
I20260709 13:15:55.181025 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:55.180796 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2076) took 1139 ms. Trace:
I20260709 13:15:54.923424  2501 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:54.922376  2481 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:55.172475 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:55.181872 31024 rpcz_store.cc:276] 0709 13:15:54.041049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.653845 (+612796us) service_pool.cc:224] Handling call
0709 13:15:54.654165 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.174181 (+520016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.174212 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.180054 (+  5842us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:55.180192 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.180339 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.180613 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":383358}
I20260709 13:15:54.973268  2396 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:54.924798  2023 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:55.174609 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 136188us
I20260709 13:15:54.921002  2484 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:55.185803 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47860.2us
I20260709 13:15:55.187409 31028 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:55.210587 30923 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:55.139910 30882 rpcz_store.cc:276] 0709 13:15:53.881554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.954244 (+ 72690us) service_pool.cc:224] Handling call
0709 13:15:54.029167 (+ 74923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.029541 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.029596 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.030183 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.220173 (+189990us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:54.220242 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.220344 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.978580 (+758236us) raft_consensus.cc:1685] finished
0709 13:15:54.978604 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.978766 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":26692,"spinlock_wait_cycles":35584,"thread_start_us":106869,"threads_started":1,"wal-append.queue_time_us":417887}
I20260709 13:15:55.006386  2395 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.919018  2512 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:55.224678  2512 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.225106  2512 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.215272 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:55.211998 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:55.222622 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2071) took 1182 ms. Trace:
I20260709 13:15:55.232661 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:15:55.168788  2207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.007s	sys 0.018s
I20260709 13:15:55.227181 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:55.234850 30875 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:54.965142  2292 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.236373 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:54.930331  2523 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.283s
I20260709 13:15:55.174968  2524 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.226794 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:55.233174 31027 rpcz_store.cc:276] 0709 13:15:54.039788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.650537 (+610749us) service_pool.cc:224] Handling call
0709 13:15:54.650904 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.206443 (+555539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.206495 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.221784 (+ 15289us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:55.221935 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.222137 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.222536 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545571,"raft.queue_time_us":545823,"spinlock_wait_cycles":24670592}
I20260709 13:15:55.245216  2207 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:55.245591  2490 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.204685  2501 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:55.214419  2396 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:55.251199 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 832) took 1933 ms. Trace:
I20260709 13:15:55.258843 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:55.214658  2366 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:15:55.233033  2440 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.428s	user 0.012s	sys 0.000s
I20260709 13:15:55.279405 30949 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:15:55.215517  2506 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:55.171303  2454 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:55.206722  2481 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:55.223186  2473 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:55.322606 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:54.918134  2482 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.300565 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.286347 30958 rpcz_store.cc:276] 0709 13:15:53.317390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.390806 (+ 73416us) service_pool.cc:224] Handling call
0709 13:15:53.436495 (+ 45689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.694437 (+257942us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:53.694466 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.844054 (+149588us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b2c00046bc8. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:15:53.927011 (+ 82957us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.032153 (+105142us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:54.032196 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.220877 (+188681us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002904d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:54.220927 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.250974 (+1030047us) raft_consensus.cc:1685] finished
0709 13:15:55.250991 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.251139 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131692,"raft.queue_time_us":178906,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":37850,"spinlock_wait_cycles":454264448,"thread_start_us":84499,"threads_started":1,"wal-append.queue_time_us":350479}
I20260709 13:15:55.300490 30949 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:55.308429 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 138740us
I20260709 13:15:55.278177  1811 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:55.313475 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 58449.4us
I20260709 13:15:55.299829  1855 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:15:55.280421  1998 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:55.271076  2207 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:55.353332 30953 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:15:55.324218 30997 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.544s (SENT)
I20260709 13:15:55.353427 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.354729 30954 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:55.326596 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.337493 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:55.292091  2520 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:15:55.355733 30956 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:55.303164  2366 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:55.347702 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:55.338650 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.361258 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:55.354135 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:55.292443  2490 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:55.322007  2484 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:55.373134 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 714) took 1483 ms. Trace:
I20260709 13:15:55.372628  2501 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.373483  2484 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.374209  2501 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.374914  2545 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:55.320636  2506 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.378124  2506 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:55.378288  2526 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.380142  2255 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:55.353961  1855 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:55.381619  1855 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:15:55.382930 31596 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:15:55.383276  2547 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.232697  2395 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.324128  2468 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.359221 30949 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:55.365681  2517 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:15:55.368906  2505 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:55.369364  2528 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:55.369640  2511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.006s	sys 0.005s
I20260709 13:15:55.396826 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:55.369480  1484 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:55.301430  2524 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.364061  2440 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:15:55.370683  2522 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:15:55.321981  2473 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:55.364283  1811 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:55.372766  2531 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:15:55.375499  2545 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.367100 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:55.360670  2207 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:55.370527  2523 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:55.387859  2454 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:55.389070  2514 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.725s	user 0.001s	sys 0.000s
I20260709 13:15:55.389353 30956 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:55.389483  2430 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:55.389979 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.384902 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:55.361023  2303 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.398432 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.373679 31031 rpcz_store.cc:276] 0709 13:15:53.890061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.328059 (+437998us) service_pool.cc:224] Handling call
0709 13:15:54.346663 (+ 18604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.347038 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.347068 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.347583 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.558032 (+210449us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:54.558070 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.558142 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.372900 (+814758us) raft_consensus.cc:1685] finished
0709 13:15:55.372922 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.373068 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10821,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15038,"thread_start_us":208166,"threads_started":1,"wal-append.queue_time_us":580259}
W20260709 13:15:55.369410  2525 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:15:55.399365 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:55.463876  2027 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.075s	user 0.010s	sys 0.003s
I20260709 13:15:55.367398  1998 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:55.455936  2506 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.370375  2490 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:55.401784 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:55.403406 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:55.404179  1484 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:55.372553  2495 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:55.406332 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 690) took 1812 ms (client timeout 1544 ms). Trace:
W20260709 13:15:55.643638 31029 rpcz_store.cc:269] 0709 13:15:53.593482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.593598 (+   116us) service_pool.cc:224] Handling call
0709 13:15:55.406107 (+1812509us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54003791d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:55.406240 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503832960}
I20260709 13:15:55.406847 31032 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:15:55.369519  2518 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:15:55.400285  2402 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.221s	user 0.009s	sys 0.004s
W20260709 13:15:55.399686  2511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.007s	sys 0.005s
W20260709 13:15:55.447084 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.399864  2505 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.416496  2473 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:55.474694 30955 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:55.443645  1950 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.475817  2433 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:55.722221  2433 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:55.722921  2433 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.723749  2532 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:55.480026 30954 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:55.455212  2523 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:55.325769  2336 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:15:55.754699 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.673398  2292 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:55.593360 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:55.779707 30956 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:55.395208  2468 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:55.596748 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.454062  2484 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:55.669342 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.669986 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:55.786851 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1028) took 1348 ms. Trace:
I20260709 13:15:55.787293 30958 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:55.399011  2396 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.407610  2528 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.715902  2505 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:55.680559 30952 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:55.676533 31026 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:15:55.483270  2430 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:55.592862  1998 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:55.899564  1998 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:55.723079  2544 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.227s
I20260709 13:15:55.364321  2366 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:55.725513 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:55.908051 30954 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:55.480429  2303 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:55.590570 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 196594us
I20260709 13:15:55.767810 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 859) took 1885 ms. Trace:
I20260709 13:15:55.913573 30876 rpcz_store.cc:276] 0709 13:15:53.882679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.035727 (+153048us) service_pool.cc:224] Handling call
0709 13:15:54.057348 (+ 21621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.211465 (+154117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.211494 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.211539 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:54.211576 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.767444 (+1555868us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000d4dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:55.767515 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.767707 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4183,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":20139,"spinlock_wait_cycles":353597184}
I20260709 13:15:55.673048  1484 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.775484 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.755870  1950 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.782521  2551 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:55.594928  2027 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.708333  2511 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:55.801532 30950 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:55.926862 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.927511 30950 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:55.927567 30954 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:15:55.724660  2482 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:55.708567  2402 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.976958 30950 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:55.808599 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 483403us
I20260709 13:15:55.787436 31597 rpcz_store.cc:276] 0709 13:15:54.438603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.438725 (+   122us) service_pool.cc:224] Handling call
0709 13:15:54.439061 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.449494 (+ 10433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.449540 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.473945 (+ 24405us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.690291 (+216346us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:54.690351 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.690448 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:55.786552 (+1096104us) raft_consensus.cc:1685] finished
0709 13:15:55.786582 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.786773 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4291,"raft.queue_time_us":132914,"spinlock_wait_cycles":9708288,"thread_start_us":133303,"threads_started":1,"wal-append.queue_time_us":720180}
I20260709 13:15:55.826390 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 719) took 1383 ms. Trace:
W20260709 13:15:55.676949 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 309904us
I20260709 13:15:55.844165 30956 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:15:55.978437 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:55.979317 30950 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:55.754928  2523 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.915249 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:55.891479  2518 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.915261  2537 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:15:55.929131 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 527449us
I20260709 13:15:55.930609 30958 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
W20260709 13:15:55.919287 30874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.004s
I20260709 13:15:55.910512  2253 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.992367  2253 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.978127 31024 rpcz_store.cc:276] 0709 13:15:54.442679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.207832 (+765153us) service_pool.cc:224] Handling call
0709 13:15:55.217370 (+  9538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.217578 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:55.217862 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.825967 (+608105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.826045 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:55.826114 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.826198 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.826328 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8367,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":37533,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":604436,"threads_started":2,"wal-append.queue_time_us":245230}
I20260709 13:15:55.891709  2395 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:55.987735 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:55.996011 31604 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: []
W20260709 13:15:55.998776 30874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.004s
W20260709 13:15:55.987576  2530 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:15:56.108019 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:56.118671 30955 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:55.997947  2271 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:55.988490  2512 consensus_meta.cc:287] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.757s	user 0.005s	sys 0.006s
I20260709 13:15:56.110872 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:55.993960  2539 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.579s	user 0.000s	sys 0.001s
I20260709 13:15:56.113497 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:56.168682 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:56.169561 30882 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:56.170763 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:56.090556 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 339114us
I20260709 13:15:55.988592  2402 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:55.986155  2433 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:56.123656 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:56.120736 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:56.184033 31024 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
W20260709 13:15:56.178920  2543 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
W20260709 13:15:56.179490 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.095747  2524 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:56.191067 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:56.182848 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.179001 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:56.189078 30923 connection.cc:256] RPC call timeout handler was delayed by -2.338500139999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:15:56.190065 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.121934  2490 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:56.219354 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:56.219683 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.220685 30882 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:56.194478 31031 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:15:56.220964 31029 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
W20260709 13:15:56.233084 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 122315us
I20260709 13:15:56.234160 31570 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:56.169898  2547 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.223250 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:56.227049 31024 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:56.227062 30955 raft_consensus.cc:2376] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10. Re-sending same reply.
I20260709 13:15:56.176271  1811 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:56.235632 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:56.239650 31027 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
W20260709 13:15:56.232026 30923 connection.cc:256] RPC call timeout handler was delayed by -1.9844074860002365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:15:56.240842 30923 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.546s (SENT)
I20260709 13:15:56.242048 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:56.247201 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1983) took 1277 ms. Trace:
I20260709 13:15:56.247810 30879 rpcz_store.cc:276] 0709 13:15:54.969627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.970511 (+   884us) service_pool.cc:224] Handling call
0709 13:15:54.970863 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.971200 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.971226 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.971700 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.131003 (+159303us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:55.131044 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.131124 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.246871 (+1115747us) raft_consensus.cc:1685] finished
0709 13:15:56.246907 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.247118 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":158889,"threads_started":1,"wal-append.queue_time_us":365273}
I20260709 13:15:56.272974 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:56.275465 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1071) took 2174 ms. Trace:
W20260709 13:15:56.238516  2538 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.489s	user 0.000s	sys 0.001s
I20260709 13:15:56.276057 31599 rpcz_store.cc:276] 0709 13:15:54.101036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.101135 (+    99us) service_pool.cc:224] Handling call
0709 13:15:54.120704 (+ 19569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.186454 (+ 65750us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:54.186499 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.202532 (+ 16033us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.142517 (+939985us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:55.142772 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.142861 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:56.275169 (+1132308us) raft_consensus.cc:1685] finished
0709 13:15:56.275198 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:56.275380 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49687,"raft.queue_time_us":65941,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11020,"thread_start_us":854759,"threads_started":1,"wal-append.queue_time_us":1024693}
I20260709 13:15:56.273818 30882 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:55.997608  2518 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:56.280836 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45298.6us
I20260709 13:15:55.997406  2551 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:56.177000  2271 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.290774 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:56.237401  2472 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.174317  2512 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.236016  2545 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:56.232263  2537 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:56.243805  2336 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:56.308372  2482 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:56.311715 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:56.305970 31570 leader_election.cc:336] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.536s (SENT)
I20260709 13:15:56.312476 30882 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:56.312510 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:56.247983  2506 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:56.289451  2453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.008s	sys 0.020s
I20260709 13:15:56.285727  2546 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.248817  2560 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:56.315559 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:56.296741  2555 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:56.358278 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 117446us
I20260709 13:15:56.294854  2433 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:15:56.325274  2482 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:15:56.344148  2453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.009s	sys 0.020s
I20260709 13:15:56.309352  2303 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:56.247174  2490 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.095439  2430 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.375600  2551 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:56.376492  2528 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:56.336298  2545 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:15:56.248692  2547 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.421540  2547 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:56.421949  2207 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.002s
I20260709 13:15:56.417472  2548 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.252s
W20260709 13:15:56.418771  2563 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:15:56.419675  2512 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:56.314611  2472 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:56.377296  2184 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:15:56.470664 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 169522us
W20260709 13:15:56.396309  2526 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.017s	user 0.008s	sys 0.004s
I20260709 13:15:56.513664  2526 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.393652  2482 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:56.338093  2506 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.393942  2511 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:56.423683  2027 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:56.473384  2561 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
I20260709 13:15:56.472999  2453 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:56.506217 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:56.422418  2207 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:56.605974 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 99835.2us
I20260709 13:15:56.608763 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:56.370667  2555 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:56.610069  2207 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:56.610836  2528 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:56.611470  2528 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:56.506242  2501 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.131s	user 0.009s	sys 0.004s
W20260709 13:15:56.502683  2366 consensus_meta.cc:287] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.001s
I20260709 13:15:56.493099  2537 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:56.641914 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.853940 30956 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.002s	sys 0.030s
W20260709 13:15:56.994199 30956 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.002s	sys 0.037s
I20260709 13:15:56.994021  2271 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:56.817811  2561 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:15:56.636519 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 296753us
I20260709 13:15:56.999779 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:56.499683  2494 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.313s	user 0.001s	sys 0.008s
W20260709 13:15:56.988055  2473 consensus_meta.cc:287] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.232s	user 0.006s	sys 0.006s
W20260709 13:15:56.864218  1998 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.964s	user 0.012s	sys 0.000s
I20260709 13:15:56.532178  1484 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:57.002849  1855 consensus_meta.cc:287] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.621s	user 0.020s	sys 0.002s
I20260709 13:15:56.610811  2555 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:56.999593  2528 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:56.711370  2402 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:56.605477  2453 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:56.998040  1950 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.067958 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1033) took 1671 ms. Trace:
I20260709 13:15:56.835861  2490 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:57.101091  2523 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.085s	user 0.005s	sys 0.007s
I20260709 13:15:57.101627  2523 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:57.037974 30876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.001s	sys 0.018s
W20260709 13:15:57.103031 30876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.005s	sys 0.021s
I20260709 13:15:57.076081 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:57.078145 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 867) took 1692 ms. Trace:
I20260709 13:15:57.104959 30874 rpcz_store.cc:276] 0709 13:15:55.385957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.386118 (+   161us) service_pool.cc:224] Handling call
0709 13:15:55.400987 (+ 14869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.411670 (+ 10683us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:55.411700 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.412274 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.003280 (+591006us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:56.003337 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.003430 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.077953 (+1074523us) raft_consensus.cc:1685] finished
0709 13:15:57.077969 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.078086 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312084,"raft.queue_time_us":224019,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":29702,"thread_start_us":586956,"threads_started":1,"wal-append.queue_time_us":774791}
I20260709 13:15:57.018927  2366 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.089901 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.079445  2027 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:15:57.078785  2207 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:57.095279 31596 rpcz_store.cc:276] 0709 13:15:55.396204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.396468 (+   264us) service_pool.cc:224] Handling call
0709 13:15:55.410356 (+ 13888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.521071 (+1110715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.521118 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.521175 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:56.521220 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.067590 (+546370us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54006702d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:57.067651 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.067876 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":887,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":80177,"spinlock_wait_cycles":2553400064}
I20260709 13:15:57.125236 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.113655 30950 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:57.101152  2441 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:57.119246 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.123090 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1989) took 1009 ms. Trace:
I20260709 13:15:57.079262  2473 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.125936 30882 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.095503  2572 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.133855 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56745.1us
I20260709 13:15:57.130847 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.080807  1998 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.134183 30876 rpcz_store.cc:276] 0709 13:15:56.113667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.187438 (+ 73771us) service_pool.cc:224] Handling call
0709 13:15:56.231460 (+ 44022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.231755 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:56.501717 (+269962us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.122601 (+620884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.122682 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:57.122744 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.122844 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.123010 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":793035,"prepare.run_cpu_time_us":2379,"prepare.run_wall_time_us":12865,"raft.queue_time_us":21108,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5473,"thread_start_us":830421,"threads_started":2}
I20260709 13:15:57.143584 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.118731  2511 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:57.125425  2207 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:57.139997 30874 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:57.150751  2505 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.232s	user 0.005s	sys 0.006s
I20260709 13:15:57.151731 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.090148  1855 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.156721 30950 raft_consensus.cc:2376] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13. Re-sending same reply.
I20260709 13:15:57.144802  2572 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.169919  2505 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.172019 30958 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:57.171525  2572 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.173426  2505 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.155380  2207 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.184446 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.186685 30950 raft_consensus.cc:2376] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10. Re-sending same reply.
I20260709 13:15:57.189473 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.168437  2034 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.193274 30950 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:15:57.179538 30874 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:57.152392  2453 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:57.210022  2453 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:15:57.201423  2562 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.965s	user 0.011s	sys 0.001s
W20260709 13:15:57.203398 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.213666 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.204551  1998 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.205214 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.206756  1855 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:57.207435  2554 log.cc:927] Time spent T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.026s	user 0.006s	sys 0.009s
I20260709 13:15:57.208096  2415 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:57.208781  2528 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:57.215163 30876 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:15:57.215402 30882 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:15:57.222139 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.214579  2034 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.228339  2034 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.228945  2528 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.230121  2366 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.230568 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.229743 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.231837 30874 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:57.231879 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.230144 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 866) took 2016 ms. Trace:
I20260709 13:15:57.233527 30875 rpcz_store.cc:276] 0709 13:15:55.213788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.236961 (+ 23173us) service_pool.cc:224] Handling call
0709 13:15:55.237499 (+   538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.238504 (+  1005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.238532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.280993 (+ 42461us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.759484 (+478491us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:55.759538 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.759621 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.206860 (+1447239us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:57.229846 (+ 22986us) raft_consensus.cc:1685] finished
0709 13:15:57.229869 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.230083 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5411,"raft.queue_time_us":73903,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6382,"spinlock_wait_cycles":7528320,"thread_start_us":433771,"threads_started":1,"wal-append.queue_time_us":697362}
I20260709 13:15:57.239511 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 843) took 3529 ms. Trace:
I20260709 13:15:57.239987 30881 rpcz_store.cc:276] 0709 13:15:53.710256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.711869 (+  1613us) service_pool.cc:224] Handling call
0709 13:15:53.733757 (+ 21888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:53.757445 (+ 23688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:53.757482 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:53.809791 (+ 52309us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.048342 (+238551us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:54.048413 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.048541 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:54.668405 (+619864us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:57.238673 (+2570268us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b240013a948. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f27379f39c4 00007f27379f1acb 00007f2737bacdc9 00007f2737baca55 00007f2737babfb0 00007f273a822488 00007f273a822be8 00007f273a7fa398 00007f273a7f576a 00007f273a7f4bb6
0709 13:15:57.239246 (+   573us) raft_consensus.cc:1685] finished
0709 13:15:57.239278 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.239418 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25325568,"thread_start_us":171527,"threads_started":1,"wal-append.queue_time_us":300428}
I20260709 13:15:57.249187 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:57.253461  2482 consensus_meta.cc:287] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
I20260709 13:15:57.253937  2482 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.256136  2482 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.256681 30951 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:57.250363  2523 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.265264  2473 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.256681  2482 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.267982 31030 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:57.269001  2023 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.269444  2023 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:57.241909  2528 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:57.281477 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1027) took 3067 ms. Trace:
I20260709 13:15:57.281893 31603 rpcz_store.cc:276] 0709 13:15:54.213875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.214023 (+   148us) service_pool.cc:224] Handling call
0709 13:15:54.239328 (+ 25305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.412085 (+172757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.412128 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.412756 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.830001 (+417245us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:54.830058 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.278448 (+2448390us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54006a54d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:57.278524 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.278586 (+    62us) raft_consensus.cc:1685] finished
0709 13:15:57.278603 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.281412 (+  2809us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56400,"raft.queue_time_us":89408,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":15710,"spinlock_wait_cycles":353312512,"thread_start_us":416906,"threads_started":1,"wal-append.queue_time_us":716348,"wal-append.run_cpu_time_us":31233,"wal-append.run_wall_time_us":1563915}
I20260709 13:15:57.278856  2482 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.278867  2207 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.294608  1950 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.295241  1950 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.336786 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:15:57.298522 31026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 697) took 3512 ms (client timeout 1536 ms). Trace:
W20260709 13:15:57.305188 30997 connection.cc:256] RPC call timeout handler was delayed by -1.2865884350001124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:15:57.340359 31026 rpcz_store.cc:269] 0709 13:15:53.786313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.803525 (+ 17212us) service_pool.cc:224] Handling call
0709 13:15:57.298197 (+3494672us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540007c454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:57.298381 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3996894592}
W20260709 13:15:57.341434 30997 connection.cc:256] RPC call timeout handler was delayed by -1.2590767980000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30160000000000003s for a response
I20260709 13:15:57.346016 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:57.346900 31029 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:57.348963  2023 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:57.349654  2482 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.351807 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:57.354704  2253 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.355975  2482 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.357496 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:57.359498 30998 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.360702 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:57.360986 30998 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.361406 31026 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:57.362602 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.363181 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 851) took 1057 ms. Trace:
I20260709 13:15:57.363507 30950 rpcz_store.cc:276] 0709 13:15:56.305658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.343987 (+1038329us) service_pool.cc:224] Handling call
0709 13:15:57.363134 (+ 19147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:57.343637  2490 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.295799  2207 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.343878  2589 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.368824  2541 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.351s	user 0.015s	sys 0.017s
I20260709 13:15:57.371304  2472 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.365832 31602 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:15:57.372087 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:57.372766  2536 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.462s	user 0.004s	sys 0.019s
I20260709 13:15:57.364733  2402 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.373693  2402 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.374161  2402 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.373790  2490 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:57.374392  2549 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.475s	user 0.031s	sys 0.063s
I20260709 13:15:57.367221  2589 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.376127  2490 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.376798  1950 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:57.377385 30848 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.502s (SENT)
I20260709 13:15:57.378194  2589 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:57.381130 30848 leader_election.cc:336] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.541s (SENT)
I20260709 13:15:57.381609 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:57.384452  2297 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:57.384796  2027 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.364846  2253 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.385022  2297 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.385696  2253 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.385344  2027 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.386070  2253 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.387609 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.388324 30950 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:15:57.388841 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 849) took 1083 ms. Trace:
I20260709 13:15:57.389130 30950 rpcz_store.cc:276] 0709 13:15:56.304987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.387281 (+1082294us) service_pool.cc:224] Handling call
0709 13:15:57.388788 (+  1507us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:57.389503 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.391963  2027 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:57.387704 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.393219  2297 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:57.394793 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.393862  2478 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.394929 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1749) took 2058 ms. Trace:
I20260709 13:15:57.364833 30998 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.295884  2415 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:57.396948 30848 leader_election.cc:336] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.581s (SENT)
I20260709 13:15:57.390019 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.400068 30951 rpcz_store.cc:276] 0709 13:15:55.336431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.338286 (+  1855us) service_pool.cc:224] Handling call
0709 13:15:57.394725 (+2056439us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54001946d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:57.394873 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4360605056}
I20260709 13:15:57.400461 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:57.398880 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:57.404407 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.405314 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.395555  2023 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.407090 30951 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:57.407827 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.408309 30951 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.408684 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.409395 30877 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:57.410562 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.410622 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:57.410903 30997 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.506s (SENT)
I20260709 13:15:57.411053 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.411410 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:57.388159  2207 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.411599 30877 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:57.412601  1950 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:57.412420 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:57.420879 30997 leader_election.cc:336] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.640s (SENT)
W20260709 13:15:57.414114  2503 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 3.136s	user 0.016s	sys 0.015s
I20260709 13:15:57.416178 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.426048 30881 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:15:57.411803  2297 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:57.430102  2297 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.430685  2509 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 2.768s	user 0.003s	sys 0.009s
I20260709 13:15:57.430514  2297 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.434623  2253 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.435101 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 856) took 3553 ms. Trace:
I20260709 13:15:57.435734  2402 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:57.436507 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 713) took 3546 ms. Trace:
I20260709 13:15:57.418444  2394 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:57.436896 31023 rpcz_store.cc:276] 0709 13:15:53.889819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.285268 (+395449us) service_pool.cc:224] Handling call
0709 13:15:54.285653 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.286052 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:54.286348 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.519574 (+233226us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.520241 (+   667us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.579642 (+ 59401us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.579830 (+   188us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:54.580060 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.977977 (+397917us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b18003ffca0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:54.978196 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.978390 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.430158 (+2451768us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:57.436228 (+  6070us) raft_consensus.cc:1685] finished
0709 13:15:57.436256 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.436413 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159659,"prepare.queue_time_us":54134,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":130,"raft.queue_time_us":436778,"raft.run_cpu_time_us":584,"raft.run_wall_time_us":50154,"spinlock_wait_cycles":34264832,"thread_start_us":232502,"threads_started":2,"wal-append.queue_time_us":293844}
I20260709 13:15:57.438581  2394 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.439018  2394 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.439304 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:57.443740  2402 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:57.448427 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51509.3us
W20260709 13:15:57.448925 30848 leader_election.cc:336] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.631s (SENT)
I20260709 13:15:57.404028  2478 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.416772  2023 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:57.453233 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.409511  2415 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.427383 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.281956  2528 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.448570 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.450073 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.421589 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.435472 30883 rpcz_store.cc:276] 0709 13:15:53.881838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.954713 (+ 72875us) service_pool.cc:224] Handling call
0709 13:15:54.030745 (+ 76032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.031004 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.031039 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:54.074866 (+ 43827us) log.cc:844] Serialized 26 byte log entry
0709 13:15:54.179314 (+104448us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:54.179357 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.179416 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.413513 (+3234097us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:57.434780 (+ 21267us) raft_consensus.cc:1685] finished
0709 13:15:57.434808 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.435037 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102792704,"thread_start_us":22831,"threads_started":1,"wal-append.queue_time_us":136699}
I20260709 13:15:57.423470  2473 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:57.453994 31605 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:57.411580  2589 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:57.458946 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.460928 31596 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:57.460445 31597 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:57.460520 31598 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:57.470402 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.470700 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:57.471112 30877 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.464469  2253 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.466251 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1979) took 3350 ms. Trace:
I20260709 13:15:57.466538 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.473816 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:57.430624  2397 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.474980 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.480152 31029 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:15:57.480690 30950 raft_consensus.cc:2376] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11. Re-sending same reply.
I20260709 13:15:57.480877 30951 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:57.473989 30881 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:57.467067  2402 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:15:57.479599 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.467942  2524 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:57.479813 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.488592 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:57.489316 31023 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.488607 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:15:57.491037 30848 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.659s (SENT)
I20260709 13:15:57.491518 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:57.491573 30951 raft_consensus.cc:2376] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11. Re-sending same reply.
I20260709 13:15:57.473729  1950 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:57.493453 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.495601 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.498307 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.499822 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.500548 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1185) took 2800 ms. Trace:
I20260709 13:15:57.501061 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:15:57.500978 31604 rpcz_store.cc:276] 0709 13:15:54.700483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.700720 (+   237us) service_pool.cc:224] Handling call
0709 13:15:54.818848 (+118128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.996887 (+1178039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.500297 (+1503410us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540069e954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:57.500481 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706594176}
I20260709 13:15:57.480425  2397 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.490284  2402 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.510751 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.512670 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1072) took 3411 ms. Trace:
I20260709 13:15:57.513250 31604 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:57.515097 30877 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
W20260709 13:15:57.520424 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.522615  2237 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.517788 30998 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.514688 31600 rpcz_store.cc:276] 0709 13:15:54.101314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.102596 (+  1282us) service_pool.cc:224] Handling call
0709 13:15:54.102882 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.103079 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:54.108650 (+  5571us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.350689 (+242039us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800153dc0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:15:54.876508 (+525819us) log.cc:844] Serialized 14 byte log entry
0709 13:15:54.888558 (+ 12050us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.434497 (+2545939us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b1800153dc0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:15:57.511549 (+ 77052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.511599 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:57.511641 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.511706 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.512611 (+   905us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9280,"prepare.queue_time_us":86874,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":132,"raft.queue_time_us":520556,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"spinlock_wait_cycles":287412480,"thread_start_us":545613,"threads_started":3,"wal-append.queue_time_us":515953}
I20260709 13:15:57.533231 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.533890 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.534166 31603 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:57.538573  2416 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:57.539213  2416 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:57.493168  1950 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.474625  2473 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.483426  2297 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.493633  2524 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.540251 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:57.643100 30950 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:57.643854 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 847) took 1339 ms. Trace:
I20260709 13:15:57.644228 30950 rpcz_store.cc:276] 0709 13:15:56.304310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.502210 (+1197900us) service_pool.cc:224] Handling call
0709 13:15:57.642921 (+140711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.643574 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.643796 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:57.643750 30848 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.671s (SENT)
I20260709 13:15:57.545019 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.647356  1950 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:57.648660 30848 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.686s (SENT)
I20260709 13:15:57.649399 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.662451 30880 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:15:57.540773  2416 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.502916  2316 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:57.652027 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:57.663197 30848 leader_election.cc:336] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.732s (SENT)
I20260709 13:15:57.663432 31600 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:15:57.652846 30951 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:15:57.664179 30848 leader_election.cc:336] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.761s (SENT)
I20260709 13:15:57.664469 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 848) took 1359 ms. Trace:
I20260709 13:15:57.664801 30951 rpcz_store.cc:276] 0709 13:15:56.304675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.518614 (+1213939us) service_pool.cc:224] Handling call
0709 13:15:57.644847 (+126233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.664207 (+ 19360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.664415 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:57.653609 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.511976  2397 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.672297 30951 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:15:57.630546  2521 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.651s	user 0.012s	sys 0.023s
I20260709 13:15:57.525236  2402 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:57.674877  2521 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.013s	sys 0.026s
W20260709 13:15:57.673555 30848 leader_election.cc:336] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.797s (SENT)
I20260709 13:15:57.573941  2482 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:57.543709  2506 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:57.678614 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.675894 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:57.653244  2462 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.575457  2023 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:57.678216 30998 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.660799  2478 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.685838  2207 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.693542 31599 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:15:57.696460 30848 leader_election.cc:336] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.851s (SENT)
I20260709 13:15:57.579224  2394 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:57.705103  2600 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:15:57.725253  1881 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:15:57.756224 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 59827.8us
W20260709 13:15:57.761863 30848 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.971s (SENT)
W20260709 13:15:57.763134 30848 leader_election.cc:336] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.056s (SENT)
I20260709 13:15:57.763796 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:57.754967  1881 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.787367 31023 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:15:57.792689  1881 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.768137  2207 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:57.810667  2468 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.811138  2473 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.816604  2394 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.817561  2528 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.818397 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.818995 30880 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.819432  2481 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.820457  2481 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.828567 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:57.830940 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:57.829734 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.832592  2528 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:57.832976  2528 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:57.833326  2528 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.837631 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:57.838450  2551 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:57.838306 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.838634 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.838910  2551 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.839291  2551 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.839658 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.840934 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.842034 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.842546 31603 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.839732 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.844259 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:57.855981  2455 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.846881 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:57.862668  2415 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.862862  2528 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.888628  2237 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:15:57.889096  2237 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.890249  2528 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:57.848762  1881 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:57.865702 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.891600 30996 connection.cc:256] RPC call timeout handler was delayed by -1.2319242429998667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:15:57.892167 30996 connection.cc:256] RPC call timeout handler was delayed by -1.0641660339999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 13:15:57.892323  1881 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:57.892647 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 1991) took 1725 ms. Trace:
I20260709 13:15:57.893314  1881 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.892987 30879 rpcz_store.cc:276] 0709 13:15:56.166868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.280732 (+113864us) service_pool.cc:224] Handling call
0709 13:15:56.307104 (+ 26372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.337832 (+ 30728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.337862 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:56.337901 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:56.337931 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.892426 (+1554495us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54001257d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:57.892474 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.892592 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70147968}
I20260709 13:15:57.893949  1881 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.894433 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:15:57.855144 31025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2599) took 3963 ms (client timeout 1928 ms). Trace:
W20260709 13:15:57.895649 31025 rpcz_store.cc:269] 0709 13:15:53.891261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.033984 (+142723us) service_pool.cc:224] Handling call
0709 13:15:57.854912 (+3820928us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540007ce54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:57.855056 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326471936}
I20260709 13:15:57.844470 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.897372 30877 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:57.849459  2559 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.560s	user 0.007s	sys 0.005s
W20260709 13:15:57.848062 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.876744 31603 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:15:57.905817 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.906646 31603 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:15:57.907070 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.876890 31027 raft_consensus.cc:2376] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7. Re-sending same reply.
I20260709 13:15:57.908533 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:57.909536 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.877614  2455 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:57.918650 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.918785 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.919478 31600 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:15:57.878961 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.879904  2548 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:57.876327  2558 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.880143  2597 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:57.880942 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:15:57.881738  2396 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.882696 30883 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:15:57.931841 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52294.4us
I20260709 13:15:57.883889 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.933540 30882 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.884829 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:57.884949 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2131) took 1647 ms. Trace:
I20260709 13:15:57.934330 30958 rpcz_store.cc:276] 0709 13:15:56.237122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.237612 (+   490us) service_pool.cc:224] Handling call
0709 13:15:56.237905 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.172428 (+934523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.884729 (+712301us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54001e0854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:57.884892 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2147791104}
I20260709 13:15:57.885710 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 711) took 3996 ms. Trace:
I20260709 13:15:57.935499 31032 rpcz_store.cc:276] 0709 13:15:53.889277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.246024 (+356747us) service_pool.cc:224] Handling call
0709 13:15:55.406540 (+1160516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:55.645090 (+238550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.885536 (+2240446us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003791d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:57.885653 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667704704}
I20260709 13:15:57.936007 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:15:57.895294  2255 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.894527 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.902958 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 850) took 1597 ms. Trace:
I20260709 13:15:57.912762 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:57.913632 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:57.945394 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.945787 31603 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:57.916465 30951 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:57.923627 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 53174us
I20260709 13:15:57.942560 30879 raft_consensus.cc:2410] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:15:57.924465 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.947537 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.947834 31023 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:15:57.761520  2464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.368s	user 0.007s	sys 0.031s
W20260709 13:15:57.912497  2519 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 3.094s	user 0.004s	sys 0.009s
I20260709 13:15:57.930112 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.887598  2551 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:57.956192 30880 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:15:57.978507 30881 raft_consensus.cc:2368] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:15:57.941215 30953 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:15:57.952083 30882 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:15:57.979806 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.942373 30950 rpcz_store.cc:276] 0709 13:15:56.305302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.660927 (+1355625us) service_pool.cc:224] Handling call
0709 13:15:57.661247 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.661455 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:57.679330 (+ 17875us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.902531 (+223201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.902603 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:57.902659 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.902744 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.902890 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22775,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":120,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":222706,"threads_started":1}
I20260709 13:15:57.980038 30998 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:57.940186  2511 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:57.963735 31600 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:57.968041 31023 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 7.
I20260709 13:15:57.969033 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:57.981370 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 721) took 3538 ms. Trace:
I20260709 13:15:57.923928  2481 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:57.963182  2415 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:57.963572  2255 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:57.972841 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:58.056705 30883 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:57.931999  2480 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:57.963307  2494 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:57.976696 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:57.923231  2418 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:15:57.954720 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 189069us
I20260709 13:15:57.981359 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:57.972913  2490 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:15:57.982213 31603 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:57.964429  2597 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:57.924217  2394 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:15:57.982476 31028 rpcz_store.cc:276] 0709 13:15:54.443171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.223836 (+780665us) service_pool.cc:224] Handling call
0709 13:15:55.224179 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.321574 (+ 97395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.321607 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.336711 (+ 15104us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.758900 (+422189us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:55.758952 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.759045 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.848903 (+2089858us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:57.981101 (+132198us) raft_consensus.cc:1685] finished
0709 13:15:57.981120 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.981297 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77783,"raft.queue_time_us":85253,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":12322,"spinlock_wait_cycles":35732864,"thread_start_us":374764,"threads_started":1,"wal-append.queue_time_us":804138}
I20260709 13:15:58.049072 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:57.981668  2316 raft_consensus.cc:2764] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:15:57.967542  1950 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:57.963425  2464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.575s	user 0.007s	sys 0.031s
I20260709 13:15:57.945060  2558 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.035950  2253 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:58.063105 30882 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:58.034615 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.078042 31023 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:57.965679  2548 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:58.067276 30848 leader_election.cc:336] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.216s (SENT)
I20260709 13:15:58.081303 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:58.075647 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.079454 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.062793  2494 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:58.074533  2604 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:15:58.085711 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:58.086380 31603 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:15:58.086453 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.087689 30883 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:15:58.084440 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.089676  2253 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:58.094099 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.094907 31600 raft_consensus.cc:2376] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10. Re-sending same reply.
W20260709 13:15:58.099417 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 140287us
I20260709 13:15:58.100116 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.102339 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:58.055476  2481 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:58.109958 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47249.1us
W20260709 13:15:58.110694 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.106774 31032 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.107901 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:58.104292 31031 raft_consensus.cc:2393] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:58.111442 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.113294 31023 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:58.109447 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:58.116087 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.116933 31603 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:15:58.120312 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:58.121922 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:58.122824 31603 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:58.129436  1881 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.129581  2478 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:58.112058  2471 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.131664  2471 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.132074  2471 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.133356 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.135087 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.136154  2253 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.119060 30996 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.141860 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.065472  2480 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.092747  2494 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.150981 31023 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:15:58.173250 31603 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:15:58.182219 31032 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:58.096710  2528 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:15:58.184736  2481 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:58.185035  2607 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:15:58.186556 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.183723 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.187150 31603 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:15:58.187394 30954 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:58.187947 31023 raft_consensus.cc:2368] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:15:58.188380 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.188963 31603 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:58.189941 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.191638 30922 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:58.171237  1881 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.118252  2418 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:58.149151  1484 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:15:58.194021 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.194626 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.195212 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.170873  2500 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:15:58.189710  2397 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.002s
I20260709 13:15:58.180130  2511 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:15:58.192876  2606 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:15:58.149708  2207 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:15:58.149554  2433 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:15:58.198796 31605 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:15:58.201193 31603 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:15:58.203686 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.204846  2255 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:58.206904  2237 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.207679  2442 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.203375  1484 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:58.196548  1881 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.207978  2471 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.183429  2597 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.198046  2462 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:15:58.214246 31023 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:15:58.209681  2402 consensus_meta.cc:287] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.002s
I20260709 13:15:58.221102 31605 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:58.201134  2551 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.224920 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:58.226195 31605 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:58.217968  2500 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:58.228722 31600 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:58.222554  2576 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.220351  1881 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.218538  2481 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:15:58.233558 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.202342  2397 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.223704  2462 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:58.224416  2476 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:15:58.237689  2617 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:15:58.227986  2478 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:15:58.246317 31596 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:58.234757  2576 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.229409  2402 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.239238  2462 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.254492 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.255070 31023 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:58.256037 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1032) took 2874 ms. Trace:
I20260709 13:15:58.256582 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.256379 31602 rpcz_store.cc:276] 0709 13:15:55.381944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.382079 (+   135us) service_pool.cc:224] Handling call
0709 13:15:55.382450 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.372658 (+1990208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.255770 (+883112us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54005bf254. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:58.255980 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4560600832}
I20260709 13:15:58.258605 31023 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:58.260268 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.237534  2255 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:15:58.242990  2548 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.265766 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.266944 31023 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.261859  2506 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:58.270969  2506 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:58.271858  2506 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.273253  2550 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.273577  2501 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:58.266429  2471 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.273773  2550 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.274166  2501 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.274919  2476 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:15:58.276482  2237 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:58.277262 31023 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:15:58.278167 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.274778 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:58.278824 31023 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:15:58.279003  2524 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.279961 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2127) took 2374 ms. Trace:
I20260709 13:15:58.280174 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.280355 30954 rpcz_store.cc:276] 0709 13:15:55.905234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.928483 (+ 23249us) service_pool.cc:224] Handling call
0709 13:15:55.928727 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.187930 (+2259203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.279734 (+ 91804us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b5400194bd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:58.279912 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5193637632}
I20260709 13:15:58.280964  2402 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.273062  2506 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:57.473095 30878 rpcz_store.cc:276] 0709 13:15:54.116141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.116338 (+   197us) service_pool.cc:224] Handling call
0709 13:15:54.145875 (+ 29537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.146077 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:15:55.169213 (+1023136us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.368298 (+2199085us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:57.465635 (+ 97337us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18000552a0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a
0709 13:15:57.465903 (+   268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.465952 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:15:57.465996 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.466082 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.466191 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1258474,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":7207,"spinlock_wait_cycles":25650944,"thread_start_us":1225193,"threads_started":2,"wal-append.queue_time_us":753822}
I20260709 13:15:58.281656 31027 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:15:58.254104  2620 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.174s	user 0.002s	sys 0.001s
I20260709 13:15:58.249773  2433 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.287708 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.288105 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.288375 31023 raft_consensus.cc:2376] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10. Re-sending same reply.
I20260709 13:15:58.289260 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.289680 31023 raft_consensus.cc:2376] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13. Re-sending same reply.
I20260709 13:15:58.290385 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.291263 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:58.260061  2615 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:15:58.293283 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.283994 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:58.258325  2473 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:15:58.294411 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.294628 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:58.295687 31023 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 4.
I20260709 13:15:58.299060 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.299506 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.299993 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.300151 31023 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:58.300944 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:58.303125 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.304796 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:58.306248  2501 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.306797  2501 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:58.306998  2518 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.307299  2501 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:58.308017 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.308568  2396 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.308653 31602 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:58.309449  2551 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:58.310144  2551 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:58.310389 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:58.311300  2518 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.311929  2518 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.312361  2518 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.317123 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.317729 31029 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.323966 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.325647 30949 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.325845 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:58.323983 30997 leader_election.cc:336] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 3.335s (SENT)
I20260709 13:15:58.326974 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:15:58.328460  2255 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:58.330847  1998 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:15:58.331439  1998 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:15:58.301080  2207 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:58.298210  2524 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.295414  2473 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:15:58.335789 30848 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.725s (SENT)
I20260709 13:15:58.295454  2397 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:58.254333  1484 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.352487  2494 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.353971 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.355218 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.355352  2494 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.357538 30923 leader_election.cc:400] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:15:58.342726 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.343668 30956 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:58.345367  2473 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:58.364986 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2114) took 2976 ms (client timeout 2202 ms). Trace:
I20260709 13:15:58.347586  1998 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.264106  2500 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.348091  2471 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:15:58.351231 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 844) took 2049 ms. Trace:
I20260709 13:15:58.353008  2455 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.239748  2511 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.359011 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:58.362280 31028 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
W20260709 13:15:58.364691 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.365479 30952 rpcz_store.cc:269] 0709 13:15:55.388503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.390696 (+  2193us) service_pool.cc:224] Handling call
0709 13:15:58.364783 (+2974087us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b54002b6e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:58.364914 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108139392}
I20260709 13:15:58.366374 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:15:58.369277 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.369994 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.308151  2501 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.297710  2433 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.371645 30955 rpcz_store.cc:276] 0709 13:15:56.301830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.302021 (+   191us) service_pool.cc:224] Handling call
0709 13:15:56.302491 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.617636 (+315145us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:56.892171 (+274535us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.222625 (+330454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.222670 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:57.222716 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.350997 (+1128281us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400256f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:58.351041 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.351172 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":570461,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":48,"raft.queue_time_us":76,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5971,"spinlock_wait_cycles":724094848,"thread_start_us":603715,"threads_started":2,"wal-append.queue_time_us":386331,"wal-append.run_cpu_time_us":1229,"wal-append.run_wall_time_us":1012730}
I20260709 13:15:58.311339  2551 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.375809 31023 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:15:58.381289 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.382251 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.343183  2524 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:58.383955  2524 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.378579 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:15:58.372210 30949 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:15:58.389074 30949 pending_rounds.cc:85] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:15:58.389324 30949 pending_rounds.cc:107] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:15:58.389585 30949 raft_consensus.cc:2889] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:58.382907 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.389683 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:15:58.391254 30848 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.775s (SENT)
I20260709 13:15:58.391754 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:58.393033 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:15:58.393772  2442 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.395605 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.394170  2552 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.396379 31028 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:58.395752  2478 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.395678  2442 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.399096  2478 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.399204  2442 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.399497  2478 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.401269 31029 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:58.402371  2570 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.402916  2570 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:58.404006  2493 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:15:58.404167 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1746) took 3172 ms. Trace:
I20260709 13:15:58.405908 31029 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:15:58.406589 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 730) took 1060 ms. Trace:
I20260709 13:15:58.404600 30949 rpcz_store.cc:276] 0709 13:15:55.232298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.232553 (+   255us) service_pool.cc:224] Handling call
0709 13:15:55.279241 (+ 46688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.325233 (+3045992us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b580050dbd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:15:58.395342 (+ 70109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.404104 (+  8762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5767184640}
I20260709 13:15:58.406896 31029 rpcz_store.cc:276] 0709 13:15:57.345910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.405327 (+1059417us) service_pool.cc:224] Handling call
0709 13:15:58.405687 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.406310 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.406513 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.376804  1998 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.407421  2442 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.409194 31029 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:15:58.414053 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2617) took 1065 ms. Trace:
I20260709 13:15:58.414729 31029 rpcz_store.cc:276] 0709 13:15:57.348882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.408497 (+1059615us) service_pool.cc:224] Handling call
0709 13:15:58.408968 (+   471us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.413682 (+  4714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.413985 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.416781 31029 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: [6.7-9.8]
W20260709 13:15:58.417289 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.417640 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2618) took 1068 ms. Trace:
I20260709 13:15:58.394135  2544 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:58.379855  2473 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:58.380076  2455 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:15:58.433471 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.418164 31029 rpcz_store.cc:276] 0709 13:15:57.349166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.416013 (+1066847us) service_pool.cc:224] Handling call
0709 13:15:58.416454 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.417310 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.417575 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.425284  2495 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.422559  2544 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:58.455912  2462 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.458117  2462 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.458954  2433 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:58.459291 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:58.458132  2518 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.460760 31604 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.465387  2471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51632 (request call id 98) took 7885 ms. Trace:
I20260709 13:15:58.465901  2471 rpcz_store.cc:276] 0709 13:15:50.577197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.931897 (+354700us) service_pool.cc:224] Handling call
0709 13:15:51.120834 (+188937us) log.cc:844] Serialized 494 byte log entry
0709 13:15:51.923023 (+802189us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800202ba0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:15:58.453689 (+6530666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42883,"raft.queue_time_us":243137,"raft.run_cpu_time_us":1521,"raft.run_wall_time_us":83736,"spinlock_wait_cycles":24184576,"thread_start_us":335457,"threads_started":1,"wal-append.queue_time_us":880208,"wal-append.run_cpu_time_us":3595,"wal-append.run_wall_time_us":1160892}
I20260709 13:15:58.453984  2544 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:58.469022  2524 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:58.479385 30848 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.858s (SENT)
W20260709 13:15:58.481622 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.486451 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d95504ff00154bdf99a5de1ad11f4f58 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 13:15:58.486707  2550 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:15:58.460188  2542 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 2.649s	user 0.035s	sys 0.057s
I20260709 13:15:58.459241  1881 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.452200  2495 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:15:58.513067 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 120065us
I20260709 13:15:58.510063  2524 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.506789  2467 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.523361 31029 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:15:58.514011  2550 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.511813  2495 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.530893 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.531478 31024 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:15:58.532371 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:58.532750 31024 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:15:58.533268 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:58.525959 30848 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.912s (SENT)
I20260709 13:15:58.528920  2467 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.529964 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.535566 31025 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:58.504004  2478 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.571949 31025 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:58.572641 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2628) took 1100 ms. Trace:
I20260709 13:15:58.572993 31025 rpcz_store.cc:276] 0709 13:15:57.471738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.896801 (+425063us) service_pool.cc:224] Handling call
0709 13:15:58.529810 (+633009us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:15:58.572581 (+ 42771us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15620352}
I20260709 13:15:58.560228 31605 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:15:58.564921  1881 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:58.570063 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 44068.5us
I20260709 13:15:58.574987 31024 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
W20260709 13:15:58.576933 30848 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.926s (SENT)
I20260709 13:15:58.577405 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:58.580363 31024 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:58.579993 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.583328 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:58.582062 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.583928 31600 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:15:58.584885 31025 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:58.585297 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1182) took 3911 ms. Trace:
I20260709 13:15:58.585999 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2623) took 1235 ms. Trace:
I20260709 13:15:58.586365 31025 rpcz_store.cc:276] 0709 13:15:57.350607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.584455 (+1233848us) service_pool.cc:224] Handling call
0709 13:15:58.584713 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.585798 (+  1085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.585951 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.570278  2524 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:58.588868 31025 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:58.590644 31604 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:15:58.585093  2500 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:58.592229 30922 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:58.592576  2500 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.585839 31601 rpcz_store.cc:276] 0709 13:15:54.674280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.675217 (+   937us) service_pool.cc:224] Handling call
0709 13:15:55.061689 (+386472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:55.062119 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:55.062158 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:55.093892 (+ 31734us) log.cc:844] Serialized 26 byte log entry
0709 13:15:55.302434 (+208542us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:15:55.302499 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.302600 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.419487 (+3116887us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:15:58.583413 (+163926us) raft_consensus.cc:1685] finished
0709 13:15:58.583434 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.585237 (+  1803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8166,"raft.queue_time_us":230326,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9853,"spinlock_wait_cycles":572695296,"thread_start_us":93713,"threads_started":1,"wal-append.queue_time_us":493724}
I20260709 13:15:58.593247 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2624) took 1242 ms. Trace:
I20260709 13:15:58.594429 31025 rpcz_store.cc:276] 0709 13:15:57.350851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.588443 (+1237592us) service_pool.cc:224] Handling call
0709 13:15:58.588721 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.589202 (+   481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.593194 (+  3992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.580528  1484 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:58.570487  2550 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.597077 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2620) took 1231 ms. Trace:
I20260709 13:15:58.602582 31024 rpcz_store.cc:276] 0709 13:15:57.349865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.579895 (+1230030us) service_pool.cc:224] Handling call
0709 13:15:58.580178 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.580994 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.581181 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.594308  2433 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:58.592950  2500 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.598790  2473 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.612129  2433 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:15:58.597887  2635 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:15:58.599821  2524 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.629457 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:58.630056 31604 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:15:58.632159  2631 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:15:58.637281 30848 leader_election.cc:336] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.025s (SENT)
I20260709 13:15:58.637732 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:15:58.624303  2635 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:58.617584  2473 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:58.640298  2551 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:15:58.625088  2442 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:58.633872  2518 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.657080 31604 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:58.658938 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:15:58.640640  2467 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:58.674428 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1039) took 1228 ms. Trace:
I20260709 13:15:58.674844 31599 rpcz_store.cc:276] 0709 13:15:57.445892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.447682 (+  1790us) service_pool.cc:224] Handling call
0709 13:15:57.448027 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.694141 (+246114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.674182 (+980041us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54005f1c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:58.674372 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563449600}
W20260709 13:15:58.671308  2629 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
W20260709 13:15:58.681093  2634 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:15:58.681702  2630 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:15:58.681277 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2094) took 1275 ms. Trace:
I20260709 13:15:58.686189 31024 rpcz_store.cc:276] 0709 13:15:57.406211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.603308 (+1197097us) service_pool.cc:224] Handling call
0709 13:15:58.603627 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.603873 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.603900 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.609010 (+  5110us) log.cc:844] Serialized 26 byte log entry
0709 13:15:58.674712 (+ 65702us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:58.674755 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.674820 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.681048 (+  6228us) raft_consensus.cc:1685] finished
0709 13:15:58.681072 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.681214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":45277,"threads_started":1,"wal-append.queue_time_us":58882}
I20260709 13:15:58.669751  2442 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:58.688417  2442 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:58.689522  2442 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:58.669687  2478 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:58.693632 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.698144 31024 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:58.699672 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2606) took 4682 ms (client timeout 1546 ms). Trace:
W20260709 13:15:58.700145 31030 rpcz_store.cc:269] 0709 13:15:54.017801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.055890 (+ 38089us) service_pool.cc:224] Handling call
0709 13:15:58.699470 (+4643580us) spinlock_profiling.cc:243] Waited 3.18 s on lock 0x7b540009f1d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:58.699582 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7316434688}
I20260709 13:15:58.701108  2524 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:58.701188 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:15:58.701982 31030 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:58.708657 31597 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:58.709609 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1051) took 1175 ms. Trace:
I20260709 13:15:58.656257  2433 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:58.705585  2632 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:15:58.718973 31024 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 5.
I20260709 13:15:58.724455 31030 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:15:58.728992 31030 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:15:58.730743 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.710019 31598 rpcz_store.cc:276] 0709 13:15:57.534509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.534819 (+   310us) service_pool.cc:224] Handling call
0709 13:15:57.535111 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.535335 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:15:57.685147 (+149812us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.642444 (+957297us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800454a20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:15:58.707233 (+ 64789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.707463 (+   230us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:15:58.707621 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.708083 (+   462us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.709546 (+  1463us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141921,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3678,"raft.queue_time_us":117,"spinlock_wait_cycles":2685696,"thread_start_us":211949,"threads_started":2}
I20260709 13:15:58.735944 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 735) took 1316 ms. Trace:
I20260709 13:15:58.738444 31030 rpcz_store.cc:276] 0709 13:15:57.419876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.728263 (+1308387us) service_pool.cc:224] Handling call
0709 13:15:58.728731 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.735581 (+  6850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.735870 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:58.714550  2550 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:59.034130  2467 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.222209  2597 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:59.222604  2556 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:15:59.248267  2556 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.250591  2556 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:15:59.272774  2639 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.600s	user 0.000s	sys 0.002s
I20260709 13:15:59.280092  2473 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:59.254266  2467 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.247673  2597 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:59.289384  2500 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
W20260709 13:15:59.296772  2495 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.000s
I20260709 13:15:58.711228  2635 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.318634  2495 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:59.311961  2501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.027s	sys 0.006s
I20260709 13:15:59.312676  2500 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:15:59.344561  2544 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.876s	user 0.011s	sys 0.000s
W20260709 13:15:59.351171  2501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.027s	sys 0.008s
I20260709 13:15:59.361582  2467 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:59.376988  2500 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:59.362156  2544 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:15:59.387419  2641 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:15:59.378271  2597 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:59.389104  2495 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:59.393622  2442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.082s	sys 0.233s
W20260709 13:15:59.394119  2442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.082s	sys 0.233s
I20260709 13:15:59.394022  2544 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:59.417029  2297 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:59.447069  2416 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:59.447655  2416 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:15:59.448581  2416 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.449898  2416 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:59.481016  2576 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:59.519968 30956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2135) took 3167 ms (client timeout 1659 ms). Trace:
W20260709 13:15:59.520476 30956 rpcz_store.cc:269] 0709 13:15:56.352787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.132558 (+779771us) service_pool.cc:224] Handling call
0709 13:15:59.519706 (+2387148us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002b7854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.519873 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600325888}
W20260709 13:15:59.531677 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.562464  2558 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:15:59.585834 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.601611 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.602131 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.604498 30881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 871) took 1726 ms (client timeout 1599 ms). Trace:
W20260709 13:15:59.604991 30881 rpcz_store.cc:269] 0709 13:15:57.878555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.878681 (+   126us) service_pool.cc:224] Handling call
0709 13:15:59.604271 (+1725590us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54000d34d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.604423 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124063488}
I20260709 13:15:59.608955 31604 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:59.616155  2493 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:59.622601  1950 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:59.626890 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 736) took 2206 ms. Trace:
I20260709 13:15:59.627372 31030 rpcz_store.cc:276] 0709 13:15:57.420218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.108047 (+1687829us) service_pool.cc:224] Handling call
0709 13:15:59.626314 (+518267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.626534 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.626562 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.626608 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:59.626651 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.626708 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.626828 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.629069 31030 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:15:59.629673 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2097) took 2200 ms. Trace:
I20260709 13:15:59.629983 31030 rpcz_store.cc:276] 0709 13:15:57.429126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.628470 (+2199344us) service_pool.cc:224] Handling call
0709 13:15:59.628823 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.629420 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.629619 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.631311 31030 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:15:59.632027 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2100) took 2173 ms. Trace:
I20260709 13:15:59.632400 31030 rpcz_store.cc:276] 0709 13:15:57.459093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.630708 (+2171615us) service_pool.cc:224] Handling call
0709 13:15:59.630975 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.631724 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.631970 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.633720 31030 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:15:59.634518 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2631) took 2149 ms. Trace:
I20260709 13:15:59.634837 31030 rpcz_store.cc:276] 0709 13:15:57.484794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.633139 (+2148345us) service_pool.cc:224] Handling call
0709 13:15:59.633412 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.634302 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.634472 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.642652 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1075) took 1805 ms. Trace:
I20260709 13:15:59.643074 31597 rpcz_store.cc:276] 0709 13:15:57.837540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.837669 (+   129us) service_pool.cc:224] Handling call
0709 13:15:58.708396 (+870727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.709157 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.642460 (+933303us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54006a54d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.642592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001709440}
I20260709 13:15:59.652314 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:15:59.661919 31024 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:15:59.658104  2493 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.672091  2493 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.673141  2558 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.673627  2558 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.674350  2493 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:59.666373  2548 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.784883  2548 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:59.787230  2548 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:15:59.668681 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:59.789317 31597 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:15:59.791951  2576 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:15:59.792520  2576 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.794620  2576 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:59.795122  2576 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.669780 31604 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:59.796911 31604 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:15:59.672428 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2630) took 2199 ms (client timeout 1723 ms). Trace:
W20260709 13:15:59.799736 31032 rpcz_store.cc:269] 0709 13:15:57.473278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.966155 (+492877us) service_pool.cc:224] Handling call
0709 13:15:59.672249 (+1706094us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b54000c49d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.672353 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108291968}
I20260709 13:15:59.801179 31032 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:59.801759 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 739) took 2218 ms. Trace:
I20260709 13:15:59.802073 31032 rpcz_store.cc:276] 0709 13:15:57.583128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.800714 (+2217586us) service_pool.cc:224] Handling call
0709 13:15:59.801001 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.801532 (+   531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.801704 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.803277 31032 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:59.804109 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:15:59.666302  2418 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:59.665213  2545 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:00.053756  2545 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.054175  2545 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.054958  2545 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.678731 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.058226 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:00.058928 31601 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:15:59.660984 31571 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:00.060446 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 399501us
W20260709 13:15:59.655055 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.680154 31602 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.063109 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:15:59.682426 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.063782  2610 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:00.064119 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.064481  2610 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.064917  2610 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.687513 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.067281  2610 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:00.067480 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 380031us
I20260709 13:16:00.069034 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.069873 30956 raft_consensus.cc:2410] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:00.059712 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:15:59.693080 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:15:59.704181  2608 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.729s	user 0.004s	sys 0.016s
W20260709 13:15:59.717578 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2102) took 2233 ms (client timeout 1601 ms). Trace:
W20260709 13:16:00.072918 31031 rpcz_store.cc:269] 0709 13:15:57.484649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.524933 (+ 40284us) service_pool.cc:224] Handling call
0709 13:15:59.717337 (+2192404us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54001f2f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.717501 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043062656}
W20260709 13:15:59.698457 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.074779 30924 connection.cc:256] RPC call timeout handler was delayed by -1.1833015110000815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 13:15:59.723109 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:00.075137 30924 connection.cc:256] RPC call timeout handler was delayed by -1.1140015109999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:16:00.075474 30924 connection.cc:256] RPC call timeout handler was delayed by -1.0249015110000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:16:00.075686 31026 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:00.076022  2442 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.076315 30924 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:00.076716  2442 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:59.735751 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1089) took 1757 ms. Trace:
I20260709 13:15:59.741142 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1088) took 1796 ms. Trace:
I20260709 13:15:59.746562 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:59.758705 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 875) took 1873 ms. Trace:
I20260709 13:15:59.761270 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:15:59.762148 30923 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.687s (SENT) [suppressed 51 similar messages]
I20260709 13:15:59.730175 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:15:59.711561 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.766153 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:59.763981 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.077582 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:00.079357 30875 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:59.765925 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.080268 30883 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.077829  2635 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.767000 30997 connection.cc:256] RPC call timeout handler was delayed by -1.010139153999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
I20260709 13:16:00.081991 30955 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.082186 30958 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:00.081084  2635 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.766906 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:15:59.771104  2480 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.084637  2480 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:00.085284  2480 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:15:59.776612 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 727) took 2431 ms. Trace:
I20260709 13:15:59.778158 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:00.085911  2635 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.086278 31596 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:15:59.780968 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:00.087090 31599 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.087402 31599 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:15:59.775873 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:15:59.808736 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2122) took 4133 ms. Trace:
I20260709 13:15:59.814677 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2103) took 1670 ms. Trace:
I20260709 13:16:00.088650 31032 rpcz_store.cc:276] 0709 13:15:58.144380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.802788 (+1658408us) service_pool.cc:224] Handling call
0709 13:15:59.803098 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.803598 (+   500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.814606 (+ 11008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.088589 30953 rpcz_store.cc:276] 0709 13:15:55.676630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:55.781342 (+104712us) service_pool.cc:224] Handling call
0709 13:15:55.785282 (+  3940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.979026 (+2193744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.808469 (+1829443us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b54003fe8d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:59.808665 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4957378944}
I20260709 13:15:59.795562  2576 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:00.090660 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.091384  1950 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:15:59.895447  2544 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:15:59.900734 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2098) took 2452 ms (client timeout 1716 ms). Trace:
I20260709 13:16:00.091948  2576 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:00.092204 31027 rpcz_store.cc:269] 0709 13:15:57.448197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.908160 (+459963us) service_pool.cc:224] Handling call
0709 13:15:59.900547 (+1992387us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54001bfb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.900666 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818076416}
I20260709 13:16:00.078178 30874 rpcz_store.cc:276] 0709 13:15:57.885514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.885667 (+   153us) service_pool.cc:224] Handling call
0709 13:15:57.886058 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.250117 (+364059us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:15:58.250137 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.250165 (+    28us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:58.250183 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.757819 (+1507636us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180039b140. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b3b2a6 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419
0709 13:15:59.758469 (+   650us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400290254. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:59.758523 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.758649 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1101,"raft.queue_time_us":1229,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4770,"spinlock_wait_cycles":843636992}
I20260709 13:16:00.093663  2576 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:00.093830  2544 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.078588 30881 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:15:59.903667 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2619) took 2554 ms. Trace:
W20260709 13:15:59.895458 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.095232 31029 rpcz_store.cc:276] 0709 13:15:57.349444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.443410 (+1093966us) service_pool.cc:224] Handling call
0709 13:15:58.450950 (+  7540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.524504 (+ 73554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.903452 (+1378948us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b540007c454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:59.903611 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166078848}
W20260709 13:16:00.096146 31570 connection.cc:256] RPC call timeout handler was delayed by -1.7921573569999509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 13:16:00.079022 31023 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:00.097119 31570 connection.cc:256] RPC call timeout handler was delayed by -1.7300573569998505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:16:00.097599 31570 connection.cc:256] RPC call timeout handler was delayed by -1.7300573569998505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 13:15:59.928720 30769 maintenance_manager.cc:643] P 9bcfacd34c704ab69ff2de017b2e1fb5: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.506s	user 0.181s	sys 0.078s Metrics: {"bytes_written":30649,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":182597,"dirs.run_cpu_time_us":414,"dirs.run_wall_time_us":1116,"drs_written":1,"lbm_read_time_us":423,"lbm_reads_lt_1ms":4,"lbm_write_time_us":313915,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":106152,"threads_started":2,"update_count":33,"wal-append.queue_time_us":22778}
I20260709 13:16:00.096195  2544 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:15:59.940155  2184 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:00.098361  2544 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.098598  2184 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.098857  2544 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.099437  2184 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.078794  2442 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.100703  2184 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.101159  2544 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.105573 30770 maintenance_manager.cc:419] P 9bcfacd34c704ab69ff2de017b2e1fb5: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10450 bytes on disk
I20260709 13:16:00.077713 31605 rpcz_store.cc:276] 0709 13:15:57.944752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.230357 (+285605us) service_pool.cc:224] Handling call
0709 13:15:58.230662 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.574149 (+343487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.740867 (+1166718us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540069f5d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:15:59.741079 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757032192}
I20260709 13:16:00.109824 30769 maintenance_manager.cc:643] P 9bcfacd34c704ab69ff2de017b2e1fb5: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":417,"lbm_reads_lt_1ms":4}
I20260709 13:15:59.956615 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 738) took 2459 ms. Trace:
W20260709 13:15:59.957687 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.111940 30998 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.077657 31600 rpcz_store.cc:276] 0709 13:15:57.977955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.235205 (+257250us) service_pool.cc:224] Handling call
0709 13:15:58.583644 (+348439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.584319 (+   675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.735510 (+1151191us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54007d50d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:15:59.735673 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788278528}
I20260709 13:16:00.077961  2481 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:16:00.085913 31028 rpcz_store.cc:276] 0709 13:15:57.345004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.397039 (+1052035us) service_pool.cc:224] Handling call
0709 13:15:58.397363 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.397674 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.397701 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:58.398223 (+   522us) log.cc:844] Serialized 52 byte log entry
0709 13:15:58.462445 (+ 64222us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:15:58.462488 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.462557 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.776362 (+1313805us) raft_consensus.cc:1685] finished
0709 13:15:59.776386 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.776548 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1096,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":53331,"threads_started":1,"wal-append.queue_time_us":126960}
I20260709 13:16:00.114341  2656 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:00.114989  2656 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:15:59.959388 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 155367us
I20260709 13:16:00.016857 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:15:59.959309  2416 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:00.116458 30876 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:00.116567  2416 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.019666  2476 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.116961  2416 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.117290  2476 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.118024 31023 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:00.119359  2476 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.023535  2418 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.120226  2548 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:00.121551  2418 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:00.122040 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.122270  2418 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:00.122896  2418 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:00.122097  2656 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:00.037240 31025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.086s	sys 0.216s
I20260709 13:16:00.063433  2555 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:00.123984 31025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.464s	user 0.087s	sys 0.217s
I20260709 13:16:00.124204  2555 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.069749  2557 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:00.071314 30949 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.125839  2557 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:00.121554  1881 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:16:00.126721  2557 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.127168  2555 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.127971  2555 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.091969  1950 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.128321  2555 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:00.129866  1950 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.129371  2555 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.805264  2473 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.085564 30954 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:00.127710 31570 connection.cc:256] RPC call timeout handler was delayed by -1.2179271079999126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 13:16:00.130651  2473 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:15:59.864158  2292 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:00.131791  2292 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.902554 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.132699  2473 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:15:59.805991 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.133178 31597 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:00.133378 30877 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.133797  2292 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.134315  2292 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.134706  2292 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:15:59.900766 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.078796 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:00.136756  2292 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.137091 31603 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:00.025862  2570 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:00.036396 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.137722 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.125334 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2625) took 2774 ms. Trace:
I20260709 13:16:00.110989 31030 rpcz_store.cc:276] 0709 13:15:57.497261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.635623 (+2138362us) service_pool.cc:224] Handling call
0709 13:15:59.635907 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.636110 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:15:59.648117 (+ 12007us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.956176 (+308059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.956243 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:15:59.956302 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.956398 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.956547 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267820,"prepare.queue_time_us":12001,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":268915,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":51453,"threads_started":2,"wal-append.queue_time_us":11423}
I20260709 13:16:00.138372 30955 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:16:00.138552 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.139204 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.138391 31025 rpcz_store.cc:276] 0709 13:15:57.351071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.595281 (+1244210us) service_pool.cc:224] Handling call
0709 13:15:58.596196 (+   915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.596392 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:58.659538 (+ 63146us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.124844 (+1465306us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.125003 (+   159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.125047 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:00.125088 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.125149 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.125257 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104588,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":11567,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":151,"thread_start_us":1522148,"threads_started":2,"wal-append.queue_time_us":748184}
I20260709 13:16:00.141247 30952 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:00.141713 30952 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:15:59.965955  2558 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.137482 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.140331 30949 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:00.131338 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0479662309999185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:16:00.145081 30949 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:00.145242 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0365449999999328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
I20260709 13:16:00.140393  2545 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.146461 30949 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.146901 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.147423 30949 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.147686  2292 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:00.148233 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.148720 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.144701 30953 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:00.149071  2292 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:00.149690  2292 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:00.150053 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72549.2us
I20260709 13:16:00.150661  2292 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.151419 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.152799 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:00.153048 30877 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:00.072243 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:00.153805  2610 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:00.153973  2418 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.154836 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2105) took 1920 ms. Trace:
I20260709 13:16:00.155545 31024 rpcz_store.cc:276] 0709 13:15:58.234666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.072741 (+1838075us) service_pool.cc:224] Handling call
0709 13:16:00.073039 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.073341 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.073377 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.073844 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.154481 (+ 80637us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:00.154536 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.154610 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.154659 (+    49us) raft_consensus.cc:1685] finished
0709 13:16:00.154670 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.154773 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4471,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":73357,"threads_started":1,"wal-append.queue_time_us":71825}
I20260709 13:16:00.143563 30952 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.158126 30952 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.164999 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.128496 31599 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:00.167937  2546 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.168143 30956 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:00.168586  2546 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.175693 30875 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:00.191164  2570 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.192142  2570 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:00.193184  2473 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.193794  2473 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:00.196211 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 43530.5us
I20260709 13:16:00.198293  2473 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.200826  2546 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:00.203351  2570 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:00.209504  2570 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.211622  2570 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.129830 30883 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:00.216776 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.217648 30956 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:00.221385 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.223822 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.172310  2416 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.224525 30953 raft_consensus.cc:2368] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10.
I20260709 13:16:00.226029  2416 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.224161 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.227739  2570 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.268275 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 506097us
I20260709 13:16:00.268730  2555 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.268822  2570 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.271296  2570 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.234774 30949 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:16:00.272425 30949 pending_rounds.cc:85] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 10
I20260709 13:16:00.272699 30949 pending_rounds.cc:107] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:16:00.272941 30949 raft_consensus.cc:2889] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:00.273748 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.237259 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:00.242447 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 126322us
I20260709 13:16:00.274139 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.248606 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.275174 30955 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:00.275977 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.276213 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:00.276822 30955 raft_consensus.cc:2410] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:00.245738 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.277678 30954 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:00.277778 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.278173  2570 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:00.278587 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.279207 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:00.279384 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.280010  2184 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:00.280364 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.280555  2184 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.280779  2548 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:00.281118 30923 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.281795 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.251458 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.281904  2184 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.283212 30950 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:00.284050 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.284188 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.284812 30950 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:00.285378 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.253031 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.256824 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.285728 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:00.286090 31603 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:00.286130 30957 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:00.286373 31601 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:00.255537 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 107371us
I20260709 13:16:00.286767 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.287083 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.287232 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.243468 30952 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:00.287817 30957 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 5: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:00.287957 30952 pending_rounds.cc:85] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:16:00.288280 30952 pending_rounds.cc:107] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 13:16:00.260649 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 147631us
I20260709 13:16:00.288332 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.288589 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.289184 30957 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:00.258929  2418 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.289908  2292 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:00.290318  2292 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.262929  2557 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:00.290688  2292 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.290866  2557 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:00.261121 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 173580us
W20260709 13:16:00.292208 30997 leader_election.cc:336] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.685s (SENT)
I20260709 13:16:00.292649 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:00.293183  2557 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:00.264190 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 202671us
I20260709 13:16:00.293460 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.294224 30951 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12.
W20260709 13:16:00.294528 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.295048 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.295995  2610 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:00.288617 30952 raft_consensus.cc:2889] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:00.296823 31604 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:00.295660 30951 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:00.296938  2546 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:00.297407 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.298045 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.274556 30953 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:00.305179 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.305766 30949 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.278622  2570 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:00.282401 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.306895 31599 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:00.307178 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.307756  2570 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.308892 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.285513 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.298517 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.299010 31597 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.309978 30950 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:00.311239 30952 raft_consensus.cc:2410] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:00.296023 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.299667 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.312388 31596 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:00.312665 30957 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.313475 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.299923 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.316021 30951 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:00.316223 31603 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:00.263813 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2106) took 2026 ms. Trace:
I20260709 13:16:00.317292 31031 rpcz_store.cc:276] 0709 13:15:58.237106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.073647 (+1836541us) service_pool.cc:224] Handling call
0709 13:16:00.073940 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.074269 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.074304 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.074695 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.263449 (+188754us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:00.263486 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.263556 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.263612 (+    56us) raft_consensus.cc:1685] finished
0709 13:16:00.263623 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.263739 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3788,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":58,"thread_start_us":188380,"threads_started":1,"wal-append.queue_time_us":174100}
I20260709 13:16:00.300384 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:00.279754 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.301957 31604 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:00.278606 30955 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:00.304212 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.323153 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.281960  2548 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:00.304883  1881 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.305845 31598 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:00.325809  1881 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:00.326370  1881 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:00.325662  2292 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.326740  1881 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.327400 31605 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:00.330197 31601 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:00.305969 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:00.262264 30848 leader_election.cc:336] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.202s (SENT)
W20260709 13:16:00.274102 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 205629us
W20260709 13:16:00.304276 30997 leader_election.cc:336] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.696s (SENT)
W20260709 13:16:00.332381 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 70146.8us
I20260709 13:16:00.332696 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:00.333123 30848 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.231s (SENT)
I20260709 13:16:00.333659  2418 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:00.333886 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.334611 30997 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.812s (SENT)
W20260709 13:16:00.266794 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.324451 31604 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:00.332139 30953 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:00.336151  2683 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:00.299213  2679 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:00.335614 30997 leader_election.cc:336] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.969s (SENT)
I20260709 13:16:00.324965  2548 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:00.315426 31571 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:00.337740 30997 leader_election.cc:336] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.005s (SENT)
I20260709 13:16:00.251130 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:00.339025 30997 leader_election.cc:336] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.176s (SENT)
I20260709 13:16:00.335182  1881 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.339478  2548 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:00.251062 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.340373 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.340888  2548 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.341707  2576 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.341881  1881 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.342227  2576 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.344297  2576 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.344174 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.345230 31026 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:00.339421 30997 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:00.346328  2576 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.346825  2576 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:00.349748 30997 leader_election.cc:336] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.224s (SENT)
W20260709 13:16:00.351181 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 70115.1us
I20260709 13:16:00.353382 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.355412 31031 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:00.356254 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.357034 30883 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:00.359098 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.359515 30877 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:00.331619 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:00.355535 30924 connection.cc:256] RPC call timeout handler was delayed by -1.8562252259998786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:16:00.362995 30924 connection.cc:256] RPC call timeout handler was delayed by -1.6303252259999681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 13:16:00.365684 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:00.365877 30924 connection.cc:256] RPC call timeout handler was delayed by -1.592525225999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:16:00.367066 30924 connection.cc:256] RPC call timeout handler was delayed by -1.5664252259998648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:16:00.367584 30924 connection.cc:256] RPC call timeout handler was delayed by -1.4701252259999364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:16:00.368031 30924 connection.cc:256] RPC call timeout handler was delayed by -1.4368252259998826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:16:00.368431 30924 connection.cc:256] RPC call timeout handler was delayed by -1.4071252259998346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 13:16:00.363579 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.354276 30956 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:16:00.373039 30924 connection.cc:256] RPC call timeout handler was delayed by -1.3396252259999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 13:16:00.370401 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 71888.7us
I20260709 13:16:00.371080 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.374269 30877 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:00.375525 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.372018 30957 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
W20260709 13:16:00.373474 30924 connection.cc:256] RPC call timeout handler was delayed by -1.3180252259999179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 13:16:00.369055  2481 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.369225  2462 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:00.375192  2493 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:16:00.385979  2462 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.385324 30883 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:00.387727  2184 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.388029  2545 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:00.378494 30924 connection.cc:256] RPC call timeout handler was delayed by -1.0975252260000161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24470000000000003s for a response
I20260709 13:16:00.375615  2442 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:16:00.393818 30924 connection.cc:256] RPC call timeout handler was delayed by -1.0885252260000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2457s for a response
I20260709 13:16:00.380522 31023 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:00.376020  2418 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:00.378460  2671 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.394516  2442 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:00.394608  2418 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:00.395197  2442 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.395094  2671 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.388768 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.397058 31026 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:00.396874  2664 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:00.397831  2671 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.386621  2292 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.339082  2557 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:00.380669 31031 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:00.403685 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.402571 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.380892 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.406236 30958 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:00.383351 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:00.407507 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:00.413128 31028 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:00.413219 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.413964 30950 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:00.393116 31604 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:00.393694  2545 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.414391  2558 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:00.338135  2610 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.386322  2493 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:00.368888  2473 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:00.381388 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.423399 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:00.368866  2416 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.416718 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.399461  2184 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.416426  2546 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:00.431188  2292 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:00.417979 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 102652us
I20260709 13:16:00.407183  2576 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.431212  2546 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.390000  1881 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:16:00.378134  2570 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.431397  2675 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:00.396351  2442 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.419919  2493 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.423084  2473 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.402388  2481 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.442740  2473 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.418370  2418 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.430227  2679 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:00.415825  2557 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.441536  2292 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.417847  2674 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:00.415416  2545 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.429522  2656 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:00.442076  2675 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:00.440194  2546 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.446661  2679 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.448335  2610 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.443418  2689 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:16:00.454219  2675 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.457504  2685 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:00.457918  2685 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.454540  2679 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.459744  2679 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.459244  2685 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.394438 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.495075 30876 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:16:00.495335 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.497238 30952 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:00.401357 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:00.498744 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.379433 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:00.500136  2184 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.502652 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.448455  2442 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.384059 30949 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:00.403338 30954 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:16:00.405742 30951 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:00.626881 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.401641 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.628260 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.628427 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.629375 30950 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:00.629292 30955 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:00.629719 30877 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:00.400450 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.630419 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:00.631397 30957 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:00.632443 30874 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:00.632575 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.632762 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:00.500933 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 121438us
I20260709 13:16:00.450528  2493 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.424345 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:00.645776  2493 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:00.646242 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 221882us
I20260709 13:16:00.647032  2685 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.400207 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.648442 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.508401 30883 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:00.650183 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.514863  2635 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:00.651947  2635 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.653527  2635 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.654728 31028 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:00.517143 30875 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:00.604436 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.498739 30953 raft_consensus.cc:2376] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13. Re-sending same reply.
W20260709 13:16:00.531281 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.605276 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.659188 30958 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:00.598273  2570 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.661615 30875 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:00.662891 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.664247 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.664517 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.665169 30874 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:00.665601 30875 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:00.665771 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 218482us
I20260709 13:16:00.666715 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.667148 30874 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:00.667443  2689 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:00.668298 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.669160 30950 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:00.676312 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.680697 30877 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
W20260709 13:16:00.648736  2695 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:16:00.683853 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:00.684332 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 91022.1us
I20260709 13:16:00.630452 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:00.685518 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080029a1c0 after lost signal to thread 29721
I20260709 13:16:00.685745 30955 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:16:00.605151  2694 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:16:00.687225 31626 debug-util.cc:398] Leaking SignalData structure 0x7b08002cac20 after lost signal to thread 30815
I20260709 13:16:00.684789 30957 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:00.689910  1881 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:00.689996  2675 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:00.691025 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 43493.1us
I20260709 13:16:00.443506  2462 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.691893  2665 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.692627  2665 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.693710 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:00.694075 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.628479 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:00.694590 31030 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.695222  2675 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:00.694988 31028 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:00.697109 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.697849 31025 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:00.699003 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.700542  2688 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:00.528285 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.590616  2481 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.633884 30949 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:00.603410  2545 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.636643 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.639876 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:00.732568 31626 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad8a0 after lost signal to thread 30907
I20260709 13:16:00.732874 30882 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:16:00.734283 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080035ada0 after lost signal to thread 30982
W20260709 13:16:00.734620 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080031d940 after lost signal to thread 30983
I20260709 13:16:00.640491 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.641618 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.742172 30883 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:00.642711 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.643498  2683 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:00.648542 30956 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:00.604802  2557 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:00.731138 30876 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:00.739615 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.740139 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 381968us
W20260709 13:16:00.743103 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 115023us
I20260709 13:16:00.739163  2473 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.760113 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:00.767208 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.533227  2292 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.767686 30880 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:00.780061 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.782898  2665 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.770152  2686 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:00.770596  2684 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:16:00.764322 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:00.762744 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:00.772504 31626 debug-util.cc:398] Leaking SignalData structure 0x7b0800326dc0 after lost signal to thread 31056
W20260709 13:16:00.788489 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.788344 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47231.5us
W20260709 13:16:00.768596 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 370382us
I20260709 13:16:00.786873 30881 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:00.759881  2473 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.769636 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:00.780247 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.798418 30877 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:16:00.816449 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.823124 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.821460 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.700378 30780 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 7, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 7 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:00.825080 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55592.3us
I20260709 13:16:00.828776 30882 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:00.835410 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.837180  2656 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.837560 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:00.837646 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.837852  2656 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:00.840060 31025 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
W20260709 13:16:00.846406 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48107.5us
I20260709 13:16:00.848033 30957 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:00.848611 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.849612 30950 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:00.849391 30780 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 10, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 10 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:00.853996  2688 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.854794  2688 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.855911 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.848063 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:00.858153 30956 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:00.851905 30780 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:00.867405 30778 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 359) took 20907 ms (client timeout 15000 ms). Trace:
W20260709 13:16:00.873509 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45151.5us
I20260709 13:16:00.874054 31030 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:00.857595  2656 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:00.878208  2679 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:00.878762  2679 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:00.879199  2679 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:00.879227  2635 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:00.880580  2481 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:00.880517  2635 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:00.881116  2481 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:00.867976 30778 rpcz_store.cc:269] 0709 13:15:39.960231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.980734 (+ 20503us) service_pool.cc:224] Handling call
0709 13:16:00.867136 (+20886402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:56.349615 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:56.350278 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:56.350338 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:15:56.350351 (+    13us) tablet.cc:662] Decoding operations
0709 13:15:56.351543 (+  1192us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:56.351616 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:56.351644 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:15:56.965272 (+613628us) tablet.cc:701] Row locks acquired
0709 13:15:56.965333 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:15:56.965576 (+   243us) write_op.cc:270] Start()
0709 13:15:56.965731 (+   155us) write_op.cc:276] Timestamp: P: 1783602956965485 usec, L: 0
0709 13:15:56.965757 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:15:56.966698 (+   941us) log.cc:844] Serialized 5176 byte log entry
0709 13:15:57.647282 (+680584us) op_driver.cc:464] REPLICATION: finished
0709 13:15:57.803225 (+155943us) write_op.cc:301] APPLY: starting
0709 13:15:57.803391 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:57.804817 (+  1426us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:57.805005 (+   188us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:57.807435 (+  2430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:57.807849 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:15:57.807907 (+    58us) write_op.cc:312] APPLY: finished
0709 13:15:57.808311 (+   404us) log.cc:844] Serialized 95 byte log entry
0709 13:15:57.812022 (+  3711us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:57.812230 (+   208us) write_op.cc:454] Released schema lock
0709 13:15:57.812305 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:57.812836 (+   531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:57.812880 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1463429,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":149609,"apply.run_cpu_time_us":5442,"apply.run_wall_time_us":9573,"num_ops":13,"prepare.queue_time_us":224757,"prepare.run_cpu_time_us":55268,"prepare.run_wall_time_us":1071536,"raft.queue_time_us":208982,"raft.run_cpu_time_us":5316,"raft.run_wall_time_us":38031,"replication_time_us":681363,"thread_start_us":667401,"threads_started":4,"wal-append.queue_time_us":451921,"wal-append.run_cpu_time_us":26093,"wal-append.run_wall_time_us":1608238}]]}
I20260709 13:16:00.879688 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:00.888304 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:00.893687 31028 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:16:00.894048 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.894893 31031 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:00.896014  2656 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:00.898175  2656 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:00.899367  2656 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.899667  2473 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:00.901027  2473 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:00.901350  2473 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:00.902609  2473 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.834851 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:00.912966 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:00.916954 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58813.8us
I20260709 13:16:00.890136  2686 consensus_queue.cc:1243] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:00.923264 30949 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:00.952077 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.952870 31031 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:00.923509 30882 raft_consensus.cc:2410] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:00.955827  2442 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:00.956996  2442 consensus_queue.cc:1243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:00.957504  2493 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:00.957934  2493 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:00.923807 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 107859us
I20260709 13:16:00.959098  2493 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.961366  2493 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:00.924865  2664 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:00.963289  2664 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:00.963809  2664 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:00.928439 30848 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.788s (SENT)
W20260709 13:16:00.969010 30848 leader_election.cc:336] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.880s (SENT)
I20260709 13:16:00.969451 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:00.970495  2555 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:00.929152 31626 debug-util.cc:398] Leaking SignalData structure 0x7b0800356160 after lost signal to thread 31629
W20260709 13:16:00.972457 31626 debug-util.cc:398] Leaking SignalData structure 0x7b0800283780 after lost signal to thread 31630
W20260709 13:16:00.972940 31626 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4ec0 after lost signal to thread 2255
W20260709 13:16:00.973275 31626 debug-util.cc:398] Leaking SignalData structure 0x7b0800329e00 after lost signal to thread 2397
W20260709 13:16:00.973508 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080022bac0 after lost signal to thread 2402
W20260709 13:16:00.974078 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080035ddc0 after lost signal to thread 2490
W20260709 13:16:00.974339 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080037d360 after lost signal to thread 2494
I20260709 13:16:00.932173  2481 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:00.976861  2481 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:00.981475 30848 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.419s (SENT)
I20260709 13:16:00.933501  2685 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:00.933600  2473 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.936275 30780 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 10 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.938110  2635 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:00.939574  2688 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:00.944077 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.944986 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:00.945972 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:00.946655 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:00.947624 31029 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:00.948153 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:00.948482 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:00.948895 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101155us
I20260709 13:16:00.949580 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:00.932871 30922 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:00.983274 30882 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:00.985715 30875 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:00.985456  2686 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:00.986402  2545 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:00.986747  2610 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:00.987228  2418 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:00.987329 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.988924 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:00.990828 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:01.004827 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:01.010121 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77351.7us
I20260709 13:16:01.011204 30949 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:01.011514 31032 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.014199 30956 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:00.993530  2685 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:00.999430  2635 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.016234 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:01.014503 31023 raft_consensus.cc:2376] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8. Re-sending same reply.
I20260709 13:16:01.016237 31026 raft_consensus.cc:2376] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9. Re-sending same reply.
I20260709 13:16:01.023447 31025 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.027436 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.027969  2555 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:01.028846  2442 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:01.029336  2442 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.029691  2442 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:01.030022 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:01.032064 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:01.032908  2184 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:01.033362  2184 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.033708  2184 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.035079  2548 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:01.032320  2462 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.036770  2675 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:01.037680 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:01.039974 30880 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:01.041204 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.041603 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.042167 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.022989 30780 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 9 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:01.050172 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.010617  2610 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:00.974356  2679 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.055940 30876 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:01.057497 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.058957 30882 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:01.061651 31032 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:01.063434  2442 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.065850  2442 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:01.066227  2610 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:01.072221 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 90842.3us
I20260709 13:16:01.073573  2690 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:01.073715  2555 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:01.073895  2665 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:01.074120 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.074761  2555 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:01.075219  2555 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:01.076633 30878 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:01.076359  2555 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.076869 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:01.077849  2555 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:01.079661 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.022301  2635 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.021116  2685 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:01.088835 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.051263 31027 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:01.045094  2493 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:01.079948  2610 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.074170  2690 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:01.116950 30881 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:01.124111 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47369.8us
I20260709 13:16:01.128423  2664 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.132462  2664 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.123396 31025 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:01.104218  2493 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.137141 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.137941 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.138773 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.138906  2184 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.139607 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.140132 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.131958 30780 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 3 to 5, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 5 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:01.141024 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:01.150476 30880 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.141814 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:01.144764 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50995.7us
I20260709 13:16:01.142230 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.168843 30876 raft_consensus.cc:2368] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:16:01.151165 30780 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 5, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 5 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.168941 30874 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:01.171523 30956 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:01.144029  2557 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:01.172056 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 137049us
W20260709 13:16:01.169893 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 43993us
W20260709 13:16:01.176472 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.147367  2548 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:01.152916  2493 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.183606 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.192837  2690 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.194828  2690 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:01.197368  2184 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:01.202613 30951 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:01.203567  2679 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:01.204813 30881 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:16:01.206785  2557 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:01.207860 31601 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:01.208040  2557 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:01.211853  2684 consensus_queue.cc:1175] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f535fccbafb14e3f92bd45065da403db" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
W20260709 13:16:01.216364 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.217324 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.220659  2548 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.221272  2664 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:01.233453 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50434.4us
W20260709 13:16:01.235954 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 210644us
I20260709 13:16:01.180061 30780 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 8, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 8 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:01.251973 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64929.5us
I20260709 13:16:01.272190 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.287456 31598 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:16:01.288944 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 227750us
I20260709 13:16:01.290396 31601 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:01.284847 30780 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 7 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:01.301051 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.302045 31603 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:01.312098  2688 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:01.313397  2688 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:01.313853  2688 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:01.315892 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.317001 31602 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:01.318351  2665 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:01.319918  2711 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.168s	user 0.006s	sys 0.000s
I20260709 13:16:01.320042  2665 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:01.272279  2664 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:01.320930  2664 consensus_queue.cc:1243] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:01.321521  2665 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:01.327647 30880 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
W20260709 13:16:01.290035  2719 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:16:01.344273 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.314950  2688 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.362794 31603 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:01.366633 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.281708  2685 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.364955 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:01.385411 30780 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 1 to 6, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 6 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.384416 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:01.402609 31604 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:01.398564 30848 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.401238 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.407009 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:01.407680 30881 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:01.410981 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.415460 30780 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 11, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 11 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.417727 30780 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:01.418973 30780 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 8, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:01.427291  2720 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:16:01.431212 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.436204  2706 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:01.436698  2706 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.437085  2706 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:01.437454 31604 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:01.438634 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.438763 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:01.439396 31600 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.415375  2557 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.444554  2635 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.447139  2635 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.449234 30997 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.449941 31600 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:01.450654 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:01.451370 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66710.1us
I20260709 13:16:01.397872  2656 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:16:01.452057  1881 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.452224  2664 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.453361 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.454742 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:01.454993 30847 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.455436 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:01.460317 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.466751  2558 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:16:01.468876  2545 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:01.469447  2545 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:01.469841 31603 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:01.470562  2545 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.471532  2664 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:01.473392 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.474057  2664 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.476604 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:01.477962 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.479317 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:01.483793  2674 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:01.484802 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 83641.1us
W20260709 13:16:01.485677 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 118225us
I20260709 13:16:01.489403 30955 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:01.489712  2685 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:01.491677 31596 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:01.465994 30780 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:01.496601  2720 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:01.519735 30880 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:01.522733 30880 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:01.520936 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:01.521687 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.523823 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.511615  2555 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:01.531364 30780 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 9 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 10 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.516062  2664 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:01.515658  2557 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.520901  2688 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:01.524226  2720 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:01.523587 30880 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.537297 30957 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:01.542881 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 63650us
W20260709 13:16:01.555815 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 100877us
I20260709 13:16:01.556967 30847 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.531445  2555 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:01.565595 30949 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.574916 30880 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.567658 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:01.538789  2664 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:01.586761 30780 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 7 to 9, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.552428  2720 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:01.544051  2712 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.579690  2555 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.572520  2481 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.618654  2725 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:01.620162 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 127650us
I20260709 13:16:01.548661  2690 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:16:01.590857  2557 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.592722  2664 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.572788  2674 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:16:01.637940 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.589681  2691 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:01.640607 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 59155.7us
I20260709 13:16:01.646401  2721 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:01.647162  2721 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.649755  2721 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:01.652280  1881 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:01.653083  1881 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.653700  2493 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.654836 30954 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:01.627187  2713 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.627460  2656 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:01.669101 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.630779  2725 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:01.663712 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.677501 30847 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:01.672688 30780 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.674489 30880 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:16:01.634830  2418 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:01.679278 30880 pending_rounds.cc:85] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 9
W20260709 13:16:01.683869 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.684314  2493 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.662972  1881 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.684942  2684 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.685380  2656 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.685523  2684 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:01.686427  2735 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:01.687227  2713 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:01.701555 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.679692 30880 pending_rounds.cc:107] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:16:01.723210 30880 raft_consensus.cc:2889] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:01.723527 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 61901.5us
I20260709 13:16:01.731364 30881 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:01.724478 30780 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 9, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.680987  2706 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.660353  2481 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.739040  2656 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.670136  2665 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:16:01.739432  2481 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:01.740216 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 75915.1us
I20260709 13:16:01.680773  2725 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.763202  2713 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.764048 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.764319 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.765005 31601 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:01.767447 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:01.769448  2706 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:01.769589  2720 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.771562 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:01.771903  2674 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:01.772677  2665 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:01.773191  2665 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:01.773075  2728 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:01.774207  2665 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:01.743968 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.752166  2712 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:01.776154  2712 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:01.746368 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.747113 30949 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:01.747884  2418 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.732820  2557 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:01.751812 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 187017us
I20260709 13:16:01.752240 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:01.755690 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.682269  2721 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:01.737160 30780 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:01.762835 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.781708 31603 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:01.789779  2418 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.790190  2557 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.790825 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.791320  2684 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:01.795078 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 65221.8us
I20260709 13:16:01.795619  2558 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:01.796188 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:01.797879 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.798436  2675 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:01.799460  2555 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.800505 30874 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:01.801438 31601 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:01.813040  2745 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:01.815146  2745 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:01.816308  2745 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.816891 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.817567  2745 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.811652  2558 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.820067 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:01.810139  2557 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:01.813961  2675 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:01.823016  2558 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:01.787676  2720 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.844226 31604 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:01.827318  2684 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:01.851523 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.851881  2666 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:01.852087  2684 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.852808  2666 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:01.853188  2666 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:01.853921 30924 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:01.854379  2684 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:01.854167  2666 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.855247  2442 raft_consensus.cc:2764] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:01.842829  2675 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:01.855738 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:01.856693  2713 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:01.857108  2713 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.857147 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.857563  2713 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:01.858132  2656 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:01.859587 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:01.860299 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.860900  2555 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.861348 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.844770 31604 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:01.862958 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.842648  2712 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.847759  2709 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:01.863269 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:01.850630  2481 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:01.852487  2493 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:01.847421 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 84724.5us
I20260709 13:16:01.862814 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:01.855528  2666 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.876281 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:01.874567 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:01.896186 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 111024us
I20260709 13:16:01.826860  2664 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.900084 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:01.903225 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 43750.6us
I20260709 13:16:01.865810  2418 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.903846  2675 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:01.920065 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:01.896364  2548 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:01.896014  1881 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:01.916926 31604 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.932464 30877 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:01.934980 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.912695  2656 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:01.939608 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.934809  2712 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.954963 30881 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:01.928010  2743 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:01.938673  2656 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.937959  2684 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:01.960208  2684 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.960613  2684 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:01.962215  2706 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:01.962654 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 417630us
I20260709 13:16:01.963645 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:01.963792 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:01.968535 31604 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.957314  2743 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:01.977289 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 94470us
I20260709 13:16:01.956925  2545 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:01.932613  2742 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:16:01.958865  2656 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:01.983287 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 54390.5us
W20260709 13:16:01.981204 30923 leader_election.cc:336] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.687s (SENT)
I20260709 13:16:01.987501 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:01.986380 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:01.970253  2635 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:01.971668  1881 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.992595 30949 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:01.979161  2493 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.995905 31571 leader_election.cc:400] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:16:01.995707  2493 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.996711 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:01.996817 30956 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:01.997398 30954 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:01.996256 31571 leader_election.cc:403] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:01.979072  2688 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:02.004223  2493 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:01.970368  2690 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:16:02.008055  2481 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:02.008232 30956 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:01.951215  2725 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:01.980199  2743 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.016446  2675 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:02.024096 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 51294.6us
I20260709 13:16:01.987998  2720 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:02.039486 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.968192  2686 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:16:02.035643 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44811.4us
I20260709 13:16:02.039321  2688 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:02.026250 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:02.047780 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:02.045897 30949 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:16:02.046779 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51094.2us
I20260709 13:16:02.048447 30951 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
W20260709 13:16:02.048332 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 70092.7us
I20260709 13:16:02.050870 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:02.038105  2706 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10.
I20260709 13:16:02.061298 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.064030 31032 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:02.061890 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:02.062235 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.071506 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.072154 31027 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.072603 31600 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:16:02.072980 31600 pending_rounds.cc:85] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:16:02.073222 31600 pending_rounds.cc:107] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:16:02.073467 31600 raft_consensus.cc:2889] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.073926 31601 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:02.053063  2664 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:02.075260  2481 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.079059 31026 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:02.044965  1881 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.080312 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.080047  2688 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.080921 31023 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 7.
I20260709 13:16:02.066172  2665 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:02.081703  1881 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:02.081866  2665 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.082351  2665 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.083048  1881 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.084184 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:02.072203 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:02.088586 31028 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:02.083707 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.090251 31029 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:02.094746  2750 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.080s	user 0.003s	sys 0.001s
I20260709 13:16:02.094658  2725 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:02.096398 31571 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:02.098547  2709 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:02.099257  2709 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:02.099809 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.100490 31024 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 6.
I20260709 13:16:02.100564  2418 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:02.100366  2709 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.056888  2675 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:02.102499 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.105396 31027 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:02.106711 31023 raft_consensus.cc:2376] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10. Re-sending same reply.
I20260709 13:16:02.111459  2557 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.115104 30875 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:01.970340  2610 consensus_queue.cc:1175] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95b998a6735f4180986a8b8f7d84b8fc" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:02.117434  2557 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:02.119994  2726 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:02.120719  2726 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:02.121270  2726 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.125298 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.126304 31023 raft_consensus.cc:2410] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:16:02.128150 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.128729 31024 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.129141 31023 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:02.130268 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.132093 31023 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:02.132824  2756 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:02.133966 31031 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:02.139231  2751 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.231s	user 0.000s	sys 0.003s
W20260709 13:16:02.147305 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.150218 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52089.4us
W20260709 13:16:02.157986 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 96128us
W20260709 13:16:02.158867 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 74778.1us
I20260709 13:16:02.164242  2763 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.164425  2760 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.164836  2763 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.166180  1881 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.166682  1881 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.168715  1881 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:02.170159  2747 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 13:16:02.170621  2684 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:02.165280 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 98331.5us
I20260709 13:16:02.156277 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:02.176883 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:02.182664 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:02.189579  2493 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.189734 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:02.190454 31605 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:02.189764 31027 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:02.192240 31029 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:02.192317 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:02.196249 31032 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:02.191648 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:02.163249  2558 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.199821  2686 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.204509 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.205740 31029 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:02.233022 30954 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:02.206331 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.208451 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:02.164862  2760 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:02.235733 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 79560.1us
I20260709 13:16:02.234875 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.237203 31024 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:16:02.240198 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 172032us
W20260709 13:16:02.243114 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 44494.3us
W20260709 13:16:02.248975 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89198.6us
I20260709 13:16:02.249917 31028 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:02.250835 31030 raft_consensus.cc:2393] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:02.249984 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:02.258203 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.182180  2713 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.262166 31027 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:02.247256  2481 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:02.272689 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 64334.3us
I20260709 13:16:02.250664  2706 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:02.275974 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:02.279538 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 102765us
I20260709 13:16:02.280972 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.284001  2558 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:02.285245 30879 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:02.286334 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.288481 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.289255 31032 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:16:02.263180  2635 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:02.258972  2763 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:02.292400 31025 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:02.272015  2493 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:02.293308 31605 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:02.291545  2545 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.300622 31027 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:02.300850 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:02.292685 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.278167  2688 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.332110 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 268328us
I20260709 13:16:02.345160 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:02.345814 30954 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.304396  2720 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:02.339787 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:02.344172 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 94298.7us
I20260709 13:16:02.331609 30847 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:02.279949  2706 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:02.339812 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:02.356611 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.327149  2746 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:16:02.361887 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.365962 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:02.362739 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.371227 30880 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:02.305567  2685 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:16:02.372511 30954 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:02.305912  2292 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:16:02.328279  2442 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:16:02.349792  2706 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.364393  2690 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:02.465276 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:02.467242  2766 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:02.375916  2725 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:02.472373  2725 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:02.474035  2725 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.360411  2760 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.476315  2761 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:16:02.477197  2760 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.345922  2688 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.482525  2688 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:02.476366  2726 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.463788  2690 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:02.486399  2656 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.489100  2726 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:02.527460 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:02.506307  2674 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.557832 30848 connection.cc:256] RPC call timeout handler was delayed by -1.2093275499998981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:16:02.568523 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.569659 31027 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:02.551522  2493 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:02.575405  2493 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:02.577476 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 285881us
I20260709 13:16:02.583462 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.585419 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.525137  2548 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:16:02.592293 31032 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:02.593356  2292 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:02.594509  2688 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:02.595362 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.609931 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:02.622910 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.624095  2685 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:02.624275  2292 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.624770  2292 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.625134  2292 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.626173  2684 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:02.609299  2709 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:02.628052  2709 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:02.628444  2709 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:02.632390  2685 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:02.632874  2713 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:02.634497  2769 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:16:02.634133 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:02.635560  2774 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:02.637667  2765 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:16:02.646083  2686 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:02.647969 31600 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:02.648660 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.650421  2726 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:02.651257  2726 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:02.653707 30880 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:16:02.654079 30880 pending_rounds.cc:85] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 5
I20260709 13:16:02.654304 30880 pending_rounds.cc:107] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:16:02.654518 30880 raft_consensus.cc:2889] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.651585  2726 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:02.655411  2726 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.656133 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.656601  2726 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:02.656876 30875 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:02.657733 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.658495 30879 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:02.655627 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.650265  2706 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.660063 30878 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:02.660408 31600 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:02.662231  2706 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:02.662734  2743 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 13:16:02.663136  2743 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.664424 31604 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:02.666352 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:02.667137  2686 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:02.668743  2686 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:02.669165  2686 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:02.669595  2686 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.571626  2674 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.673607  2674 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:02.674952  2690 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.676383  2690 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.676636 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.677883 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.679018 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.679564 30875 raft_consensus.cc:2376] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10. Re-sending same reply.
I20260709 13:16:02.681484 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:02.681905  2545 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:02.682341  2545 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:02.682529  2706 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:02.683209  2706 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:02.684453  2706 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.688115 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.688922 31024 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:02.689638  2656 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:02.690231 31030 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:16:02.690723 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.691255 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.692642 31032 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:02.696246 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.698661  2743 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:02.561990  2635 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:02.699355  2481 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.700096 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.703594 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:02.703979  2557 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:02.706058  2761 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:02.705940  2656 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:02.708446 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.726136 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.726313 30874 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:02.709009 30880 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:02.726928 30882 raft_consensus.cc:2410] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:02.709158  2664 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.728858 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.709185 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.709393  2720 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:02.647949  2742 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:02.715723 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.683166  2545 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.731639 30883 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:02.731680 30881 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:02.591091  2442 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:02.699342 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:02.719516 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 418722us
I20260709 13:16:02.722584 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.724251 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.728155 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:02.734267 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 278817us
I20260709 13:16:02.735683 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.736881 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:02.737429 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 463569us
I20260709 13:16:02.740665  2736 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:02.740823 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.741096  2736 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.741266  2675 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:02.741489  2736 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.741715  2675 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:02.733525  2665 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.008s
W20260709 13:16:02.746063 30997 leader_election.cc:336] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.585s (SENT)
I20260709 13:16:02.746366 31604 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:02.743129 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:02.763907 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.750236 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:02.763012 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:02.731350  2742 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:02.790836 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.739223  2754 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.733180  2442 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:02.743705  2743 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:02.797739 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:02.799608 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 62785.5us
W20260709 13:16:02.799832 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.800788 30879 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:02.800911 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51356.5us
I20260709 13:16:02.802879 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.803954 30875 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:02.811414 31032 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:02.800417 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.728693  2686 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.817813 30882 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:16:02.818610 30952 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:02.819003 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.840253 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:02.815102 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.832190 30954 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:02.799608 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:02.842521 30953 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.842952  2545 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:02.846351 31024 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:02.847402 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.799625  2779 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:02.848150  2779 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.848531  2779 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.848932  2713 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.849501  2713 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.799211  2442 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.852005  2635 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.738888  2481 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.854974  2481 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:02.742664  2675 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.743117  2665 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.857281  2686 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:02.857434  2742 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.792109  2418 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:02.858459  2742 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:02.858563  2418 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:02.789920  2674 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:02.859521  2418 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.861034 30876 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:02.862318 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.862530 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.862895 30874 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.863596 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.864176 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.868199  2557 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.869187 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52388.7us
W20260709 13:16:02.842381 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 110486us
I20260709 13:16:02.789244  2746 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:02.806224  2754 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:02.879263 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 311015us
I20260709 13:16:02.760877  2712 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:16:02.733242  2664 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.743110  2759 consensus_queue.cc:1059] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:16:02.922848 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.855629  2481 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:02.923574 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.924127 30875 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:02.923574 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:02.943889 31031 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:02.868724  2557 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:02.930971 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:02.931170 31024 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:02.945106 30874 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
W20260709 13:16:02.931159 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.932999 31028 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:02.938681 30953 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:02.953223 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.954089 30875 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:02.917852  2713 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:02.961652 30881 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:02.959841 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:02.984745 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.987802 31023 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:02.990077 30876 raft_consensus.cc:2410] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:02.950769  2772 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.992491 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:02.997220 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:02.957430  2774 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:02.958765  2746 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:02.928555  2292 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:02.990655  2493 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:03.016561 30876 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:03.034703 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:03.022899 30881 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:02.871057  2782 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.150s
I20260709 13:16:03.032752  2781 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:16:03.039445 30874 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:02.999267  2481 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:03.106689 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 236293us
I20260709 13:16:02.966229  2442 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.017578  2684 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:03.024539  2635 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:03.134729 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 291614us
I20260709 13:16:03.136660 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:03.137822 30997 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.722s (SENT)
I20260709 13:16:03.142370 30874 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:03.145426 31024 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
W20260709 13:16:03.148116 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.094452  2679 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:16:03.154618 30954 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:03.021072  2772 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:03.160030 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 319866us
I20260709 13:16:03.121182  2720 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:16:03.177551 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 48312.1us
W20260709 13:16:03.178978 30997 leader_election.cc:336] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.790s (SENT)
I20260709 13:16:03.190061 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:03.131036  2684 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.156025  2610 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.193332 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:03.193943 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:03.197062 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:03.172369  2688 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.194977  2712 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.147399  2779 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.217484 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:03.227525 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.228632 30953 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:03.236052 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:03.249065 30952 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:03.204944  2784 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.250877 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:03.253430  2493 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:03.253203 30878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.002s	sys 0.009s
W20260709 13:16:03.255523 30878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.002s	sys 0.009s
I20260709 13:16:03.260623 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.218727  2782 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.261075 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.261569 30954 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:03.260705 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.221813  2781 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.264034 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:03.271282 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.265973 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.264072 30949 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:16:03.268375 30951 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:03.266322 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.280310 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.281169 30950 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:03.279541 30874 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:03.272145 30957 raft_consensus.cc:2376] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10. Re-sending same reply.
I20260709 13:16:03.223198  2788 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:03.238340  2557 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:03.206614  2610 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.253816  2784 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.291023 30879 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
W20260709 13:16:03.288203 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 98264.8us
I20260709 13:16:03.177634  2774 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.221812  2688 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:03.306957  2798 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:16:03.192736  2746 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.285383 30958 raft_consensus.cc:2376] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10. Re-sending same reply.
W20260709 13:16:03.315531 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.265097  2780 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:03.257565  2706 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:03.314278 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.296314  2679 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:03.251456  2712 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.314406 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:03.220927  2481 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.319067 30951 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:16:03.304566  2292 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:03.305203  2788 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:03.307648  2493 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:03.338459 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.285172  2782 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:03.323611 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.331670 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.338408  2803 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:03.339432  2793 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:16:03.339702 30955 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:03.281265  2781 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:03.342747 30875 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:03.319332  2442 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.321357  2679 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.331246 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:03.566396 30874 raft_consensus.cc:606] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:03.566992 30874 raft_consensus.cc:614] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:03.386821  2787 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:16:03.332182  2780 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:03.323565 30951 pending_rounds.cc:85] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:16:03.571370 30951 pending_rounds.cc:107] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:16:03.571732 30951 raft_consensus.cc:2889] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:03.542972  2545 consensus_meta.cc:287] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.007s
I20260709 13:16:03.333943  2664 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.392043  2811 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:03.341437 30997 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.019s (SENT)
I20260709 13:16:03.292205  2790 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.222s
W20260709 13:16:03.478679 30880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.024s
W20260709 13:16:03.586074 30880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.004s	sys 0.027s
I20260709 13:16:03.515174 30950 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:03.515815 31024 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:03.323530  2809 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.525507  2688 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:03.517565  2557 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.329720  2795 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:03.567494  2679 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:03.529258 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:03.530442  2800 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.331s	user 0.000s	sys 0.007s
I20260709 13:16:03.504930  2635 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:03.518132  2292 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:03.580508 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.553696  2558 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.529070  2712 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.592271 30950 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10.
W20260709 13:16:03.517463 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 380855us
I20260709 13:16:03.523336  2779 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.525713  2784 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:03.528244 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 311494us
W20260709 13:16:03.581274  2743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.005s	sys 0.007s
I20260709 13:16:03.609198 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.579324  2754 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.612776 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:03.723124 31026 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:03.637130 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.596760  2790 consensus_queue.cc:1243] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:03.592396  2666 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:03.617570 30958 raft_consensus.cc:2376] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10. Re-sending same reply.
W20260709 13:16:03.757848 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 521889us
I20260709 13:16:03.758214 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.758581 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:03.599587  2442 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:03.657370 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:03.760814 31025 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:03.762190 31025 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:03.662882 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49882.2us
I20260709 13:16:03.665555 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.673748 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.767983 30951 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
W20260709 13:16:03.649684  2690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.021s
I20260709 13:16:03.683207 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ab89a799c64088901472d6633cfb83"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:03.769109 30874 raft_consensus.cc:606] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:03.684659  2743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.006s	sys 0.007s
I20260709 13:16:03.685842 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:03.695596 30956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 900) took 1362 ms (client timeout 1793 ms). Trace:
I20260709 13:16:03.524950  2788 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:03.698516  2776 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.845s	user 0.004s	sys 0.016s
I20260709 13:16:03.700637  2761 raft_consensus.cc:3055] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:03.613765  2795 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:03.711833 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 381566us
I20260709 13:16:03.682124  2808 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.712932 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.682580  2829 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:16:03.711398 31030 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:03.671932  2686 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:16:03.609843  2557 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:03.752658 31604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.049s
I20260709 13:16:03.619309  2688 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:16:03.755452 30924 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:03.665185  2558 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.755597 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:03.756158 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:03.665517  2292 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:03.758734 30958 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:03.586537  2684 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:03.770406 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:03.774256 30956 rpcz_store.cc:269] 0709 13:16:02.333674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.333826 (+   152us) service_pool.cc:224] Handling call
0709 13:16:03.695325 (+1361499us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54002b7d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:03.695492 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485190912}
I20260709 13:16:03.606765  2809 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.786549 31025 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:03.792209 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:03.616950  2772 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.798281 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:03.800848 30997 leader_election.cc:336] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.196s (SENT)
I20260709 13:16:03.772418  2743 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:03.803259 31604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.004s	sys 0.049s
W20260709 13:16:03.774371  2690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.006s	sys 0.021s
I20260709 13:16:03.606204  2811 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.788632  2761 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:03.801733 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:03.906388 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:03.802295  2829 consensus_queue.cc:1243] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:03.913434 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:03.912694 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 114491us
W20260709 13:16:03.820230 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.940593  2776 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:16:03.906641 31030 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:03.938263 30950 raft_consensus.cc:2368] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10.
I20260709 13:16:03.803866  2665 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:03.931320  2784 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:03.997184  2784 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.997591  2784 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:03.955826  2742 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.097s	user 0.015s	sys 0.000s
I20260709 13:16:03.796525  2664 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:03.952642 31602 raft_consensus.cc:2410] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:03.834458  2821 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:03.779945  2442 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.021049 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.022457 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.022943  2442 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:03.958314 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 199785us
W20260709 13:16:03.807255 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51882.6us
I20260709 13:16:04.025961 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:04.027100 30924 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:03.939718  2736 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.198s	user 0.014s	sys 0.004s
I20260709 13:16:04.028241 31605 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:04.028164  2736 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:04.028982  2743 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.029927  2790 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:04.030386  2736 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:04.031945  2838 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:04.033787  2666 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:04.034734  2666 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:04.035058  2666 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:04.035223 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2059) took 1328 ms. Trace:
I20260709 13:16:04.035929  2665 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:04.036489  2810 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:16:04.036859  2665 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:04.036588  2292 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.037691  2726 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:04.037779  2665 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:04.038307  2665 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:04.038753  2836 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:04.039292  2836 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.040071  2831 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:04.040540  2831 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:04.041571  2813 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.242s
I20260709 13:16:04.041466  2831 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:04.042506  2557 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.042670  2831 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:04.031345  2761 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:04.045387  2675 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:04.045955  2761 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:03.941268  2709 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.312s	user 0.009s	sys 0.009s
I20260709 13:16:03.945951  2635 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:03.996356 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:03.796578  2706 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:16:03.828270 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:03.835078  2779 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:03.796340  2763 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
I20260709 13:16:03.806128  2545 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.167s
I20260709 13:16:04.012858 31032 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:04.013765 30958 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:03.940560  2684 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:16:04.046059  2819 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:16:03.753329  2780 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.023538 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.035517 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:04.112334 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 76892.3us
I20260709 13:16:03.802557  2808 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:03.904749 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.113897 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:04.038201  2726 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:04.035674 30878 rpcz_store.cc:276] 0709 13:16:02.707040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.709929 (+  2889us) service_pool.cc:224] Handling call
0709 13:16:02.710190 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.257731 (+547541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.257777 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.300523 (+ 42746us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.588950 (+288427us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:03.589006 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.589113 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.034987 (+445874us) raft_consensus.cc:1685] finished
0709 13:16:04.035005 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.035138 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71860,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7953,"thread_start_us":827847,"threads_started":2,"wal-append.queue_time_us":606238}
I20260709 13:16:04.076669 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:04.115581 30879 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.081835 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:04.104974 31026 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:04.046654  2829 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.117974 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:04.113646 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:04.120034 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 93012.5us
W20260709 13:16:04.108278 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 316908us
I20260709 13:16:04.122520 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.123219 30958 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:04.135812 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.067656 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.137010 30951 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.113974 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:03.998276  2754 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.039224  2665 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:04.149637 30950 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:04.133203 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:04.133682 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51982.9us
I20260709 13:16:04.150683 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.067655 31598 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:04.151407 30956 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:04.154160 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 362471us
I20260709 13:16:04.142287 30879 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:04.107776  2685 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.144768 31605 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:04.046797  2742 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:04.149139 30997 leader_election.cc:336] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.237s (SENT)
I20260709 13:16:04.159735 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:04.161845 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2053) took 1877 ms. Trace:
I20260709 13:16:04.162015 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.123909  2688 consensus_queue.cc:1243] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:04.162743 30955 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:04.117475  2790 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:04.066803  2664 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.182399 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 61044.6us
I20260709 13:16:04.136525  2557 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:04.067132  2709 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.110688  2779 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:04.183354 30997 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.264s (SENT)
I20260709 13:16:04.198313 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.190352 30958 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.185128 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2139) took 1317 ms. Trace:
I20260709 13:16:04.201275 31031 rpcz_store.cc:276] 0709 13:16:02.862489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.863442 (+   953us) service_pool.cc:224] Handling call
0709 13:16:02.863716 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.944265 (+ 80549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.179685 (+1235420us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54003791d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:04.179914 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183494016}
I20260709 13:16:04.210543 31598 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:04.210652 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89810.2us
I20260709 13:16:04.211037 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.194948  2784 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.213696 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:04.147361  2842 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.133414  2807 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:04.170060  2813 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:04.221329 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.222157 30955 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:04.181772  2713 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:04.162262 30877 rpcz_store.cc:276] 0709 13:16:02.283998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.284734 (+   736us) service_pool.cc:224] Handling call
0709 13:16:02.285100 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.285517 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:02.296791 (+ 11274us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.566356 (+269565us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.585499 (+ 19143us) log.cc:844] Serialized 26 byte log entry
0709 13:16:02.585655 (+   156us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:02.585693 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.585757 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.697808 (+1112051us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:04.146221 (+448413us) raft_consensus.cc:1685] finished
0709 13:16:04.161642 (+ 15421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.161788 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11274,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":9672,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":11810,"spinlock_wait_cycles":44566144,"thread_start_us":213939,"threads_started":1,"wal-append.queue_time_us":468740}
I20260709 13:16:04.186802  2688 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:04.133823  2666 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:04.243939 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 120538us
I20260709 13:16:04.225554  2849 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:04.240775 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 57463.2us
I20260709 13:16:04.178565  2685 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.248521 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.247722 30956 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:04.249214 30955 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:04.248564 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.197702  2664 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.252358 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.132975  2829 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.239914 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:04.240535  2679 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.003s
I20260709 13:16:04.258136 30996 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:04.238883  2795 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.244436  2754 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.236757  2809 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.259758 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.260820 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.241030  2781 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.275497 31597 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:04.246124  2849 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:04.249528 30958 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:04.293639 31605 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:04.248526  2759 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:04.274603 30952 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.019s	sys 0.014s
W20260709 13:16:04.260345  2778 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.215s	user 0.053s	sys 0.106s
W20260709 13:16:04.282645 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.256065  2811 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.258508  2807 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.247785  2688 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.300908 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:04.301710 30952 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.019s	sys 0.014s
I20260709 13:16:04.300239 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.294616 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.239220  2813 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.315876 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.307802 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.316596 31605 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:04.317586 30956 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:04.309862 30958 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
W20260709 13:16:04.314956 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.305590 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47557.9us
W20260709 13:16:04.305820  2778 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.053s	sys 0.107s
I20260709 13:16:04.324772 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.328327 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.329322 30958 raft_consensus.cc:2368] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10.
I20260709 13:16:04.261188  2679 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.301406  2801 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:04.334197 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 87239.5us
I20260709 13:16:04.323011  2557 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:04.336620 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.343302 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:04.304064  2795 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:04.349226 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:04.321161  2784 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.358152 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1250) took 1224 ms. Trace:
I20260709 13:16:04.330498  2674 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:04.353252 30958 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.364456 31604 rpcz_store.cc:276] 0709 13:16:03.130282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.130487 (+   205us) service_pool.cc:224] Handling call
0709 13:16:03.130875 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.133573 (+  2698us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:03.147478 (+ 13905us) log.cc:844] Serialized 14 byte log entry
0709 13:16:04.220520 (+1073042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:04.226136 (+  5616us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.226295 (+   159us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:04.226342 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.226414 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.354207 (+127793us) raft_consensus.cc:1685] finished
0709 13:16:04.354225 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.354373 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21625,"prepare.queue_time_us":17579,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":172060,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":11740,"thread_start_us":1028053,"threads_started":2,"wal-append.queue_time_us":846622}
I20260709 13:16:04.384481 30955 raft_consensus.cc:2410] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:04.390534  2829 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:04.392130  2840 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
W20260709 13:16:04.394969  2844 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:16:04.305393  2759 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.397931  2759 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.319432  2807 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.400509  2807 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.347203  2795 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:04.405510 30956 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:04.406455 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 913) took 1077 ms. Trace:
I20260709 13:16:04.406863 30956 rpcz_store.cc:276] 0709 13:16:03.329267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.357778 (+1028511us) service_pool.cc:224] Handling call
0709 13:16:04.405252 (+ 47474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.406139 (+   887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.406380 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:04.412755 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.413810 31604 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:04.364678  2690 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:04.422138 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 255962us
I20260709 13:16:04.378264  2674 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.341332  2557 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:04.479135  2828 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:16:04.420007  2807 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:16:04.479022 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:04.479542 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.422474  2759 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:04.480268 31026 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 5.
I20260709 13:16:04.427628 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 911) took 1594 ms. Trace:
I20260709 13:16:04.480571 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.424496  2690 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:04.481426 31030 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:16:04.481727 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 763) took 1360 ms. Trace:
I20260709 13:16:04.482502  2690 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.483860  2690 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.484881 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.485674 31028 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:04.428468  2674 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.487993  2779 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.424080 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:04.490336 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66337.3us
I20260709 13:16:04.490718 31604 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
W20260709 13:16:04.492659 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.467099 31027 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:04.495186 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:04.452301 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48318.1us
I20260709 13:16:04.468634 30951 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:04.497192 30955 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:04.481087 30880 rpcz_store.cc:276] 0709 13:16:02.832753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.837730 (+  4977us) service_pool.cc:224] Handling call
0709 13:16:02.838139 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.868419 (+ 30280us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:02.868726 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.592927 (+724201us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.593188 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.593331 (+   143us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.666556 (+ 73225us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.666747 (+   191us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:03.666996 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.667192 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.667282 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.040841 (+373559us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b180022b9a0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:04.427381 (+386540us) raft_consensus.cc:1685] finished
0709 13:16:04.427403 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.427565 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6188,"prepare.queue_time_us":8764,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":83,"raft.queue_time_us":186042,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":50211,"spinlock_wait_cycles":13368064,"thread_start_us":717435,"threads_started":1,"wal-append.queue_time_us":965525}
I20260709 13:16:04.512626 30958 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:04.518102 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.416489  2849 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.520777  2688 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.521418  2849 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.524050  2871 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:04.524832  2871 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:04.528324 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 148174us
I20260709 13:16:04.528999 30956 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:04.529166 30997 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10.
I20260709 13:16:04.529472 30997 leader_election.cc:403] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.482161 31023 rpcz_store.cc:276] 0709 13:16:03.121750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.122325 (+   575us) service_pool.cc:224] Handling call
0709 13:16:03.136226 (+ 13901us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:03.152162 (+ 15936us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:03.282717 (+130555us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.527380 (+244663us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b18004bec20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f273eb2e58f 00007f2737b6d571 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd
0709 13:16:03.562709 (+ 35329us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:03.584735 (+ 22026us) log.cc:844] Serialized 78 byte log entry
0709 13:16:03.587202 (+  2467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:03.588196 (+   994us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.595822 (+  7626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.596023 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.481457 (+885434us) raft_consensus.cc:1685] finished
0709 13:16:04.481483 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.481668 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70624,"prepare.queue_time_us":144369,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":4399,"raft.queue_time_us":82950,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":28017,"spinlock_wait_cycles":5648768,"thread_start_us":264305,"threads_started":2,"wal-append.queue_time_us":698132}
I20260709 13:16:04.529582 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:04.530237 30958 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:04.425078  2827 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:16:04.533448 30958 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [6.5-8.6]
W20260709 13:16:04.531412 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.534970  2833 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:16:04.535090  2862 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:04.535672  2862 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.536065  2862 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:04.538708 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:04.539949 31604 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:04.536959 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2487) took 1702 ms. Trace:
I20260709 13:16:04.452054  2709 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.409524  2811 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
W20260709 13:16:04.548478 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.421583  2713 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:04.550643 30956 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:04.531972  2685 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.541718 30882 rpcz_store.cc:276] 0709 13:16:02.834205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.023635 (+189430us) service_pool.cc:224] Handling call
0709 13:16:03.024121 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.040055 (+ 15934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.040100 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.107227 (+ 67127us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.596502 (+489275us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:03.596650 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.597014 (+   364us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.536727 (+939713us) raft_consensus.cc:1685] finished
0709 13:16:04.536748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.536901 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17258,"raft.queue_time_us":196563,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":33190,"thread_start_us":453495,"threads_started":1,"wal-append.queue_time_us":935523}
I20260709 13:16:04.563257 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:04.567401 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:04.564448 31603 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
W20260709 13:16:04.554486  2761 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:16:04.573345 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:04.503757  2795 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:04.534152  2871 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:04.575559 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 46528us
I20260709 13:16:04.577096 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:04.577519 30956 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: [6.7-10.9]
I20260709 13:16:04.578569 31030 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:04.559597  2875 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.579788 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:04.580230 31031 raft_consensus.cc:606] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.589337 31030 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:04.589612 31031 raft_consensus.cc:614] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:04.582818  2870 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:16:04.582825 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.590663 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:04.584287  2857 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:16:04.584568  2868 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:04.585093  2853 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:16:04.586787  2792 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.318s	user 0.004s	sys 0.000s
I20260709 13:16:04.558961  2845 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:04.592077 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.595309 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.596107  2674 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:04.594071  2675 consensus_meta.cc:287] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.000s
I20260709 13:16:04.599021 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.561151  2807 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:16:04.599954  2795 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:04.600289 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:04.604679 30956 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:04.605281 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.616786 31027 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:04.606204 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.601769  2845 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.620836 31029 raft_consensus.cc:2410] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:04.621551 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:04.625900 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.627012 31028 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:04.635972 31030 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:04.638091 31025 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:16:04.641376  2831 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.003s
W20260709 13:16:04.643085 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 95070.3us
W20260709 13:16:04.645675 30848 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.625s (SENT)
I20260709 13:16:04.648082 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.648991 31026 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:04.596117  2866 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:04.647064 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.655114 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:04.656541 31030 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:16:04.653116  2675 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.658072  2675 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:04.658743 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.660300  2861 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.660758  2861 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.661567  2688 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.662046  2688 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.662879  2861 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.663375  2861 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:04.614634  2860 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:04.669605 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:04.670742 31030 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:04.674584 30997 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.905s (SENT)
I20260709 13:16:04.620172  2679 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.677946 30875 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:16:04.678227 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:04.699090 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.715147 30997 leader_election.cc:336] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.918s (SENT)
I20260709 13:16:04.716400 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.680580 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:04.679966  2780 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:16:04.719688 30874 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:04.720214 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:04.720662 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 75028.3us
I20260709 13:16:04.720958 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:04.721293 30848 leader_election.cc:336] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.648s (SENT)
I20260709 13:16:04.721534 30875 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:04.723273 30848 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.016s (SENT)
I20260709 13:16:04.728062  2688 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.733764 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:04.654198  2866 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:04.655782  2864 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.743912 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2670) took 1555 ms. Trace:
I20260709 13:16:04.744413 31030 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:04.744407 31024 rpcz_store.cc:276] 0709 13:16:03.188868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.781563 (+592695us) service_pool.cc:224] Handling call
0709 13:16:03.829965 (+ 48402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.933185 (+103220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.933229 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.948087 (+ 14858us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.242862 (+294775us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:04.242909 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.242981 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.743675 (+500694us) raft_consensus.cc:1685] finished
0709 13:16:04.743695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.743848 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35984,"raft.queue_time_us":27625,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6346,"thread_start_us":137907,"threads_started":1,"wal-append.queue_time_us":343621}
I20260709 13:16:04.747180 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 903) took 1965 ms. Trace:
I20260709 13:16:04.676180  2860 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.747589 30949 rpcz_store.cc:276] 0709 13:16:02.774454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.774584 (+   130us) service_pool.cc:224] Handling call
0709 13:16:02.774908 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.275948 (+501040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.739926 (+1463978us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540027f954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:04.740210 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124425984}
I20260709 13:16:04.749063 30949 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:04.742414 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:04.732976  2868 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.743916  2746 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:04.637182  2713 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:04.762221 30949 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:04.763689 30951 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:04.667393  2861 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:04.766650 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51565.5us
I20260709 13:16:04.748106  2866 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.753579  2870 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:04.774312 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:04.749308  2860 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.755903  2675 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.777956 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:04.782060 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58807.6us
W20260709 13:16:04.784055 30848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.061s (SENT) [suppressed 48 similar messages]
I20260709 13:16:04.787530 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:04.773604  2868 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.776989  2679 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:04.777153  2746 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:04.757547  2847 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:16:04.785673  2872 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:04.804579  2872 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.807049  2872 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.803521  2746 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.802367 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:04.811951  2742 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:04.812474  2742 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:04.813294  2742 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.814198  2610 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.796983  2686 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:04.816263  2686 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:04.816542 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.816835  2686 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:04.786593  2688 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:04.819809  2674 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.820127  2688 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:04.820768  2688 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:04.822562  2845 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:04.788648  2846 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:04.828123  2846 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.828657  2846 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:04.830639 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:04.833251 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 914) took 1490 ms. Trace:
I20260709 13:16:04.816272  2836 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.833694 30955 rpcz_store.cc:276] 0709 13:16:03.343052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.385714 (+1042662us) service_pool.cc:224] Handling call
0709 13:16:04.496924 (+111210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.497741 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.833052 (+335311us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540002fb50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:04.833186 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254605568}
I20260709 13:16:04.835362 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2068) took 1917 ms. Trace:
I20260709 13:16:04.751758  2864 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.789587  2869 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:04.835778 30876 rpcz_store.cc:276] 0709 13:16:02.917612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.143690 (+226078us) service_pool.cc:224] Handling call
0709 13:16:03.144115 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.155930 (+ 11815us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:03.181187 (+ 25257us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.516478 (+335291us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.536799 (+ 20321us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.536983 (+   184us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:03.537032 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.537121 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:04.831034 (+1293913us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b240013a828. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f27379f39c4 00007f27379f1acb 00007f2737bacdc9 00007f2737baca55 00007f2737babfb0 00007f273a822488 00007f273a822be8 00007f273a7fa398 00007f273a7f576a 00007f273a7f4bb6
0709 13:16:04.835041 (+  4007us) raft_consensus.cc:1685] finished
0709 13:16:04.835153 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.835296 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210125,"prepare.queue_time_us":29864,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":349462,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":9274,"spinlock_wait_cycles":149213440,"thread_start_us":101601,"threads_started":1,"wal-append.queue_time_us":820863}
I20260709 13:16:04.790302  2780 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:16:04.836215  2801 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:04.876766 30876 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:16:04.880308  2878 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:04.885587  2804 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:04.886747  2791 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.744s	user 0.004s	sys 0.000s
I20260709 13:16:04.888847 31023 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:04.889835 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:16:04.905460 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 67938.4us
I20260709 13:16:04.876825  2879 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.894145  2780 consensus_queue.cc:1243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:16:04.915859  2783 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:04.921202  2783 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.921569  2783 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:04.918190 30997 leader_election.cc:336] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.246s (SENT)
I20260709 13:16:04.925328  2686 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.929639  2686 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:04.930850  2847 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:04.931465  2889 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:04.901476  2804 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:04.911293  2835 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.080s	user 0.005s	sys 0.000s
I20260709 13:16:04.937645 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.933015 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:04.947167 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.894259  2869 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.955715 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:04.964632  2888 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:04.976184  2713 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.976919  2713 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.979159  2713 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.985879  2786 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:04.956876 30877 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:04.916515  2743 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:16:04.904116  2801 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.000082  2801 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:04.917313  2879 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:04.997599  2869 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.000353  2875 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10.
I20260709 13:16:05.004614 30877 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:04.945240  2686 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:16:04.994565  2690 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.005s
I20260709 13:16:05.008641  2864 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.012171  2861 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.006551  2804 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.017570  2866 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.040778  2869 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:05.046690  2869 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:05.004428  2846 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.070981  2780 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.071658  2780 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.074155  2780 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:05.075523 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 166622us
I20260709 13:16:05.002983  2879 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:05.077404 30997 leader_election.cc:336] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.962s (SENT)
I20260709 13:16:05.077697 30877 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:05.078208 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:04.999555  2862 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:05.075727  2849 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.554s	user 0.016s	sys 0.005s
W20260709 13:16:05.092545 30997 leader_election.cc:336] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.997s (SENT)
I20260709 13:16:05.093086 30997 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:05.088181  2805 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.097117  2879 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.097329  2875 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.097885 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.091440  2871 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.080161  2783 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.103093  2869 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:05.102921  2875 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.104080 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:05.104409  2783 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.105225  2875 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.107878  2813 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:05.111918 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:05.112660 31025 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:05.115120  2545 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:05.115602  2545 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:05.116113  2862 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.116459  2545 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.117944  2545 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.119449  2558 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.120038  2558 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.120088  2866 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.120565  2558 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:05.122712  2558 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:05.102178  2805 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.124923 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.125607 31602 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:05.126045  2805 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.126493 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.127120 31602 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:05.127859 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.128021 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.128476 31600 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:05.128539 31599 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:05.128774 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.129175 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.129513 31603 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:05.130831 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.131649 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2135) took 2270 ms. Trace:
I20260709 13:16:05.132057 31032 rpcz_store.cc:276] 0709 13:16:02.861216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.861358 (+   142us) service_pool.cc:224] Handling call
0709 13:16:02.861645 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.067145 (+1205500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.131399 (+1064254us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540009e2d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:05.131565 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2614955776}
I20260709 13:16:05.132894 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.133740 31597 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:05.134868  2805 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:05.138183 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.138586  2854 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:05.138999 31604 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:05.139029  2854 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:05.140089  2854 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.141129  2854 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.141439 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.142277  2759 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:05.142660  2759 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.142983  2759 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:05.147342  2873 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.562s	user 0.002s	sys 0.002s
W20260709 13:16:05.152544 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.152693 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.129509 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:05.158166 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.159319 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.159067 31604 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:05.160092 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:05.159312 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:05.161024 31600 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:05.161316 30879 raft_consensus.cc:606] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:05.161705 30879 raft_consensus.cc:614] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.163185 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:05.164520 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:05.165089 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:05.165673 31602 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:05.165864 31032 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:05.154109 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.169500 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:05.170529 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.172427 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:05.173054 31028 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:05.173666  2871 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:05.174664  2871 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.175983  2871 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.177238 31024 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:05.152256  2664 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.178714 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:05.182273 31027 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:05.180482 31026 pending_rounds.cc:85] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 7
I20260709 13:16:05.183275 31026 pending_rounds.cc:107] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:16:05.183549 31026 raft_consensus.cc:2889] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.182796 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.183084 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:05.151311  2759 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.185873 31028 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:05.186003 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.189450 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.164106  2558 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:05.181867  2808 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.203819 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1094) took 1093 ms. Trace:
W20260709 13:16:05.204516 30950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2179) took 1464 ms (client timeout 1713 ms). Trace:
I20260709 13:16:05.169718  2688 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.164989  2869 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:16:05.204962 30950 rpcz_store.cc:269] 0709 13:16:03.740205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.996081 (+255876us) service_pool.cc:224] Handling call
0709 13:16:05.204351 (+1208270us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b54001955d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:05.204453 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228633472}
I20260709 13:16:05.210085 31032 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:05.211326 31030 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:05.196300  2558 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.195816  2861 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:05.204275 31601 rpcz_store.cc:276] 0709 13:16:04.112979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.122680 (+  9701us) service_pool.cc:224] Handling call
0709 13:16:04.123014 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:04.278272 (+155258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:04.278304 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:04.293231 (+ 14927us) log.cc:844] Serialized 26 byte log entry
0709 13:16:04.340921 (+ 47690us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:04.340983 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.203363 (+862380us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54006a4854. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:05.203418 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:05.203470 (+    52us) raft_consensus.cc:1685] finished
0709 13:16:05.203486 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.203724 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24355,"raft.queue_time_us":23877,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6216,"spinlock_wait_cycles":337120512,"thread_start_us":25202,"threads_started":1,"wal-append.queue_time_us":115940}
I20260709 13:16:05.210220  2846 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.213658  2861 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.213801  2558 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:05.232698 30883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:05.233975 30883 raft_consensus.cc:606] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:05.235450 31027 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:05.221431  2826 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:05.220208  2664 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:05.247094  2825 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:05.247565  2825 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:05.250694  2805 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:05.252177  2805 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:05.253168  2801 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:05.253548  2801 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:05.254415  2801 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.256994  2688 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.260887 30847 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:05.235379  2861 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.262790 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:05.273563 30958 raft_consensus.cc:1217] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[9.8-11.9]   Dedup: 11.9->[]
I20260709 13:16:05.274080 30958 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:16:05.264967  2860 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:05.264875  2726 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.266664  2805 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:05.268437 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 919) took 1676 ms. Trace:
I20260709 13:16:05.271750 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 911) took 1968 ms. Trace:
I20260709 13:16:05.285420 30951 rpcz_store.cc:276] 0709 13:16:03.592238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.497232 (+904994us) service_pool.cc:224] Handling call
0709 13:16:04.497622 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.764932 (+267310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.268079 (+503147us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540008c5d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:05.268364 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611429760}
W20260709 13:16:05.272493  2901 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:16:05.285488 30953 rpcz_store.cc:276] 0709 13:16:03.303309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.328592 (+ 25283us) service_pool.cc:224] Handling call
0709 13:16:03.344503 (+ 15911us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:03.637107 (+292604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.637146 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:03.723168 (+ 86022us) log.cc:844] Serialized 78 byte log entry
0709 13:16:04.117073 (+393905us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:04.158218 (+ 41145us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.133407 (+975189us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b1800112000. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:05.271245 (+137838us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b1800112000. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:16:05.271428 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.271495 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:05.271534 (+    39us) raft_consensus.cc:1685] finished
0709 13:16:05.271546 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.271694 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181211,"prepare.queue_time_us":43388,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1306913,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":14833280,"thread_start_us":402630,"threads_started":2,"wal-append.queue_time_us":441655}
I20260709 13:16:05.259658  2801 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:05.306128 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 1.09239e+06us
I20260709 13:16:05.308413 30875 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.308547 30883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:05.280651  2866 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:05.311547 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:05.281409  2442 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:05.314086 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1791) took 2064 ms. Trace:
I20260709 13:16:05.292948  2805 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.313135  2726 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.260553  2664 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.316300 30952 rpcz_store.cc:276] 0709 13:16:03.249909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.255125 (+  5216us) service_pool.cc:224] Handling call
0709 13:16:03.270447 (+ 15322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.303879 (+ 33432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.303918 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.306824 (+  2906us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.573191 (+266367us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:04.309253 (+736062us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.313787 (+1004534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.313864 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:05.313903 (+    39us) raft_consensus.cc:1685] finished
0709 13:16:05.313916 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.314032 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1150369,"prepare.queue_time_us":458932,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":1050768,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":35538,"thread_start_us":963117,"threads_started":2,"wal-append.queue_time_us":736304}
W20260709 13:16:05.321080 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 651764us
I20260709 13:16:05.313669  2866 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.318255  2805 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.325510 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:05.328639 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1792) took 2078 ms. Trace:
I20260709 13:16:05.318686  2784 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.316246  2442 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:05.331634 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:05.332518 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:05.352800 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:05.248431  2825 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.354102 30949 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:05.360357 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:05.323390  2866 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.369120 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:05.328200  2790 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.357761  2442 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.375203 30952 pending_rounds.cc:85] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 6
I20260709 13:16:05.376760 30952 pending_rounds.cc:107] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:05.377133 30952 raft_consensus.cc:2889] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.333271  2481 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:05.382882  2903 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:05.385174  2859 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:16:05.390618  2799 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.391323  2905 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:05.391891  2664 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.371955  2809 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.398535 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:05.357200  2784 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.368759  2825 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:05.372545  2836 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.322968  2635 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:16:05.374101  2794 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:05.422799 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 111335us
I20260709 13:16:05.432868  2860 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.392766  2809 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.446023  2784 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.399456  2790 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.450886  2790 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.404872  2797 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:16:05.453926 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:05.406018  2774 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:16:05.415668  2779 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:16:05.458508 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:05.459285  2779 consensus_queue.cc:1243] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:05.460013  2779 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:05.460542  2779 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:05.461709 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:05.461562  2779 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:05.416386  2836 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.470392  2836 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.391369  2799 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.473901  2799 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.474524  2848 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:05.474984  2848 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:05.446141  2809 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.475993  2848 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.476667 30955 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:05.477247  2848 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:05.482050 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.481976  2558 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.484519  2784 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:05.484699  2836 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:05.484485 30924 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:05.488068  2774 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:05.491806 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:05.493506 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.496104 31571 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:05.498667  2685 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:05.499607 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2184) took 1747 ms. Trace:
I20260709 13:16:05.500005 30958 rpcz_store.cc:276] 0709 13:16:03.752127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.534376 (+782249us) service_pool.cc:224] Handling call
0709 13:16:05.273389 (+739013us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:05.274429 (+  1040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.499401 (+224972us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400350f50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:05.499546 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698664832}
I20260709 13:16:05.502982 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:05.503242 31032 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:16:05.497418 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.504698  2558 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.506368 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:05.506969 31023 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:05.507402  2666 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.508183  2688 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:05.508725  2688 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.510988  2688 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.512336 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:05.512995 31030 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:05.514458 31023 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:05.329066 30954 rpcz_store.cc:276] 0709 13:16:03.250277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.279947 (+ 29670us) service_pool.cc:224] Handling call
0709 13:16:03.309544 (+ 29597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.340523 (+ 30979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.340571 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.382380 (+ 41809us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.746372 (+363992us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:04.261949 (+515577us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.328258 (+1066309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.328343 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:05.328401 (+    58us) raft_consensus.cc:1685] finished
0709 13:16:05.328419 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:05.328578 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1086645,"prepare.queue_time_us":285937,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":221092,"raft.run_cpu_time_us":40,"raft.run_wall_time_us":40,"thread_start_us":664137,"threads_started":2,"wal-append.queue_time_us":411283,"wal-append.run_cpu_time_us":2531,"wal-append.run_wall_time_us":1356061}
I20260709 13:16:05.505499 31027 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:05.525350 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:05.525982 31603 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:05.505875 31571 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:05.503703 31602 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:05.527956 30924 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:05.530629 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:05.531752  2871 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.532517 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.533288 31598 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:05.534770 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:05.537801 31603 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
W20260709 13:16:05.540545 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.542861 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.544087 30997 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:05.533973  2871 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:05.563655 31030 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:05.503675  2442 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:05.568888 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 63077.7us
I20260709 13:16:05.520346  2866 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:05.566313 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:05.534235  2779 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:05.645740 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.780478  2866 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.132865  2860 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:06.133446  2860 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.134356  2866 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.134987  2866 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:05.798487  2795 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:05.861344 30878 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:06.135515  2860 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.138780  2665 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:05.884241 31029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2141) took 3020 ms (client timeout 2675 ms). Trace:
I20260709 13:16:05.932225  2442 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:06.139977 31029 rpcz_store.cc:269] 0709 13:16:02.863069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.863365 (+   296us) service_pool.cc:224] Handling call
0709 13:16:05.883110 (+3019745us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001b21d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:05.883344 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4038896384}
W20260709 13:16:05.945984  2861 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.003s
I20260709 13:16:06.141052  2861 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.143404  2861 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:05.987159  2759 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:05.990149 30952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.020s
W20260709 13:16:06.144151 30952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.008s	sys 0.021s
I20260709 13:16:06.146723 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:06.010321  2818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.004s	sys 0.009s
W20260709 13:16:06.147581  2818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.004s	sys 0.010s
I20260709 13:16:06.010350 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.151361 30951 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:06.152515 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.153267 30951 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15.
I20260709 13:16:06.154111 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.154798 30951 raft_consensus.cc:2368] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11.
W20260709 13:16:06.021762 30956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.049s
I20260709 13:16:06.065549 30950 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:16:06.156699 30956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.011s	sys 0.050s
I20260709 13:16:06.157737 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:06.082966 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 538937us
I20260709 13:16:06.158576 30950 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:06.158738 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:06.084079  2558 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.159680  2759 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:06.084609  2842 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.085538  2875 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:06.160394  2759 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:06.160483  2842 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.160597  2875 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:06.161574  2759 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.162955  2842 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:06.094391 30949 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.162756  2875 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:06.085206 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 518940us
I20260709 13:16:06.164350 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.165491 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.166035 30949 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:16:06.166838 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.106340 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:06.111253 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.113646  2809 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.123757 30922 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.026s	sys 0.107s
I20260709 13:16:06.107125  2788 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:06.125063 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 553686us
I20260709 13:16:05.402412  2481 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:05.966645 30848 leader_election.cc:336] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.630s (SENT)
I20260709 13:16:06.159524 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.168056 30954 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.168762  2809 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.178145  2809 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:06.169170 30922 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.028s	sys 0.107s
W20260709 13:16:06.178990 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 863015us
I20260709 13:16:06.179486  2774 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:06.180156 30922 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.181496 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.182047  2774 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:06.182411  2779 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:06.182839  2774 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.183059  2779 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.199383  2779 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.202258  2774 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.209169 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2489) took 1390 ms. Trace:
I20260709 13:16:06.209677 30875 rpcz_store.cc:276] 0709 13:16:04.818544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.823183 (+  4639us) service_pool.cc:224] Handling call
0709 13:16:04.823538 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.308907 (+485369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.208866 (+899959us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54002ab054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:06.209093 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114666752}
I20260709 13:16:06.213143  2826 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:06.213817  2826 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:06.167508 30949 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:06.228946  2635 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.230556 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.186718  2713 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:06.169203 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.193907 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2187) took 2440 ms. Trace:
I20260709 13:16:06.169499  2788 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.170989 30950 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:06.170785 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.438547 30949 raft_consensus.cc:2410] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:06.183948  2784 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:06.199520  2493 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.440699 30956 rpcz_store.cc:276] 0709 13:16:03.753130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.622378 (+869248us) service_pool.cc:224] Handling call
0709 13:16:04.653915 (+ 31537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.321054 (+667139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.321087 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.360210 (+ 39123us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.157153 (+796943us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:06.193317 (+ 36164us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.193546 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.193626 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.193676 (+    50us) raft_consensus.cc:1685] finished
0709 13:16:06.193688 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.193840 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":690428,"prepare.queue_time_us":26646,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":661111,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":3547,"thread_start_us":794862,"threads_started":2,"wal-append.queue_time_us":684043}
I20260709 13:16:06.445798 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.446822 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.447613 30949 raft_consensus.cc:2410] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:06.449417 30954 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
W20260709 13:16:06.243314  2726 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.005s
I20260709 13:16:06.185379 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.155532 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.156188  2866 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.245388 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:06.460330 30883 raft_consensus.cc:606] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:06.461261 30883 raft_consensus.cc:614] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.250743  2664 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:06.466084  2831 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.466409 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.466197  2664 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.466655  2831 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.467054 30949 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:06.460513  2781 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:06.467955 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.468760  2664 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.471294 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57298 (request call id 31) took 1178 ms. Trace:
I20260709 13:16:06.471702 30883 rpcz_store.cc:276] 0709 13:16:05.292633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.292827 (+   194us) service_pool.cc:224] Handling call
0709 13:16:06.471098 (+1178271us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000d3ed4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac54853 00007f273fc2260a 00007f27391a87d4 00007f27391a8762 00007f27391a8691 00007f27391a860c 00007f27391a78c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:06.471210 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2647272192}
W20260709 13:16:06.472246 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 505605us
I20260709 13:16:06.250187  2665 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:06.251542  2803 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.252207 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.252488 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.253659 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.254812 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.469069 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.477147 31023 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:06.477720 30949 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:06.477981 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.262346 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.263067  2795 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:06.478447 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.478896 31027 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:16:06.479357 30949 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:06.264560 31604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.017s
W20260709 13:16:06.479728 31604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.008s	sys 0.017s
I20260709 13:16:06.480788 31025 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:06.481385 30949 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:06.481423 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:06.267627 31597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.003s	sys 0.007s
I20260709 13:16:06.483208 30949 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:06.483443 31597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.004s	sys 0.007s
I20260709 13:16:06.483599 30949 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:06.271951 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.272476 30958 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:06.278630 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 724166us
I20260709 13:16:06.280716  2690 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:06.283725  2854 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:16:06.284144  2545 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:16:06.287742 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.292140 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.293659 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 123501us
W20260709 13:16:06.303316 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.303736  2860 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.304557  2818 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.318029 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.516233 30953 raft_consensus.cc:2376] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9. Re-sending same reply.
I20260709 13:16:06.344435  2782 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.508682 30949 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.353107 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1793) took 3102 ms. Trace:
W20260709 13:16:06.479907  2801 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.170s	user 0.011s	sys 0.007s
I20260709 13:16:06.413338  2558 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.414202 30997 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.616s (SENT)
I20260709 13:16:06.537322 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:06.434360  2805 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.107s	user 0.019s	sys 0.000s
W20260709 13:16:06.435700 30780 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 247) took 21904 ms (client timeout 15000 ms). Trace:
I20260709 13:16:06.436916  2481 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.440351 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.441612 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.443979 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.551002 30950 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:06.452986 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 267670us
I20260709 13:16:06.553740 30922 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.453189 30951 raft_consensus.cc:2410] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:06.460206 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:06.461859 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:06.557127 30877 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.250200  2725 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:06.460742 30952 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:06.465204 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:06.264406 30879 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:06.558286 30954 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:06.472837 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.559413 30883 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:06.484007  2803 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.482365  2665 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.484117 30878 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:06.568970 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.491945 31031 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:16:06.569653 30879 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 7.
I20260709 13:16:06.484715 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.492918 31026 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:06.486243 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1113) took 1001 ms. Trace:
I20260709 13:16:06.489559 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:06.493788 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:06.573534 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 79872.9us
I20260709 13:16:06.490924 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:06.574697 31025 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.487589 30881 raft_consensus.cc:2410] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:06.490306 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:06.513008  2848 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.035s	user 0.016s	sys 0.000s
I20260709 13:16:06.487159 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.487936 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:06.582641 31028 raft_consensus.cc:2368] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14.
W20260709 13:16:06.398138 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.521286 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.585207 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:06.586548 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.587168 30879 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:06.522148 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:06.522969 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:06.473279  2826 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.517688  2860 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.568243  2725 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.593240  2826 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.520515  2818 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:06.594012  2725 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.554440  2558 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.595366  2818 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.596144  2292 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:06.596601  2292 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:06.524121 30949 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:06.525759  2788 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.526221  2813 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:06.526698  2679 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.517441  2664 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:06.527293 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:06.520035  2763 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:16:06.533620 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51442.3us
I20260709 13:16:06.533769 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:06.498104  2849 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:06.545087 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.460218  2635 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:16:06.596487  2558 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.562040  2754 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:06.533769  2690 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:06.562592 30956 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:06.550334 30874 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:06.597873 30876 raft_consensus.cc:2410] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:16:06.603672 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.626706 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:06.518419 30957 rpcz_store.cc:276] 0709 13:16:03.250826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.295568 (+ 44742us) service_pool.cc:224] Handling call
0709 13:16:03.312403 (+ 16835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.341140 (+ 28737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.341183 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.398451 (+ 57268us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.747943 (+349492us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:04.216952 (+469009us) log.cc:844] Serialized 14 byte log entry
0709 13:16:05.285059 (+1068107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.352579 (+1067520us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b54001e0d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:06.352640 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.352699 (+    59us) raft_consensus.cc:1685] finished
0709 13:16:06.352805 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.353003 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1136651,"prepare.queue_time_us":284550,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":1291563,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"spinlock_wait_cycles":16410496,"thread_start_us":464775,"threads_started":2,"wal-append.queue_time_us":412219,"wal-append.run_cpu_time_us":3675,"wal-append.run_wall_time_us":1448008}
I20260709 13:16:06.609337 30955 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:06.627660 30955 pending_rounds.cc:85] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 5
I20260709 13:16:06.627945 30955 pending_rounds.cc:107] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:06.628183 30955 raft_consensus.cc:2889] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:06.590270 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 69067.9us
I20260709 13:16:06.583930  2545 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:06.495258  2795 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.524055 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.525000  2686 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.578917  2493 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:06.603427  2664 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.640491  2804 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.580843 31570 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:06.641654  2664 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.602957  2813 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.644294  2813 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.646548 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.647872 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.648077 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.648535 30876 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:06.605170 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:06.571830 31597 rpcz_store.cc:276] 0709 13:16:05.484923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.486271 (+  1348us) service_pool.cc:224] Handling call
0709 13:16:05.486652 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.487056 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.487087 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.528763 (+ 41676us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.485907 (+957144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:06.485947 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.486020 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.486056 (+    36us) raft_consensus.cc:1685] finished
0709 13:16:06.486066 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.486188 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4197,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":949411,"threads_started":1,"wal-append.queue_time_us":522820}
I20260709 13:16:06.616600 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.617338  2665 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.650388 30883 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
W20260709 13:16:06.636077 30904 debug-util.cc:398] Leaking SignalData structure 0x7b080036b880 after lost signal to thread 29721
I20260709 13:16:06.603181  2679 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.638305  2686 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.626659 31031 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:06.649540 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.682762 30876 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
W20260709 13:16:06.546182 30780 rpcz_store.cc:269] 0709 13:15:44.530895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.531201 (+   306us) service_pool.cc:224] Handling call
0709 13:16:06.435577 (+21904376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:01.995682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:01.996382 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:01.996447 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:16:01.996469 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:02.001404 (+  4935us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:02.001518 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:02.001543 (+    25us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:16:02.003126 (+  1583us) tablet.cc:701] Row locks acquired
0709 13:16:02.003179 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:16:02.003357 (+   178us) write_op.cc:270] Start()
0709 13:16:02.003519 (+   162us) write_op.cc:276] Timestamp: P: 1783602962003285 usec, L: 0
0709 13:16:02.003537 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:02.069717 (+ 66180us) log.cc:844] Serialized 7374 byte log entry
0709 13:16:02.852189 (+782472us) op_driver.cc:464] REPLICATION: finished
0709 13:16:03.712426 (+860237us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f2737b500ac 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273e690ef0
0709 13:16:04.253359 (+540933us) write_op.cc:301] APPLY: starting
0709 13:16:04.260538 (+  7179us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:05.013179 (+752641us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:05.013223 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:05.258505 (+245282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:05.258882 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:16:05.258930 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:05.259368 (+   438us) log.cc:844] Serialized 172 byte log entry
0709 13:16:05.375215 (+115847us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.405549 (+ 30334us) write_op.cc:454] Released schema lock
0709 13:16:05.417291 (+ 11742us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:05.555664 (+138373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.555711 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2773994,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1360021,"apply.run_cpu_time_us":93236,"apply.run_wall_time_us":1298228,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77367,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":40805,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":19,"prepare.queue_time_us":93940,"prepare.run_cpu_time_us":14520,"prepare.run_wall_time_us":258084,"raft.queue_time_us":457916,"raft.run_cpu_time_us":160888,"raft.run_wall_time_us":1481939,"replication_time_us":848471,"spinlock_wait_cycles":58851584,"thread_start_us":1831647,"threads_started":5,"wal-append.queue_time_us":371920,"wal-append.run_cpu_time_us":30171,"wal-append.run_wall_time_us":2246909}]]}
I20260709 13:16:06.560983  2859 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:06.620329 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:06.686467 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 56911.8us
I20260709 13:16:06.624068 31025 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:16:06.687469 30876 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:06.687915 30879 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:06.688298 30879 pending_rounds.cc:85] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 5
I20260709 13:16:06.688565 30879 pending_rounds.cc:107] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:06.688794 30879 raft_consensus.cc:2889] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.624737 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.597077  2292 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:06.628183 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:06.704254 31599 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:06.610019 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.621205 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:06.628574 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 57623.4us
W20260709 13:16:06.673107 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68018.6us
I20260709 13:16:06.673377 30949 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:16:06.706573 30949 pending_rounds.cc:85] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:16:06.706821 30949 pending_rounds.cc:107] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:16:06.707034 30949 raft_consensus.cc:2889] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.597476 30882 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:06.618976 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:06.675827 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08001f71c0 after lost signal to thread 30815
I20260709 13:16:06.707264 30848 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:06.708305 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:06.708640 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcc60 after lost signal to thread 30907
W20260709 13:16:06.709043 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbc80 after lost signal to thread 30908
W20260709 13:16:06.710121 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7820 after lost signal to thread 30982
W20260709 13:16:06.710386 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800382e60 after lost signal to thread 30983
I20260709 13:16:06.711221 30876 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:06.711455 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800333000 after lost signal to thread 31056
W20260709 13:16:06.635890 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 54133.5us
I20260709 13:16:06.713894 30922 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:06.714241 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 104280us
W20260709 13:16:06.680712 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 266528us
I20260709 13:16:06.605032 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:06.623728 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.715229 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7340 after lost signal to thread 31057
I20260709 13:16:06.692850 30875 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:06.701318 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.610532  2635 consensus_queue.cc:1243] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:06.715700 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:06.729403 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 148597us
I20260709 13:16:06.724429 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.730388 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:06.635068  2782 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.721051 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3ca0 after lost signal to thread 31629
W20260709 13:16:06.743132 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5540 after lost signal to thread 31630
I20260709 13:16:06.743136 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:06.743127 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:06.744225 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.614086  2831 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.716495 30883 raft_consensus.cc:2410] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:16:06.751356 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:06.737277 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.752451 31025 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:06.567080  2805 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.681793  2664 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:06.738611 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:06.783210 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44662.5us
I20260709 13:16:06.742146 31030 raft_consensus.cc:2410] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:16:06.743945 30904 debug-util.cc:398] Leaking SignalData structure 0x7b080041d5c0 after lost signal to thread 2720
W20260709 13:16:06.784291 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800306b80 after lost signal to thread 2727
W20260709 13:16:06.785193 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800096e60 after lost signal to thread 2823
I20260709 13:16:06.734052 31604 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:16:06.745072 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.745450 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:06.749223 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:06.649192  2481 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:16:06.620649  2829 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.114s
W20260709 13:16:06.785930 30904 debug-util.cc:398] Leaking SignalData structure 0x7b080032c640 after lost signal to thread 2840
I20260709 13:16:06.728859  2545 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:06.789340 31028 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:06.733242  2665 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:06.821977 30881 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:06.824471 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:06.784653 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:06.756114 31024 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:06.811721 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800085160 after lost signal to thread 2847
I20260709 13:16:06.816258 30777 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:06.827415 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08003484c0 after lost signal to thread 2870
W20260709 13:16:06.827873 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800226760 after lost signal to thread 2876
I20260709 13:16:06.828377 30877 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:06.750411  2784 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.740950  2781 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.794302 31030 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:06.741308  2635 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.749651  2801 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:16:06.620586  2690 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:06.830816 30904 debug-util.cc:398] Leaking SignalData structure 0x7b0800316160 after lost signal to thread 2887
W20260709 13:16:06.864102 30904 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7160 after lost signal to thread 2892
I20260709 13:16:06.865247 31024 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:06.832535 30880 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:06.744398  2848 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:06.827982 30777 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.736013  2813 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:16:06.838236 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:06.840374 31031 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:06.740760  2854 consensus_queue.cc:1059] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:16:06.734557  2849 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:16:06.744467  2866 consensus_queue.cc:1059] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:16:06.811875  2825 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.811586  2845 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.871428 30777 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.790333  2831 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:16:06.833740  2809 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:06.896474 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.896749 30777 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:06.898232 30777 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:06.899195 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:06.812011  2785 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.900082  2785 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.901078 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.901787 31030 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:06.902240  2785 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:06.902771  2785 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:06.903990 31032 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:06.881117 31028 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:06.832052  2558 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.832197  2784 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.788621 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.908061 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.930749 30883 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:06.899612 30777 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.933251 30883 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:06.883827 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:06.933872 31031 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:06.903818 31030 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:06.933902 30777 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:06.754614  2782 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.835120  2781 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:06.880621  2916 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:06.903307  2785 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:06.951085 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.907297  2809 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.937590  2866 consensus_queue.cc:1243] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:06.931288  2635 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:06.896428  2493 raft_consensus.cc:2764] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:06.987112 30847 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:06.974380  2781 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:06.988849 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 237533us
I20260709 13:16:06.938387  2784 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.938242  2803 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:06.992415 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:06.999724 30875 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:06.906720  2685 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:16:06.937721 30777 catalog_manager.cc:5697] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 1 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.994118 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:06.993470 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:07.004369 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:06.987048 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.004293 30777 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.008361 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:07.007925 30777 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:07.010537 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:07.013545  2772 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.014619  2772 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:07.015508  2772 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.024127 30777 catalog_manager.cc:5697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.034750 30777 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:06.985919  2809 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:06.929948  2825 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.990080  2801 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:06.967880  2845 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:06.991268  2635 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.011803 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.050808 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:07.049767 30777 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
W20260709 13:16:07.083802 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 96794.8us
I20260709 13:16:07.084769 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.061528 30875 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:06.997552  2754 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.088148  2754 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.091287  2754 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.059266  2493 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:07.093945  2493 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.094501  2493 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:07.103327 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52588.8us
I20260709 13:16:07.104224 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:07.105762 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:07.107487  2754 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.108530  2754 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.109071  2754 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:07.109615  2754 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:07.110311 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 118623us
I20260709 13:16:06.984712  2545 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.079720  2635 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:06.970099  2558 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.083932 30777 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 8, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.148419 30777 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 8, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 8 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:07.086308 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.059455  2801 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.062377  2679 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.152779  2936 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:07.153491  2782 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.153950  2805 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.119213  2803 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:07.158113  2493 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.161785 30777 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:07.162475 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:07.162541 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 419443us
I20260709 13:16:07.063707  2860 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.102485  2686 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.119107  2736 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:07.180728 31604 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.157231  2935 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.181268 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:07.181749 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.181229 30777 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:07.176944 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 90704us
W20260709 13:16:07.176821 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 165137us
I20260709 13:16:07.177903 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.122329  2945 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:07.164112  2927 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
W20260709 13:16:07.169910 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 62258.5us
I20260709 13:16:07.187561 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:07.189965 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 185647us
I20260709 13:16:07.191931 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.164357  2713 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.194319 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.195657 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.214447 30956 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:07.176797  2804 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.002s
I20260709 13:16:07.225203 30949 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.174942  2803 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.160969  2481 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:16:07.184217  2782 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.229900 30958 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13.
I20260709 13:16:07.184877  2736 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:07.231844 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.232028 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.191602 30777 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 11, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 11 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:07.232673 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.231407 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.232592 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.223816 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.184424  2935 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:07.225710  2928 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 13:16:07.242727 30777 catalog_manager.cc:5697] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 8, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 8 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:07.228591  2788 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:07.223896  2818 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.270699 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.234380  2803 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.223017  2942 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.379853 30950 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:07.277320 31596 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:07.249816  2736 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.193482  2945 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.243124 30954 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:07.243549 30952 raft_consensus.cc:2376] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9. Re-sending same reply.
I20260709 13:16:07.269097  2801 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.249538  2946 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:16:07.345782 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.416483 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 178604us
I20260709 13:16:07.342332 31604 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
W20260709 13:16:07.417186 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.363751 30956 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:07.281258 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.366719 30949 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:07.418797 30955 raft_consensus.cc:2410] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:16:07.363991 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 180224us
I20260709 13:16:07.270267  2846 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.420677 30998 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.420951 30954 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:07.277417  2929 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:16:07.274825 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.316452  2845 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.380477  2664 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.320653  2493 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.240363  2954 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.278767  2936 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.335561  2772 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.392141 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.382833  2818 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.393282  2784 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.278070  2959 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.158s
I20260709 13:16:07.393316  2481 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.325531  2809 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.279111  2782 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:16:07.306675  2943 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:16:07.303185  2872 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.378671  2935 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.397331  2945 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.397960 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.399036  2781 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:07.399060 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 64206.9us
I20260709 13:16:07.476944 30847 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:07.400789  2558 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.402189  2754 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.457494  2848 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:07.430933  2846 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.408968  2780 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.409731 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2493) took 1157 ms. Trace:
I20260709 13:16:07.409853  2803 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:07.416996 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 519436us
W20260709 13:16:07.276422  2292 consensus_meta.cc:287] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:16:07.411625  2854 raft_consensus.cc:3055] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:07.307153  2785 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:07.425012 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.525440  2854 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:07.425127 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:07.425305 31026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.010s	sys 0.005s
W20260709 13:16:07.528435 31026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.011s	sys 0.005s
I20260709 13:16:07.528148  2854 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:07.426493 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.000s	sys 0.021s
W20260709 13:16:07.528784 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 103731us
W20260709 13:16:07.529122 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.000s	sys 0.021s
I20260709 13:16:07.529425  2854 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:07.529479 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 787256us
I20260709 13:16:07.529901 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.530972 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.531092 30998 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:07.531316  2558 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.532027  2860 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:07.532518 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.532691  2957 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:07.429522 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.533844 30955 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:07.533766 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.381654  2788 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:07.534502 30879 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:07.535254  2788 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.536459  2788 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.427557 30957 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:07.412714  2825 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:07.330302  2635 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.433920 30924 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.461494 30951 raft_consensus.cc:2368] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14.
W20260709 13:16:07.540171 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 106334us
I20260709 13:16:07.483392  2809 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.430105  2948 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:07.454936  2953 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.457638  2801 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.405957  2736 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:07.408838 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 624242us
W20260709 13:16:07.547854 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.484069  2960 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:16:07.485015 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2199) took 1354 ms. Trace:
I20260709 13:16:07.481520  2966 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:07.492786  2782 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.494259 30880 rpcz_store.cc:276] 0709 13:16:06.252060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.252181 (+   121us) service_pool.cc:224] Handling call
0709 13:16:07.409509 (+1157328us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b540005a0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:07.409650 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793149696}
W20260709 13:16:07.492781 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 311569us
I20260709 13:16:07.523384 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.531967  2726 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:07.479914  2943 consensus_queue.cc:1243] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:07.540904 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:07.430132  2679 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.466303 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 278824us
I20260709 13:16:07.571844 31571 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:07.573074 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.434450  2955 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.545818  2936 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.542230 30848 leader_election.cc:400] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14.
I20260709 13:16:07.480923  2946 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.548146  2945 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.589131 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:07.535501 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.479583  2951 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:07.471450  2481 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.553014 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.553364 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:07.554113 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.552119 30953 rpcz_store.cc:276] 0709 13:16:06.130380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.516854 (+386474us) service_pool.cc:224] Handling call
0709 13:16:06.538603 (+ 21749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.538968 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.538995 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.539437 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.691397 (+151960us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:06.691434 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.691497 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.484710 (+793213us) raft_consensus.cc:1685] finished
0709 13:16:07.484741 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.484938 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2532,"raft.queue_time_us":84,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":20783,"thread_start_us":91369,"threads_started":1,"wal-append.queue_time_us":311566}
I20260709 13:16:07.554647 30956 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.554152 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.569034 30883 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:07.605320 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0691646420000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 13:16:07.546068  2558 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:07.541539  2780 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:07.581887  2804 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.532078 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.576120  2966 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.578791 30952 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:07.579237 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.659929 30952 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:07.580830 30848 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.581183 31596 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:07.580845 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.593334  2955 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.734436 31599 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:07.583415 30957 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:07.584690 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.584796 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.592175 30879 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:07.736158 31604 raft_consensus.cc:2410] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:07.524209  2292 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:07.608549 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44972.8us
W20260709 13:16:07.608589 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0302565330000562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:16:07.552405  2947 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.607278 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.608681 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.610291 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:07.627993 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:07.784297 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 193752us
W20260709 13:16:07.784629 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 174438us
I20260709 13:16:07.784853 30953 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:07.633853  2972 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:16:07.635250  2973 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:07.644438  2772 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.791911 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2687) took 1061 ms. Trace:
I20260709 13:16:07.792107  2803 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:07.793143  2713 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.005s
I20260709 13:16:07.793236  2736 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.793738  2713 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:07.574446  2782 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.796429  2782 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.586833  2763 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.797097  2763 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:07.797535  2763 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:07.733775  2818 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.649775  2481 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.650518  2635 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.650794  2784 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.597447  2945 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.791595  2795 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.799360  2955 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.582437  2960 consensus_queue.cc:1243] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:16:07.658532 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76668.1us
I20260709 13:16:07.802428  2665 raft_consensus.cc:3055] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:07.802874  2665 raft_consensus.cc:740] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.606199  2943 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:07.803716  2665 consensus_queue.cc:260] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.804277  2943 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:07.804769  2665 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:07.805150  2943 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.807309  2292 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.605451  2785 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:07.585438  2946 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.808118  2754 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:07.809926  2946 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:07.661376 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 80612.3us
I20260709 13:16:07.810979 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.812415 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.813421 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:07.814133 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:07.660751 30952 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.586382  2849 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:16:07.815304  2948 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.789149  2866 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:07.580401  2679 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.816867  2966 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.817965  2679 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.724974  2558 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.818783  2558 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.820899  2558 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.696271  2971 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:07.674650 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.823779  2872 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.824276  2872 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.824795 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.826028 30880 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:07.826215  2872 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:07.826525 30880 pending_rounds.cc:85] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 5
I20260709 13:16:07.826799 30880 pending_rounds.cc:107] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:07.827363 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.782866  2804 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.828120 30877 raft_consensus.cc:2368] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:16:07.826094 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.828459  2935 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.829191 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.831439  2804 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:07.831863  2935 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.823805 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:07.737015 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0226865829999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 13:16:07.823535 30879 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
W20260709 13:16:07.836150 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0167565330000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:16:07.837613 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:07.838385  2804 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.839279 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:07.616458  2848 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.845634 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.612574  2951 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.792285 31026 rpcz_store.cc:276] 0709 13:16:06.731159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.731473 (+   314us) service_pool.cc:224] Handling call
0709 13:16:06.755244 (+ 23771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.789953 (+ 34709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.789989 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.817708 (+ 27719us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.528819 (+711111us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:07.528858 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.528922 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.791668 (+262746us) raft_consensus.cc:1685] finished
0709 13:16:07.791691 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.791853 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36581,"raft.queue_time_us":34506,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":25384,"thread_start_us":710678,"threads_started":1,"wal-append.queue_time_us":642328}
I20260709 13:16:07.661515  2962 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:16:07.774773  2780 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.785785 30956 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:07.786041 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.853380 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.788551 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:07.789037  2940 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.514s	user 0.000s	sys 0.007s
I20260709 13:16:07.854926 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.855134 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.855949 31032 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:07.845715  2971 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.851552  2825 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:16:07.789202 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.858973  2825 consensus_queue.cc:1243] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:07.859921 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.860438 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.860953 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.861513 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.848233  2829 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.846201  2805 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.864544 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.789618 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.789718  2686 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:07.851882  2955 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:07.866142 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 948) took 1129 ms. Trace:
I20260709 13:16:07.866715  2955 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.867676  2955 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:07.789948 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.789616  2959 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:07.869805  2795 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:07.869959 31598 raft_consensus.cc:2368] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:16:07.869980  2959 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:07.552619  2953 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:07.799250  2980 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:16:07.866039  2686 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.873795  2957 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:07.874053  2686 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:07.874285  2957 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.877749  2953 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:07.575003 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:07.885177 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 310225us
I20260709 13:16:07.816100  2866 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.839015  2804 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.815086 30952 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.827018 30880 raft_consensus.cc:2889] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.776711  2781 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:07.816020  2849 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:07.902746  2849 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:07.903985  2849 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.904764  2804 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:07.905598  2849 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:07.908152 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.908993 31024 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:07.914644 31598 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:07.846475 30998 leader_election.cc:400] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:16:07.846251 31605 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:07.849251 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.916150 30998 leader_election.cc:403] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:07.916812 30879 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:07.850776 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.851517 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.852291 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.918190 31597 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:07.787861 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.871143  2959 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.873903  2846 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:07.799690  2945 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:07.921379 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 135397us
I20260709 13:16:07.922683 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:07.879521 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.924139 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 73451us
I20260709 13:16:07.855530 31602 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:07.925372 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.926478 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.927417 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:07.928359 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.928670 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.929531 31599 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:07.887650 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.930366 31025 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:07.866659 30882 rpcz_store.cc:276] 0709 13:16:06.736500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.897831 (+161331us) service_pool.cc:224] Handling call
0709 13:16:06.973406 (+ 75575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.973646 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:07.219730 (+246084us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.522995 (+303265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.523049 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:07.523089 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.523155 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.865978 (+342823us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54001266d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:07.866086 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39606,"prepare.queue_time_us":184356,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":40740,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":16628,"spinlock_wait_cycles":172670336,"thread_start_us":487799,"threads_started":2,"wal-append.queue_time_us":379798}
I20260709 13:16:07.887472 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:07.932138 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44756.9us
W20260709 13:16:07.932955 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.884326 30996 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:07.893050 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.928809 30847 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:07.844938  2726 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:07.895550 31601 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:07.850215  2292 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:07.950168 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.892580  2946 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:07.898360 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.874313  2763 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.899503 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:07.900477 31023 raft_consensus.cc:1217] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[11.10-13.11]   Dedup: 11.10->[13.11-13.11]
I20260709 13:16:07.954282 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.954646 31023 raft_consensus.cc:1240] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:16:07.875293  2957 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.882427 31596 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:07.955603 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 71369.2us
I20260709 13:16:07.959120 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.942170 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.945694 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.961118 30876 raft_consensus.cc:2410] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:16:07.956445 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.963379 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.965832 31600 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:07.966768 30875 raft_consensus.cc:2410] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:16:07.943331 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.948446 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.949409 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.951625 31032 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:07.953006 30952 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:16:07.953073 31605 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:07.923290  2686 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:07.955194 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 113139us
I20260709 13:16:07.951143  2726 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.954926 30882 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:07.958187 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:07.973825 30881 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:07.936450 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:07.939666 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.975231 30879 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:07.975358 31027 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:16:07.970625 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.949102  2801 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:07.971036 30952 pending_rounds.cc:85] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 8
I20260709 13:16:07.981794 30952 pending_rounds.cc:107] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:16:07.982105 30952 raft_consensus.cc:2889] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.982384 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.982731 30998 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:07.971704 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:07.952137  2985 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:16:07.984988 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:07.985193 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.970625 31601 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:07.985404 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.985625 31024 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:07.972424 30847 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:07.977226 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:07.982627 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:07.980473 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.978060 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:07.947865  2781 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:07.986944 31028 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:07.983016 31027 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:07.955422  2946 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:07.989200 30922 leader_election.cc:400] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:16:07.991707 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:07.966396  2804 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:07.996863 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:07.997514 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.996125  2948 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.996690  2725 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:07.952503  2962 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:16:07.971395  2772 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:08.070231 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.972139  2736 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:07.999156 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.973708  2872 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:08.001739 31604 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:08.081086 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:07.988435  2797 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:16:08.081280 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 109641us
I20260709 13:16:08.082983 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.153009 30949 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:08.153780 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:08.154160 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.155007 30949 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:07.999375  2957 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.014019 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:08.084211 30956 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:08.064671 30879 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:08.087282 30953 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:08.087880 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.180371 30953 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:08.180779 30955 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
W20260709 13:16:08.152107  2985 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:08.090804 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:08.088941 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 192886us
I20260709 13:16:08.135191 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:07.964738  2848 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:07.981623  2801 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.964421  2989 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:08.140084 31032 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:08.141755 30952 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:08.142436 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 150748us
I20260709 13:16:07.971988  2679 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:16:08.143378 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.143524 31605 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
W20260709 13:16:08.150233 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.197873 30958 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:07.988781  2935 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:07.996399  2946 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:08.082010  2948 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.078946  2784 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.156198 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.179191 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.998906  2947 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.084767 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:07.971856  2292 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:08.181643 31024 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:08.183213 30955 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:08.202961 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:08.203950 30955 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:08.204918 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.205631 30955 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:08.206590 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:07.984627  2845 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.182s
I20260709 13:16:07.998895  2788 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 13:16:08.210552  2788 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:07.982010  2545 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 13:16:08.212011  2545 consensus_queue.cc:1243] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:08.185736 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:08.214155  2859 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:08.215056 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:08.143532  2936 raft_consensus.cc:2764] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:08.187090 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:08.187922 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 173985us
I20260709 13:16:08.216197 30879 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:08.188366 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.181208 30953 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:07.984790  2558 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.192s
I20260709 13:16:08.218308 30956 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:08.219389 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.220148 30956 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
W20260709 13:16:08.190066 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 212030us
I20260709 13:16:08.141601  2736 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:08.220911  2736 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:08.221179  2936 consensus_queue.cc:1175] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74f5a5b7556240508983221981af4ab4" responder_term: 11 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:08.223127 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.150700  2781 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:08.224988  2781 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.232352  2859 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.211491  2788 consensus_queue.cc:1243] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:08.231333 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:08.236727  2859 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:08.238226 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:08.240052  2859 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:08.240711  2736 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.243644 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.143354  2725 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:07.988550  2974 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.188s
I20260709 13:16:08.151338  2635 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:08.244637 31031 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:08.244782 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.259104 30955 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:08.081161  2954 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:16:08.262234  2954 consensus_queue.cc:1243] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:08.197813  2801 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:08.196919  2780 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:08.157649  2872 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.251044 30956 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:08.194636  2943 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.182161  2782 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:08.252877 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.336757 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:08.192341 31599 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:08.260926 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:08.261854  2993 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:08.246443 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:08.247433 30950 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:08.372660 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 219970us
I20260709 13:16:08.240551  2859 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:08.246016  2948 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:08.282869 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 93384.5us
I20260709 13:16:08.374056 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:08.250268 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:08.258479  2292 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:08.363960 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:08.364694 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:08.381781 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 131608us
I20260709 13:16:08.382442 30880 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:08.277608  2985 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:16:08.337241 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:08.359395  2725 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.369872 30957 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:08.275480  2970 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:08.379578 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:08.253032  2953 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:16:08.405030  2953 consensus_queue.cc:1243] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:08.405864  2953 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:08.277025  2780 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.407011  2780 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.414485  2726 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:08.415445  2686 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:08.418234  2995 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:16:08.420293  2994 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:16:08.427886  2736 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:08.391566  2970 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:08.434783  2795 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:08.435509  2795 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.445705 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:08.456306 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 77755.2us
I20260709 13:16:08.382898 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:08.387566 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:08.461261 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 73773.8us
I20260709 13:16:08.370771  2782 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.469142  2782 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:08.471964 30949 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:08.397511  2292 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.391034 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:08.478878 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 96079us
I20260709 13:16:08.480286 30848 leader_election.cc:400] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13.
I20260709 13:16:08.480788 30848 leader_election.cc:403] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:08.482117 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:08.471412  2782 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:08.378640  2859 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.394939  2805 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.515434 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:08.496508 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 279605us
I20260709 13:16:08.525370 31024 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:08.548285 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:08.549532 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:08.486814  2782 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.487358  2665 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.488334  2966 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13.
W20260709 13:16:08.592470 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 110451us
I20260709 13:16:08.593868 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:08.564919  2782 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:08.547926  2957 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:08.577464  2872 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:08.577975  2970 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.581606 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:08.584458  3001 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:16:08.514166  2784 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:08.596448 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 395447us
I20260709 13:16:08.603695 31605 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:08.551162  2805 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:08.637910 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:08.635296 30922 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:08.642006 31599 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:08.628490 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:08.601627  2971 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:08.660145 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:08.561267  2726 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:08.670246 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:08.670575 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:08.668421 31599 pending_rounds.cc:85] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:16:08.673343 31599 pending_rounds.cc:107] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:08.673744 31599 raft_consensus.cc:2889] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.666360 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:08.681437 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.685524 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.685974 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.638687  2957 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:08.640126  3004 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:08.640820  2970 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:08.694887 31598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.006s	sys 0.015s
I20260709 13:16:08.659796  2664 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:08.703162 31598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.006s	sys 0.015s
I20260709 13:16:08.666545  2966 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:08.704638 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:08.710171 30957 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:08.703423 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:08.664327  3009 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:08.717231 31029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.003s	sys 0.018s
W20260709 13:16:08.719401 31029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.003s	sys 0.018s
I20260709 13:16:08.704945 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:08.640323  2784 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:08.844689 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.678285  2781 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.699538  2872 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:08.700031  2635 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.706372  2971 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:08.851354 31027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.025s	sys 0.030s
W20260709 13:16:08.884683 31027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.025s	sys 0.031s
I20260709 13:16:08.850214 31603 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:08.703486  2664 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:08.694591  3008 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:08.720858  3002 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:16:08.678218  2726 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.885761 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1146) took 1033 ms. Trace:
W20260709 13:16:08.894451 31026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.015s	sys 0.048s
W20260709 13:16:08.883818  2945 consensus_meta.cc:287] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.003s
W20260709 13:16:08.858758  2849 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.953s	user 0.009s	sys 0.004s
W20260709 13:16:08.924444 31026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.016s	sys 0.053s
W20260709 13:16:08.924461 30998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.006s	sys 0.020s
I20260709 13:16:08.923364 31603 rpcz_store.cc:276] 0709 13:16:07.852007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.865605 (+ 13598us) service_pool.cc:224] Handling call
0709 13:16:08.847587 (+981982us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b58000d1d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:16:08.849964 (+  2377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.885452 (+ 35488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.885700 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37119872}
W20260709 13:16:08.930357 30998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.007s	sys 0.020s
I20260709 13:16:08.878391  2872 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:08.884603  2971 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.848344  3007 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:08.885068  3010 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.856989  2781 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.851938  2785 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:08.711014  3004 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:08.717619  2780 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.924984  3009 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.910722  2988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.025s	sys 0.041s
I20260709 13:16:08.972227 31596 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:08.890249  2635 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:08.925920  3008 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:09.046972  2709 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:08.955475  2957 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.060478  2709 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:09.060858 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 959) took 1216 ms. Trace:
I20260709 13:16:08.929801  2805 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.061389 30883 rpcz_store.cc:276] 0709 13:16:07.844482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.846429 (+  1947us) service_pool.cc:224] Handling call
0709 13:16:09.060031 (+1213602us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:16:09.060251 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.060464 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.060490 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.060542 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:09.060581 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.060644 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.060798 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3389824}
I20260709 13:16:09.061677  2709 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.064388 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 361033us
I20260709 13:16:09.065646 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:09.010040 30958 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:16:09.055552 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2209) took 1857 ms (client timeout 2061 ms). Trace:
W20260709 13:16:09.068737 30951 rpcz_store.cc:269] 0709 13:16:07.198446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.198911 (+   465us) service_pool.cc:224] Handling call
0709 13:16:09.055219 (+1856308us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400256a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.055459 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505668992}
I20260709 13:16:09.044385 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.050851 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1292) took 1471 ms. Trace:
I20260709 13:16:09.082108 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.062927  2709 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.088927 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2217) took 1721 ms. Trace:
I20260709 13:16:09.089581 30954 rpcz_store.cc:276] 0709 13:16:07.367748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.385238 (+ 17490us) service_pool.cc:224] Handling call
0709 13:16:07.420529 (+ 35291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.421439 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.088637 (+1667198us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b54003ff7d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.088845 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50331520}
I20260709 13:16:09.072706 31600 rpcz_store.cc:276] 0709 13:16:07.579790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.579929 (+   139us) service_pool.cc:224] Handling call
0709 13:16:07.613997 (+ 34068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.967855 (+353858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.050528 (+1082673us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54004853d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:09.050774 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803139328}
I20260709 13:16:09.095408 30883 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:08.991573  2493 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:09.116076 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 411276us
W20260709 13:16:09.125365 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 415747us
W20260709 13:16:09.045380  2795 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:16:08.971367  2872 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:09.127487 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.132524 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:08.998524  2962 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.192365 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 59973.9us
I20260709 13:16:09.193394 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:09.017800  3005 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:09.042016  3022 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:09.190034 31602 raft_consensus.cc:2368] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12.
I20260709 13:16:09.039798  2726 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.088224  2781 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:09.209867  3012 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:16:09.211220 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2173) took 1322 ms. Trace:
I20260709 13:16:09.118476  3009 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.211627 31029 rpcz_store.cc:276] 0709 13:16:07.889068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.889215 (+   147us) service_pool.cc:224] Handling call
0709 13:16:07.899249 (+ 10034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.927209 (+ 27960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.927239 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.947677 (+ 20438us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.720819 (+773142us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:08.720877 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.720984 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.210984 (+490000us) raft_consensus.cc:1685] finished
0709 13:16:09.211010 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.211155 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34574,"raft.queue_time_us":55392,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6634,"thread_start_us":747469,"threads_started":1,"wal-append.queue_time_us":930095}
I20260709 13:16:09.213387  3009 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.215070  3030 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:08.972139  2971 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:09.195165 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.005s	sys 0.053s
W20260709 13:16:09.216655 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.005s	sys 0.053s
W20260709 13:16:09.217155 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 550830us
I20260709 13:16:09.087899  2665 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:09.121934  2493 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:09.219432 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:09.223876 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:09.218411  3006 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.552s	user 0.000s	sys 0.001s
I20260709 13:16:09.017510  3017 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:08.954452  2945 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.098788  2966 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:09.129515  2936 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:09.195096 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:09.229491 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:09.190913  2795 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.009073  3007 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.236970  3016 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:16:09.238472  2781 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.238999 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1144) took 1396 ms. Trace:
I20260709 13:16:09.304698 31604 rpcz_store.cc:276] 0709 13:16:07.842955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.861311 (+ 18356us) service_pool.cc:224] Handling call
0709 13:16:09.238732 (+1377421us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54007201d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.238889 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320479616}
I20260709 13:16:09.239398  2955 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:09.241384  2866 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.207938  3022 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.252317 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 812) took 1282 ms. Trace:
I20260709 13:16:09.282182  2936 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.225596  2988 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:09.278695  3047 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:09.010897  3010 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.279137 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 213559us
I20260709 13:16:09.217797  3005 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.134327  3025 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:16:09.286989  3033 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.296007  2784 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:09.297360  2859 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
I20260709 13:16:09.314872  3022 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.300246  3031 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:09.300478  2493 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.227751  2665 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.354048  2781 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:09.301472 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 106437us
I20260709 13:16:09.354869  2943 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:09.215857  3030 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.355118  2665 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.312667 30882 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:09.275070  3032 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:09.357422  3032 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:09.357697  2635 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.357972  3032 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.279168  3017 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.311228 31025 rpcz_store.cc:276] 0709 13:16:07.969547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.452658 (+483111us) service_pool.cc:224] Handling call
0709 13:16:08.453089 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:08.453550 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.453593 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:08.454332 (+   739us) log.cc:844] Serialized 52 byte log entry
0709 13:16:08.884235 (+429903us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:08.885617 (+  1382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.885720 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.238447 (+352727us) raft_consensus.cc:1685] finished
0709 13:16:09.238467 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.252231 (+ 13764us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20928,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":429466,"threads_started":1,"wal-append.queue_time_us":739170}
I20260709 13:16:08.970353  2935 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:09.277597  3034 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:09.367075 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 240318us
I20260709 13:16:09.331593 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:09.306413  2955 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.310508  2713 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.300251  2951 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.324484  2866 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:09.282539  2966 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.365423  2782 consensus_meta.cc:287] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.726s	user 0.006s	sys 0.005s
I20260709 13:16:09.322096  2936 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.333307  2725 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:09.299211  2801 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.961s	user 0.003s	sys 0.008s
I20260709 13:16:09.344691  2859 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.351440  2785 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:09.352588  2780 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.352912  2947 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.355154 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:09.402796 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47719.6us
I20260709 13:16:09.207345  2962 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.305894  2664 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.361861 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 806) took 1393 ms. Trace:
I20260709 13:16:09.366850 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 813) took 1397 ms. Trace:
I20260709 13:16:09.060652  3008 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.360551  2797 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:16:09.381568 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 50057.3us
W20260709 13:16:09.382969 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.398259 30882 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:16:09.418996 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 189583us
I20260709 13:16:09.379442  2955 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.400125 30877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 961) took 1555 ms. Trace:
I20260709 13:16:09.426923 30877 rpcz_store.cc:276] 0709 13:16:07.845181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.847673 (+  2492us) service_pool.cc:224] Handling call
0709 13:16:08.876638 (+1028965us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:16:08.876943 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.881180 (+  4237us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:09.218875 (+337695us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.399653 (+180778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.399812 (+   159us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:09.399858 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.399940 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.400063 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160838,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":2141,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7438,"spinlock_wait_cycles":3529472,"thread_start_us":475942,"threads_started":2}
I20260709 13:16:09.337285  3047 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.352617  3014 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:09.390000  2968 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.391909  2665 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.410823 31024 rpcz_store.cc:276] 0709 13:16:07.969706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.526354 (+556648us) service_pool.cc:224] Handling call
0709 13:16:08.563458 (+ 37104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.563733 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:08.564098 (+   365us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.366397 (+802299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.366473 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:09.366542 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.366631 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.366790 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":161,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":8049,"raft.queue_time_us":123921,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":800700,"threads_started":2,"wal-append.queue_time_us":481175}
I20260709 13:16:09.413385 31025 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:16:09.415660 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 101740us
W20260709 13:16:09.447837 30848 connection.cc:256] RPC call timeout handler was delayed by -1.1044510339997942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 13:16:09.416993 31023 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:16:09.429437 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.410797 31027 rpcz_store.cc:276] 0709 13:16:07.968628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.026470 (+ 57842us) service_pool.cc:224] Handling call
0709 13:16:08.026924 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.027180 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:08.155405 (+128225us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.361428 (+1206023us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.361503 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:09.361561 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.361647 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.361793 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":224988,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":164807,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":1222869,"threads_started":3,"wal-append.queue_time_us":888509}
I20260709 13:16:09.372686  2935 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.430037 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 962) took 1439 ms. Trace:
I20260709 13:16:09.397835  2558 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:09.431393  2635 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.343000  3033 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.406423  2785 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.424894 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:09.446782 30876 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:09.426349  2725 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.469569  3007 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.470183  2664 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.470907  2961 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:09.462832  2665 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.472512 31023 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:09.472831  2974 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.473124  2665 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:09.451507 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.430964  2797 consensus_queue.cc:1243] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:09.473752 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:09.474315 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2700) took 1483 ms. Trace:
I20260709 13:16:09.474702 31029 rpcz_store.cc:276] 0709 13:16:07.991132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.213279 (+1222147us) service_pool.cc:224] Handling call
0709 13:16:09.213666 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.214047 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.214080 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:09.214654 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.397639 (+182985us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:09.397682 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.397868 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.474104 (+ 76236us) raft_consensus.cc:1685] finished
0709 13:16:09.474124 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.474263 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85926,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":114,"thread_start_us":181763,"threads_started":1,"wal-append.queue_time_us":248646}
I20260709 13:16:09.480762  2795 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.435940  2780 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:09.481587  2780 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.482529 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:09.482770  2736 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.452190  2805 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.458078  2935 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.459741  2713 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.462018  2763 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.432442  2726 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:09.432370 30875 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:09.452574 30881 rpcz_store.cc:276] 0709 13:16:07.990465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.463293 (+472828us) service_pool.cc:224] Handling call
0709 13:16:08.497763 (+ 34470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.498031 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:08.926618 (+428587us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.429667 (+503049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.429731 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:09.429788 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.429861 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.429983 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4141,"prepare.queue_time_us":544235,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":65766,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":878214,"threads_started":3,"wal-append.queue_time_us":480209}
I20260709 13:16:09.434240  2988 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:09.431556  3038 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.398752  2782 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.471356  2961 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:09.473351  2974 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.451088 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:09.455933 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 808) took 1487 ms. Trace:
I20260709 13:16:09.449154  3004 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.411867  2947 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.406737  2801 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.445830  2945 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.491457 31026 rpcz_store.cc:276] 0709 13:16:07.968942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.999313 (+ 30371us) service_pool.cc:224] Handling call
0709 13:16:08.079062 (+ 79749us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:16:08.079476 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.079501 (+    25us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:16:08.080216 (+   715us) log.cc:844] Serialized 104 byte log entry
0709 13:16:08.929178 (+848962us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:08.998014 (+ 68836us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.308759 (+310745us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.309011 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.309104 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.455679 (+146575us) raft_consensus.cc:1685] finished
0709 13:16:09.455701 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.455873 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27903,"prepare.queue_time_us":71747,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3835,"raft.queue_time_us":100700,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":62965,"thread_start_us":1055590,"threads_started":2,"wal-append.queue_time_us":993912}
W20260709 13:16:09.503245 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.491344 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:09.494180 31027 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:16:09.489573 30950 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:09.498010 31601 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:09.467131  2978 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:09.494787  2947 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.484763  2725 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.520118  3005 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.452596  3025 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:09.521163  2978 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.466681  2989 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.211s	user 0.006s	sys 0.007s
W20260709 13:16:09.527829 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 103046us
I20260709 13:16:09.533605 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.485205  3047 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.535043 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.491787  2971 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.536005  3017 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.537811 30877 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:09.538890 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.537351  2971 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.542184 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:09.542819  2948 consensus_meta.cc:287] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.087s	user 0.009s	sys 0.001s
I20260709 13:16:09.544482  3010 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.537546  2797 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:09.543455 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.545686 30881 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:09.490509  2782 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.488751  2988 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:09.545105  2962 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.483722  2780 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.564132 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.540517 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:09.550809  2955 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.580893  2955 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.544358  2481 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:09.491648  2795 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.581821  2936 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.585249  2872 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.586483 31030 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:09.552119 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:09.543239  2948 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:09.552853 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 230438us
I20260709 13:16:09.485509 30996 leader_election.cc:400] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12.
I20260709 13:16:09.588155 30996 leader_election.cc:403] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:16:09.491307  2974 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.568696 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:09.532608  2989 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:16:09.590190 30958 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:09.591188 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:09.573251 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:09.487365  2713 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.593945  2955 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:09.594406  2955 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:09.594776  2955 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.595224  2713 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.492297  2736 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.546378  3028 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.572013 30955 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:09.489005  3038 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.504594  2635 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.597321  2736 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.597609  3038 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:09.574186 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.576256  2970 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.001s
I20260709 13:16:09.578052 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:09.598784 30957 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:09.578716 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:09.523500  2978 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.599663  3030 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.569504  2968 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.600690  2968 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.601228 31032 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:09.601275  2754 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:09.486966  2805 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.600754 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 115437us
W20260709 13:16:09.604435 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2222) took 1518 ms (client timeout 1784 ms). Trace:
W20260709 13:16:09.604825 30949 rpcz_store.cc:269] 0709 13:16:08.086462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.246193 (+159731us) service_pool.cc:224] Handling call
0709 13:16:09.604264 (+1358071us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b54002b6954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.604364 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225160064}
I20260709 13:16:09.608310 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:09.610414 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:09.610634 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.606053  3043 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:16:09.612646 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.612830 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:09.613780 30952 raft_consensus.cc:2410] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:09.614753 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:09.612076 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:09.617647 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 77215.2us
I20260709 13:16:09.617300  2970 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:09.571437  3017 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:09.641438 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.642215 30877 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:09.640688 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:09.602941  2968 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.621989  2970 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:09.648033 30848 leader_election.cc:336] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 2.061s (SENT)
I20260709 13:16:09.648276 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:09.648481 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:09.648864 30949 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.651084 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.653951 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:09.489732  2961 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.661156 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:09.661862 30949 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:09.666612 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:09.666630 30883 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:09.667083 31026 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:09.592744  2782 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:16:09.663606 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:09.668705 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:09.672544 31024 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:09.603350  2948 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:09.635934  2872 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.675536 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.675806 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:09.675627 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:09.676692 30883 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:09.681730 30957 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:09.595605  3022 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.684651 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:09.686437 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.686335 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:09.688321 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.651623  2970 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.690276 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:09.662614  2957 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:09.690989 31025 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:09.694610 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:09.695173 31024 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:09.694284 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:09.680792  2859 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.698940  2664 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:09.646850  2988 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.703835 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:09.704392  2974 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:09.705305  3033 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.706914 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:09.730047 30881 raft_consensus.cc:2393] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:09.707749 31031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 811) took 1738 ms (client timeout 2242 ms). Trace:
W20260709 13:16:09.730449 31031 rpcz_store.cc:269] 0709 13:16:07.969404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.987151 (+ 17747us) service_pool.cc:224] Handling call
0709 13:16:09.707555 (+1720404us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540007b054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.707666 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379150080}
I20260709 13:16:09.708079 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:09.731947 30883 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:09.708285  2801 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:09.710139  3058 log.cc:927] Time spent T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:09.711966  2936 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.714787  2725 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:09.715350  3020 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.698s	user 0.001s	sys 0.000s
I20260709 13:16:09.670106  2951 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:09.717608  3042 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:09.718827 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:09.646021  3017 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:09.723515 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.676440  2665 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:09.733067 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:09.761260 30881 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:09.646180  3053 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:16:09.717935  3057 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.723054  2957 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:09.744340 30880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 965) took 1656 ms (client timeout 2082 ms). Trace:
W20260709 13:16:09.768792 30880 rpcz_store.cc:269] 0709 13:16:08.088404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.386601 (+298197us) service_pool.cc:224] Handling call
0709 13:16:09.744126 (+1357525us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54000f9e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.744272 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198379264}
I20260709 13:16:09.723280  2664 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:09.687806  3043 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:09.726130  2481 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.748481 30953 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.799152 31025 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:09.758404 30877 raft_consensus.cc:2410] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:09.766208 30881 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:09.776801 31602 raft_consensus.cc:1217] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:16:09.804440 31602 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:16:09.777906 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:09.804172 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:09.805569 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:09.805668 31605 raft_consensus.cc:2393] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:09.729380  2974 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.784332 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:09.801470 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 106924us
I20260709 13:16:09.756270  3042 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:09.779527 31598 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:09.805770 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:09.806762 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:09.806789 31604 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.814450 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:09.783215  2664 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:09.780620  2957 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:09.780501  2782 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:09.785183  2801 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.804800  2946 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.550s	user 0.014s	sys 0.000s
I20260709 13:16:09.801908  3043 consensus_queue.cc:1243] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:09.787721  3046 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:09.833201 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:09.839641 31600 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:09.810935  2860 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.818102  2974 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:09.825227  3055 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:09.831351 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:09.848850  3049 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:16:09.826870  2957 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:09.853427  2860 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:09.876767  3066 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:16:09.890221  2665 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:09.892163  2665 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:09.896512  3059 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:09.807677  2481 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.786837  3057 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.911221 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.910122  2962 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.827378  3035 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:16:09.845237  3060 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:16:09.836119  2801 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.914721  3022 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:09.922227 31023 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:09.845760  3046 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.923430 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 814) took 1953 ms. Trace:
I20260709 13:16:09.891340 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2701) took 1892 ms. Trace:
I20260709 13:16:09.930060 30953 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:16:09.854782  2754 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12.
I20260709 13:16:09.835175  2782 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.936866 30953 pending_rounds.cc:85] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 10
I20260709 13:16:09.942147 30953 pending_rounds.cc:107] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:16:09.942473 30953 raft_consensus.cc:2889] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.943293 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1835) took 1860 ms. Trace:
I20260709 13:16:09.943653 30953 rpcz_store.cc:276] 0709 13:16:08.083179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.086994 (+  3815us) service_pool.cc:224] Handling call
0709 13:16:08.087195 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.747949 (+1660754us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5800703ad0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:16:09.942999 (+195050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.943229 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354865408}
I20260709 13:16:09.936780 31032 rpcz_store.cc:276] 0709 13:16:08.013943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.363585 (+349642us) service_pool.cc:224] Handling call
0709 13:16:09.891064 (+1527479us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400147154. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:09.891255 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2803451776}
I20260709 13:16:09.939100 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:09.936683 31030 rpcz_store.cc:276] 0709 13:16:07.969852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.047021 (+1077169us) service_pool.cc:224] Handling call
0709 13:16:09.047521 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.586870 (+539349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.923139 (+336269us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54003764d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:09.923355 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238896384}
I20260709 13:16:09.840654  2946 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:09.925701  2988 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:09.941485 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1129) took 2016 ms. Trace:
I20260709 13:16:09.981081 31600 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:09.983598 31597 rpcz_store.cc:276] 0709 13:16:07.924586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.927856 (+  3270us) service_pool.cc:224] Handling call
0709 13:16:07.954281 (+ 26425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.958343 (+  4062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.958370 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.958408 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:07.958443 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.941247 (+1982804us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b54006a54d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:09.941292 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.941424 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8891776}
W20260709 13:16:09.981515 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 167164us
I20260709 13:16:09.987551 31604 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:09.928149  2859 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:09.991020 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2107) took 2006 ms. Trace:
I20260709 13:16:09.987507 31601 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:09.994710 30878 rpcz_store.cc:276] 0709 13:16:07.984910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.450212 (+465302us) service_pool.cc:224] Handling call
0709 13:16:08.450650 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.451110 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.451151 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.250115 (+798964us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b2c00000f48. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:16:09.275693 (+ 25578us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.419802 (+144109us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:09.419889 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.420029 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.990722 (+570693us) raft_consensus.cc:1685] finished
0709 13:16:09.990742 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.990957 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45576,"raft.queue_time_us":9078,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10059,"spinlock_wait_cycles":20156800,"thread_start_us":106338,"threads_started":1,"wal-append.queue_time_us":393087}
I20260709 13:16:09.996256 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:09.902161  3042 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:10.003479 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.008050 30951 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:10.011562 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:10.012446 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.973451  3035 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.975927  2936 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.977113  3022 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:10.005892  2558 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:10.004417  3060 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:16:10.023048 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.024417 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:09.972437  3019 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:16:10.029968 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:10.031306  3017 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:09.932199  2665 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:09.931993  2962 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.040259 31030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:10.041278 31030 raft_consensus.cc:606] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:10.041700 31030 raft_consensus.cc:614] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:10.020483  2795 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.019052  2943 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.014293  3010 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.050657 30957 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.051713 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:10.014927  3071 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:10.025138  3042 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.005329  2859 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.078279 30847 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:10.084105 30878 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:10.084928 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:10.086203 31032 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.090931 30874 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:16:10.092449 30883 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:10.035286  2558 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:10.049736  3074 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.917428  2686 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:10.043867  3069 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:10.021247  2785 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:10.062193  3057 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.065102  3073 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.023028  3035 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.026516  2936 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.086416  2754 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.025311  3022 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.130203  3072 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.165688  2962 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.132673  2795 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:16:10.136180 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.167193  3022 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.124818  3069 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.141350 31032 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:10.145392  2859 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.164397  2754 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.089134  3010 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:10.089466  3071 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:10.180596  3032 consensus_meta.cc:287] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.811s	user 0.013s	sys 0.000s
W20260709 13:16:10.178146  2955 consensus_meta.cc:287] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
I20260709 13:16:10.190938 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2106) took 2206 ms. Trace:
I20260709 13:16:10.193642 30875 rpcz_store.cc:276] 0709 13:16:07.984634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.440548 (+455914us) service_pool.cc:224] Handling call
0709 13:16:08.440951 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.488087 (+1047136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.190573 (+702486us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540043c454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:10.190824 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279583616}
I20260709 13:16:10.075336  2943 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.200878 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:10.119200  3074 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.206426 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:10.207531 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.209052 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.204493 30949 pending_rounds.cc:85] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 6
I20260709 13:16:10.209880 30949 pending_rounds.cc:107] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:16:10.210208 30949 raft_consensus.cc:2889] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.216084 30952 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:10.211439 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:10.218729 30957 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:16:10.223222 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.161614  3073 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.236184 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:10.237069 30951 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:10.206851  2801 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.209439  2481 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:10.248232 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:10.269726 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.217875  2946 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.279811 30957 raft_consensus.cc:1217] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-10.8]   Dedup: 6.6->[8.7-10.8]
I20260709 13:16:10.286887 30957 pending_rounds.cc:85] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 6
I20260709 13:16:10.287228 30957 pending_rounds.cc:107] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:10.287520 30957 raft_consensus.cc:2889] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.202632  3032 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.206658  2955 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.238013  2782 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:10.311978 31032 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:10.206986  2558 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:10.320983 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 234718us
I20260709 13:16:10.325093 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:10.321818 30847 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:10.337833 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:10.346743  2664 consensus_meta.cc:287] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.009s
I20260709 13:16:10.347121  3011 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:10.347615  3011 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:10.347391  2664 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.348448  3011 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.349639  3011 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:10.350548  2664 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.351864 30847 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:10.352846  2664 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:10.353889 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:10.370954 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:10.343935  2859 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:10.377934 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:10.378579 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:10.359066  2785 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:10.368700  3035 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.422495 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:10.407460  3010 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:10.410269  2754 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.413276  2772 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.448071  2772 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.448385 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1848) took 1424 ms. Trace:
I20260709 13:16:10.448932 30956 rpcz_store.cc:276] 0709 13:16:09.024008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.024134 (+   126us) service_pool.cc:224] Handling call
0709 13:16:09.024486 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.458619 (+434133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.458652 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.458698 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:09.458739 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.448056 (+989317us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001e0d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:10.448120 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.448305 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997916544}
I20260709 13:16:10.450284  2772 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.450845 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:10.412801  2943 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:10.425482  3077 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:16:10.435938  3035 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.437999  2493 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:10.440341  3078 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:10.444010  3074 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.427942  3071 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.402364  3079 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:10.454425 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:10.462587 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:10.469589 31032 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:10.469842 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:10.463445  3035 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:10.464320 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 255887us
I20260709 13:16:10.453658  3008 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:10.470433 30956 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:10.497656 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:10.510529 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:10.518798 31571 connection.cc:256] RPC call timeout handler was delayed by -1.12563030299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:16:10.519991 31571 connection.cc:256] RPC call timeout handler was delayed by -1.0176303030000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:16:10.521634 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:10.476251  3079 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:10.478562  3032 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:10.531327 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.532466 30956 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:10.512806 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:10.522768  3033 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:10.523833  2861 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.536132 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:10.536227 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:10.536803 30875 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:10.537209 30951 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:10.538604 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:10.538942  2951 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:10.539332  2951 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:10.540373  2951 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:10.541085  3028 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.924s	user 0.013s	sys 0.007s
I20260709 13:16:10.541322  2951 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:10.541527  3028 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:10.544617  3046 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.544988 30956 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:10.546712  2974 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.005s
I20260709 13:16:10.547127  2974 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.476356  3008 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.555019  3072 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:10.534725  3033 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:10.555807  3008 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.556499  3033 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.557267 30954 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:16:10.557619 30954 pending_rounds.cc:85] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 8
I20260709 13:16:10.557780  2725 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:10.511533  2688 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:16:10.549660  3082 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:10.562208  2688 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:10.562592  2688 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.562913  2688 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.552830  2860 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.553435 31028 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:16:10.557938 30954 pending_rounds.cc:107] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:10.568461 30954 raft_consensus.cc:2889] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.576365  2974 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.552672 30956 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:10.581122  2688 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.584296  3079 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.585309 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2114) took 1271 ms. Trace:
I20260709 13:16:10.585965 30882 rpcz_store.cc:276] 0709 13:16:09.313847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.356929 (+ 43082us) service_pool.cc:224] Handling call
0709 13:16:09.357233 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.419225 (+ 61992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.584988 (+1165763us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54000f8f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:10.585227 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93563648}
W20260709 13:16:10.588903  3051 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.907s	user 0.005s	sys 0.000s
I20260709 13:16:10.593310  2635 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.598579 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:10.599364 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:10.601356 31029 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:10.601915 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:10.640003 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.619891 30954 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:10.689239 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:10.689448 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:10.689885 30879 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:10.476975  3073 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.687795 30882 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:10.691092 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:10.691522 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:10.695931 31032 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.686995 30874 raft_consensus.cc:2955] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:10.692914 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:10.693744 30878 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:16:10.694499 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 95990.3us
I20260709 13:16:10.698794 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:10.702675 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:10.703547 30956 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:10.704444  2725 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:10.704876  2725 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.705173  2961 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:10.705269 31597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:10.706229 31597 raft_consensus.cc:606] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:10.706717 31597 raft_consensus.cc:614] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:10.709533  2688 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:10.713156  2635 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.713697  2635 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.596642  2805 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.718986 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2177) took 1253 ms. Trace:
I20260709 13:16:10.719511 31027 rpcz_store.cc:276] 0709 13:16:09.465522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.466590 (+  1068us) service_pool.cc:224] Handling call
0709 13:16:09.467580 (+   990us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.518721 (+ 51141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.718670 (+1199949us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b54003791d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:10.718913 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59453696}
I20260709 13:16:10.720503 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:10.720682 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:10.721117 30956 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:10.727888 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:10.727941 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:10.729128 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:10.649046 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.735620 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.736090 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.547650  2970 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.848s	user 0.012s	sys 0.007s
I20260709 13:16:10.557542  3033 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:10.601078  2860 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:10.693825  2866 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:10.738374  2635 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:10.792135 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.782238  2955 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.533133  2664 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:10.693482  3053 consensus_queue.cc:1059] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:16:10.705200  2725 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:10.697525  3028 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:10.804605 31032 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:10.698334  3084 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:10.806959 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 281140us
I20260709 13:16:10.788455  2970 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.807257  3084 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:10.816532  2861 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:10.819423 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 306717us
I20260709 13:16:10.793941  2860 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.820592 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:10.816962 31571 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:10.799047  2866 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:10.823602  3096 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:10.814121  2955 raft_consensus.cc:3055] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:10.820019  3042 consensus_meta.cc:287] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.000s
I20260709 13:16:10.819442  3084 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:10.846832 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:10.849920 31025 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:10.852885 31025 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:10.835654  3035 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.854549 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:10.846755  2688 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:16:10.859831 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:10.841274  2955 raft_consensus.cc:740] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:10.860735 31029 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
W20260709 13:16:10.851208  2957 consensus_meta.cc:287] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.930s	user 0.013s	sys 0.000s
I20260709 13:16:10.848889  2974 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:10.870849 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:10.872334 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:10.853844  2936 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.885865 31032 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:11.321449 31026 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:16:11.322495 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 810) took 3350 ms (client timeout 2905 ms). Trace:
I20260709 13:16:11.324916 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.314072 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2189) took 1618 ms. Trace:
W20260709 13:16:10.949072 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.396998  3095 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.548s	user 0.000s	sys 0.039s
W20260709 13:16:11.336913 31571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.025s
I20260709 13:16:11.398065 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:11.338213 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 517497us
I20260709 13:16:11.399673 31601 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:11.400949 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.401924 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.403103 31597 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:11.404028 31031 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:11.404583  2860 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.405483 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:11.338646 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.406973 31031 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:11.342937 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.111243  2545 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:10.838217  2664 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.986693  2788 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:11.460296  2788 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:11.461913  3096 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:11.462924  3096 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.464617 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.466207 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.466501  3096 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.467199 31032 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:11.467417 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:11.467968 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.471799 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.472927 31600 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:11.393011 31023 rpcz_store.cc:276] 0709 13:16:09.695634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.695797 (+   163us) service_pool.cc:224] Handling call
0709 13:16:10.968394 (+1272597us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54001b21d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:11.313583 (+345189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445493632}
W20260709 13:16:11.391950 31028 rpcz_store.cc:269] 0709 13:16:07.969262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.999323 (+ 30061us) service_pool.cc:224] Handling call
0709 13:16:10.982760 (+2983437us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b5400347454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:11.319723 (+336963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5446939904}
W20260709 13:16:11.480890  3094 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.610s	user 0.014s	sys 0.006s
I20260709 13:16:11.481611 31597 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:11.445128  2688 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:10.871501  2957 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:10.878477  2974 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.484530  2688 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:11.486486  2688 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.487385  2974 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.372814  2970 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.372757  2989 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:11.378451  2866 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.379139  3011 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:11.491019  3011 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.494495  3011 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:10.873010  2726 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:10.865908  2861 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:10.914482  3042 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:10.914367  3056 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:16:10.996299  3069 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:10.944875  3090 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:16:10.945113  3093 log.cc:927] Time spent T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:16:10.876089  3097 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:11.398054 31571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.010s	sys 0.025s
I20260709 13:16:11.457362  2826 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:11.483968 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.371507  2966 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.487421  2957 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.488785 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:10.932968  2955 consensus_queue.cc:260] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.495733  2726 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.500366 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:11.504072 30998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.876s (SENT) [suppressed 12 similar messages]
W20260709 13:16:11.507050 31025 consensus_meta.cc:287] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.651s	user 0.006s	sys 0.015s
I20260709 13:16:11.462699  2788 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.508163  2861 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:11.526180 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.528445 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:11.525820 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 708910us
W20260709 13:16:11.533677 31024 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.649s	user 0.004s	sys 0.023s
I20260709 13:16:11.535151 31599 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:11.539927  2861 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:11.540045  2788 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.541977 31571 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:11.528012  2826 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:11.534287  2872 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:11.548084 31029 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:11.548206  2872 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:11.552069 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.551092 31024 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:11.552560 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.553612 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.554188  2955 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.554760 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.554770 31024 raft_consensus.cc:2410] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:16:11.556113 31029 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:16:11.559973 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 84807.8us
I20260709 13:16:11.543866  2826 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.556947 31025 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:11.563086 31032 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:16:11.572790  3105 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:11.574052  2688 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.574718 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:11.576421 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.576579 31601 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.577310 31024 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:11.577806  3104 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:11.578631  2961 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.873s	user 0.015s	sys 0.043s
I20260709 13:16:11.561187  2545 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.555732  2872 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.590058 31030 raft_consensus.cc:2410] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:11.590802  2545 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.591426  2664 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:11.591703 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.591810  2558 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.592924 31597 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:11.592757  2558 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.594261  2664 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:11.594911  3084 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.741s	user 0.023s	sys 0.002s
I20260709 13:16:11.583189  3104 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.595865 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.595062  2872 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.601094  2664 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.606901  3104 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.625947 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:11.626991  2686 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:11.628751  3096 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:11.629254  3096 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.629863  3096 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.627866  2686 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:16:11.633435  2686 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:11.633898  2686 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:11.635401  2686 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.637019  2686 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:11.601778  2725 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.024s
W20260709 13:16:11.637965 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 133933us
I20260709 13:16:11.612027  3084 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.641907 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.642660 31604 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:16:11.644152 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.646013 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.649394  3084 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.652715 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.653087  3056 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.653779  3056 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.656214  3056 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.656921  3042 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.657618  3042 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.659123 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.661005 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.660753  3042 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:11.595722  2861 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.659622 31601 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:11.663378  2545 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:11.663897  2688 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:11.664119 31605 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:11.644160  3104 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:11.665997 30956 consensus_meta.cc:287] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.944s	user 0.015s	sys 0.002s
I20260709 13:16:11.666567 30956 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:11.667002  3104 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:11.665925  2861 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.667330 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2250) took 1046 ms. Trace:
I20260709 13:16:11.668252 30956 rpcz_store.cc:276] 0709 13:16:10.620687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.720246 (+ 99559us) service_pool.cc:224] Handling call
0709 13:16:11.667175 (+946929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.671900  2725 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:11.673485  3033 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.885s	user 0.006s	sys 0.026s
I20260709 13:16:11.674667  2725 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.678879  3096 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.680511 31604 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:11.681758  3096 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.684566 31604 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:11.686043 31597 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:11.687420 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:11.688104 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.688198 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.689044 31599 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:11.689778  2726 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.690724 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.691632 31024 raft_consensus.cc:2393] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:11.694779 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.696775 31597 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:11.697580 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.698657 31025 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:11.699347  2955 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:11.662854 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.701740 31601 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:11.702486 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.703400 31025 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:11.704033 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.702678  2726 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.689056 31604 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:11.696686 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.706442 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.708427  3096 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:11.708223 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45479us
I20260709 13:16:11.711998 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:11.712813 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 984911us
I20260709 13:16:11.713680  3084 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:11.714766  2955 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.716257  2481 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:11.717126  2725 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:11.718055 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.722625  2955 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:11.724131 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.725140 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.727178  2872 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.727630  3042 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.728006 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.722021  2725 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:11.730477 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:11.730262  3042 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.731606 31600 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:11.730283  2872 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.733189 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:11.734200 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.735131 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.735512 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.735595  3033 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.734138  3010 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.734249 31599 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:16:11.735893 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.737126  3033 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.741380  3033 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.741503  2558 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.737955 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:11.736008  2872 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.743206 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.743886 31604 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:11.745436  2936 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:11.745574  3033 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:11.746254  2936 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.746659  3033 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.743749  3042 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:11.749963  2725 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.750396  3033 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.751210 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:11.752127  3096 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:11.752732  3096 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:11.752981 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.753875 31025 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:11.754017  3096 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.755501  2955 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:11.755959  2955 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.756315  2955 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:11.756464 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:11.742022  3010 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.758790  2726 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:11.759616  3010 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.759967  2664 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:11.760447  2664 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:11.760736 30954 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:11.761397 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2248) took 1141 ms. Trace:
I20260709 13:16:11.761718 30954 rpcz_store.cc:276] 0709 13:16:10.620069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.699739 (+ 79670us) service_pool.cc:224] Handling call
0709 13:16:11.761290 (+1061551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.761768  2664 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.748960 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:11.765826  2936 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.766638  2664 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.768167  2955 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.772699 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:11.773705  2966 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.774499  2966 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.780875  2966 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:11.782843  2861 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:11.784456 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.787591  3104 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:11.788193 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.789990 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.789878  3084 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:11.791138  3084 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:11.791290  3033 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.791564  3084 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:11.792378  3033 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:11.793246  3033 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.792764  3084 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.793628 30881 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:11.794435  3084 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.805456 30958 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:11.809473  3033 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:11.810354  3033 consensus_queue.cc:1243] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:11.811465 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.812193 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:11.812779 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 80597.4us
I20260709 13:16:11.813416 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.813628 30922 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.814802  3010 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:11.815311  3035 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:11.816164 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.817286 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:11.817698 30954 raft_consensus.cc:3060] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:11.804265 30874 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.106s	user 0.014s	sys 0.000s
I20260709 13:16:11.820258 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.827706 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:11.828568 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.839713 30956 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:11.841301 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.842272 30956 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:11.843739 30880 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:11.844445 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2549) took 1143 ms. Trace:
I20260709 13:16:11.844205 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.844681 30880 rpcz_store.cc:276] 0709 13:16:10.700793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.842880 (+1142087us) service_pool.cc:224] Handling call
0709 13:16:11.843374 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.844226 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.844362 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.845739 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:11.845583 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.846302 30880 raft_consensus.cc:2393] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:11.846807 30956 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:11.847325 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:11.849886 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:11.854179 30954 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:11.855710 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.856000 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:11.856765 30953 raft_consensus.cc:2410] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:11.857419 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.857926 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.858192 30954 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:11.858968 30953 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:11.851814 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.859911 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.856705 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:11.860383 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:11.861303 30880 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.862439 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 962) took 1664 ms. Trace:
I20260709 13:16:11.860528 30953 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:11.863915 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.866189 30956 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.860437 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.859194 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.867187 30954 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.864719 30957 rpcz_store.cc:276] 0709 13:16:10.197518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.225973 (+ 28455us) service_pool.cc:224] Handling call
0709 13:16:10.279500 (+ 53527us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:16:10.288360 (+  8860us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:10.418470 (+130110us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.534549 (+116079us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.537737 (+  3188us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:10.600251 (+ 62514us) log.cc:844] Serialized 52 byte log entry
0709 13:16:10.600403 (+   152us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:10.600435 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.600498 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.945191 (+344693us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b180048af60. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:11.861975 (+916784us) raft_consensus.cc:1685] finished
0709 13:16:11.862012 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.862223 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":514492,"prepare.queue_time_us":43795,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":3526,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":18537,"spinlock_wait_cycles":19446016,"thread_start_us":194218,"threads_started":2,"wal-append.queue_time_us":406125}
I20260709 13:16:11.868722  2866 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.869084 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.869280  2866 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.869707 30957 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:11.870599 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.871435  2866 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.875825  2866 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.880013  2866 consensus_queue.cc:1243] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:11.873575  2957 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:11.883539  2957 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.883956  2957 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:11.886608 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:11.887948  2966 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:11.888988 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:11.891152 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:11.895205  3117 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:11.897601  3117 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:11.898710  3117 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.901962 30953 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:11.903041 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.874433 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:11.903542 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:11.905273 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:11.906842 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 978) took 1221 ms. Trace:
I20260709 13:16:11.882685 30880 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:11.908846  3035 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:11.909284  3035 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:11.909687  3035 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:11.910069 30953 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:11.910207 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2550) took 1209 ms. Trace:
I20260709 13:16:11.911082 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.907269 30874 rpcz_store.cc:276] 0709 13:16:10.685149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.686364 (+  1215us) service_pool.cc:224] Handling call
0709 13:16:10.686653 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.686872 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:11.835996 (+1149124us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.906152 (+ 70156us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.906356 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.906420 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:11.906507 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.906607 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.906755 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24211,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":68245,"threads_started":2,"wal-append.queue_time_us":48375}
I20260709 13:16:11.912680 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:11.910622 30880 rpcz_store.cc:276] 0709 13:16:10.701098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.909106 (+1208008us) service_pool.cc:224] Handling call
0709 13:16:11.909560 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.909846 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.909880 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.909936 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:11.909974 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.910028 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.910131 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.914436  3117 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.916162 30880 pending_rounds.cc:85] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 8
I20260709 13:16:11.916620 30880 pending_rounds.cc:107] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:11.917033 30880 raft_consensus.cc:2889] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.906760 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:11.903272 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.916977  3009 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:11.914431 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.919353 30953 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.871628 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.875269 30954 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:11.920012 30957 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:11.920532 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:11.921080 30954 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:11.930629 31570 connection.cc:256] RPC call timeout handler was delayed by -2.1467509130000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:16:11.931097 31570 connection.cc:256] RPC call timeout handler was delayed by -2.0387509130000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 13:16:11.931403 31570 connection.cc:256] RPC call timeout handler was delayed by -1.9982509129999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 13:16:11.931686 31570 connection.cc:256] RPC call timeout handler was delayed by -1.7408509130000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
W20260709 13:16:11.932029 31570 connection.cc:256] RPC call timeout handler was delayed by -1.6724509129999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 13:16:11.932359 31570 connection.cc:256] RPC call timeout handler was delayed by -1.6215597970001454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2905s for a response
W20260709 13:16:11.932670 31570 connection.cc:256] RPC call timeout handler was delayed by -1.3268509130000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2484s for a response
I20260709 13:16:11.887991 30956 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:11.935505 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.937682 30875 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 8.
I20260709 13:16:11.939222 30956 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:11.941016 30953 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:11.946493  3031 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:11.952692 30876 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:11.954918 30954 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
W20260709 13:16:11.955525 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.955178 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.957809 30957 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:11.956297 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2541) took 1269 ms. Trace:
W20260709 13:16:11.962085 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.960786 30876 rpcz_store.cc:276] 0709 13:16:10.686646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.688331 (+  1685us) service_pool.cc:224] Handling call
0709 13:16:11.940918 (+1252587us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:16:11.941239 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.953179 (+ 11940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.956223 (+  3044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14692224}
I20260709 13:16:11.963320 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.964365 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.964356 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.965536 30954 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:11.954668  3031 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:11.967289  3031 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:11.967650  3031 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:11.967715 30954 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:11.968640  3031 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:11.969887  3031 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:11.970456 30956 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:16:11.972513 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 65826.2us
I20260709 13:16:11.975504  2957 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:11.976311 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:11.979532 30956 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:11.981489 30956 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: [6.5-9.7]
I20260709 13:16:11.981913  2955 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.983134  2955 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:11.991966 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:11.994014  2957 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:11.995114  2957 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:11.995481  2957 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:11.996582 30952 raft_consensus.cc:1240] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:11.972631  3120 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:11.974195  2966 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.008121 30949 pending_rounds.cc:85] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 2
I20260709 13:16:12.013134 30949 pending_rounds.cc:107] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:12.013509 30949 raft_consensus.cc:2889] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.007287  2957 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.016696 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.018167 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2551) took 1302 ms. Trace:
I20260709 13:16:12.018334 30876 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:12.018668 30874 rpcz_store.cc:276] 0709 13:16:11.557403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.912587 (+355184us) service_pool.cc:224] Handling call
0709 13:16:11.913019 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.913403 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:11.913772 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.016094 (+102322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.016148 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:12.016195 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.016282 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.016408 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1121,"prepare.queue_time_us":2325,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":34268,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":99379,"threads_started":2}
I20260709 13:16:12.012235  3120 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.017902  2966 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:12.021464  2970 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.021999 31570 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:12.022588 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.031001 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.008077  2955 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.042651 30998 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.042937  3127 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:12.043746  3109 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:12.044392  3109 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.043819  3127 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.050717 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.050781  2966 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.056496  3127 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:12.057246  3127 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:12.057564  2957 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.057857  3127 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.044816  3109 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.061535  3127 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:12.027637  3120 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:12.046967 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 70708.3us
I20260709 13:16:12.049268  3009 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:12.053781  3035 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.054198 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.056041  2955 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.045125  2970 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.072438  2970 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:12.072746 30956 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:12.072904  2970 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:12.073408  2970 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:12.063020 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:12.044845 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:12.068341 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:12.070422  3035 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.071146 30876 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:12.088215 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:12.093377 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 144120us
I20260709 13:16:12.071950  3127 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:16:12.096140 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.098075 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.099617 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:12.100308 31028 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:12.098312 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:12.110570 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65897.9us
W20260709 13:16:12.111646 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47169us
I20260709 13:16:12.112206 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:12.105314  3035 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.116487  3129 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.117072  3129 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:12.118052  3129 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.118431  3109 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.119997  3126 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.120626  3126 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:12.120720  3127 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:12.121976 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1849) took 2560 ms. Trace:
I20260709 13:16:12.121652  3126 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.101841  2957 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.122732  3031 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:12.124574  3031 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:12.124922 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.124517 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:12.125571 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 62946.5us
I20260709 13:16:12.126187  2493 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:12.126632 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.122372 30955 rpcz_store.cc:276] 0709 13:16:09.561575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.596451 (+ 34876us) service_pool.cc:224] Handling call
0709 13:16:09.596756 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.785871 (+189115us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:09.786218 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.893316 (+107098us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b1800364d20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:16:10.087888 (+194572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.087961 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:10.088024 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.121571 (+2033547us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54001955d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:12.121636 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.121809 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2637,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":5467,"raft.queue_time_us":2950,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9959,"spinlock_wait_cycles":438105728,"thread_start_us":191443,"threads_started":1,"wal-append.queue_time_us":415022,"wal-append.run_cpu_time_us":2778,"wal-append.run_wall_time_us":1269599}
I20260709 13:16:12.125614 30880 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:12.128520 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.128777 30998 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.129825 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.131217 30880 raft_consensus.cc:2410] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:12.132006  3035 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:12.132448  3035 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:12.132615 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.131518  3120 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.133719 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.134680 30957 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:12.134939 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.135803 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:12.122236  3127 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:12.136680  3127 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:12.125239  3031 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.137396  3120 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.137787  3127 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.109899 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:12.135630 30880 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:12.132896  3035 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.148200 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:12.148710 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:12.123713  3131 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.149783  2961 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:12.151988 30951 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.124557  2481 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.151623  2966 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:12.156414  2966 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:12.156592  2946 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:12.157485  2966 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.145802  2493 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.158533  3120 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:12.144977  3009 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:12.159543 30922 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:12.155303  2961 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.173810  2961 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:12.161419  3126 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:12.163971  3131 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:12.125249  3124 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:12.174190  3109 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:12.174321  3010 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:12.162730 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2184) took 2493 ms. Trace:
I20260709 13:16:12.175153 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.189045 30922 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:12.189707  3120 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:12.201251 31026 rpcz_store.cc:276] 0709 13:16:09.668878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.669543 (+   665us) service_pool.cc:224] Handling call
0709 13:16:11.320065 (+1650522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.383802 (+ 63737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.162527 (+778725us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400347450. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:12.162653 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3751819008}
I20260709 13:16:12.184053  3126 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:12.192054  3031 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.193477  2970 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.194427 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:12.194767  2961 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.185985  3035 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.196272  3124 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.214576 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.190932  3084 raft_consensus.cc:2764] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:12.206413  3126 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.206938  3131 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.208388  3031 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:12.198176 30951 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:12.215823 30955 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:12.216792 30880 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:12.219357 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.219949 30880 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.222244  3035 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.222393 30997 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:12.223842  3109 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:12.224589  3109 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:12.224709 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:12.225008  3109 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.225484  3109 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.225600  3106 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.226460  3106 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:12.225780  3117 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:12.211079  2493 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.216145  3124 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.231370  3031 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:12.232952 30997 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.232159  3031 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:12.235708 30880 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:12.233829  3031 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.240450  3031 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:12.232517  3117 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:12.241750  3117 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.244104 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.245698 30998 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.245959  2481 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:12.231930  3120 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:12.261777 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.262748 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.233768 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.273468  2481 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.275930  2481 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.278538  2481 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:12.288163 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64408.4us
I20260709 13:16:12.291677 30877 raft_consensus.cc:2410] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:16:12.296322 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.297133 30880 raft_consensus.cc:2393] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:12.295233 30877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2548) took 1591 ms (client timeout 1668 ms). Trace:
W20260709 13:16:12.298177 30877 rpcz_store.cc:269] 0709 13:16:10.700474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.723709 (+ 23235us) service_pool.cc:224] Handling call
0709 13:16:12.203094 (+1479385us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:16:12.292226 (+ 89132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256955136}
I20260709 13:16:12.279058  3126 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.317216  3126 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:12.318683 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.319604 30880 raft_consensus.cc:2393] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:12.320329 30880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:12.321045 30880 raft_consensus.cc:606] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:12.321420 30880 raft_consensus.cc:614] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:12.323207 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.314433  3109 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.317117 30879 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:12.324239 30880 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:12.310106 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 972) took 2233 ms. Trace:
I20260709 13:16:12.325062 30881 rpcz_store.cc:276] 0709 13:16:10.076724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.083079 (+  6355us) service_pool.cc:224] Handling call
0709 13:16:10.083499 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.794213 (+1710714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.309846 (+515633us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54003c64d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:12.310028 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3931912064}
W20260709 13:16:12.327241 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 53469.9us
I20260709 13:16:12.329898 30949 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:12.330054 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:12.330847  2866 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:12.333006 30879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2545) took 1645 ms (client timeout 1795 ms). Trace:
W20260709 13:16:12.333433 30879 rpcz_store.cc:269] 0709 13:16:10.687778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.689024 (+  1246us) service_pool.cc:224] Handling call
0709 13:16:12.327132 (+1638108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:12.333844 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.334450 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.335155 30879 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:12.340271 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2194) took 2017 ms (client timeout 2678 ms). Trace:
I20260709 13:16:12.340549 30881 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:16:12.340657 31030 rpcz_store.cc:269] 0709 13:16:10.322993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.323158 (+   165us) service_pool.cc:224] Handling call
0709 13:16:12.340040 (+2016882us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400378cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:12.340203 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2902432512}
I20260709 13:16:12.335590  2966 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.357645  3146 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:16:12.360549 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.362294 30881 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:12.325672  3106 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:12.363956 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 956) took 2171 ms (client timeout 1693 ms). Trace:
I20260709 13:16:12.364861  3109 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:12.365345  2961 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.366086  3031 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:12.381902 30958 rpcz_store.cc:269] 0709 13:16:10.193001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.193184 (+   183us) service_pool.cc:224] Handling call
0709 13:16:12.363663 (+2170479us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540002fb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:12.363854 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3686736640}
I20260709 13:16:12.383855 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.384750 31028 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:12.385350  3031 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.386052  3031 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:12.386548  3031 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:12.372587 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.372959 30997 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.379351 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.348649  2966 consensus_queue.cc:1243] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:12.388434 31026 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:12.383433  2961 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:12.399938  2961 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.400338  2961 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.403204  3009 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:12.403692  3009 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.383378  3109 raft_consensus.cc:2804] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:12.407971  3126 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:12.408586 30997 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.409562 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:12.410794 30875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2543) took 1723 ms (client timeout 2040 ms). Trace:
I20260709 13:16:12.410893 30880 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:12.387522  3031 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:12.411231 30875 rpcz_store.cc:269] 0709 13:16:10.687195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.687335 (+   140us) service_pool.cc:224] Handling call
0709 13:16:12.410585 (+1723250us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540039b2d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:12.410736 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2779736192}
I20260709 13:16:12.421813  3151 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:12.423707 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 66077.5us
I20260709 13:16:12.424156  3148 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:12.425211  3146 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:12.425666  3146 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.425913 30882 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:12.426010  3146 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:12.422675 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:12.358907  3124 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.432965 30958 pending_rounds.cc:85] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 4
I20260709 13:16:12.433324 30958 pending_rounds.cc:107] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:12.433570 30958 raft_consensus.cc:2889] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:12.436595 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.442945 30879 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:12.442471 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.452178 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.456984  3153 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:16:12.458200 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.458415 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.459025 30879 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.455453 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.460434 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.444386  2966 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:12.464941 31029 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:12.466027 31032 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.466645  3109 raft_consensus.cc:697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:12.467255 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.476630  3155 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.478565  3109 consensus_queue.cc:237] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.479240 31028 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:12.462868  2966 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:12.477810  3148 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.488010  2966 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.496510 30957 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:12.506836 30879 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:12.510942  3145 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:12.489920  3151 consensus_queue.cc:1243] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:12.515885 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:12.508874  3153 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:12.526742  3153 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.527334 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.528282 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2722) took 1048 ms. Trace:
I20260709 13:16:12.528599 31023 rpcz_store.cc:276] 0709 13:16:11.480275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.527046 (+1046771us) service_pool.cc:224] Handling call
0709 13:16:12.528219 (+  1173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:12.530493  2664 consensus_meta.cc:287] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.005s
I20260709 13:16:12.530897  2860 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.531414  2860 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.531935  2726 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:12.532528  2726 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.534510 31029 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:12.534987  2726 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.536546 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:12.537086 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:12.537655 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:12.538218 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:12.538782 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:12.539489 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:12.540184  3151 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:12.540621  3151 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:12.541436  3151 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.542666  3151 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:12.540298 31603 raft_consensus.cc:2410] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:12.544829 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.546031  3157 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:12.546553  3157 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:12.547283  2664 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:12.548370 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:12.548879 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.549563 31031 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:12.556981 30876 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
W20260709 13:16:12.567253 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 144799us
I20260709 13:16:12.553423 30848 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.572110 31032 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:12.573561 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:12.574174 31603 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.574849 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:12.576778 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.578092 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2546) took 1890 ms. Trace:
I20260709 13:16:12.580397  2955 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:12.580690  2860 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.583155  3155 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:12.584112 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:12.584872 31599 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:12.578465 30882 rpcz_store.cc:276] 0709 13:16:10.688107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.695811 (+  7704us) service_pool.cc:224] Handling call
0709 13:16:10.696104 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.426395 (+1730291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.551785 (+125390us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54000d34d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:12.578033 (+ 26248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3954493312}
I20260709 13:16:12.586448  2955 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:12.589459 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:12.589318  2955 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.590324 30883 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:12.590754 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2547) took 1890 ms. Trace:
I20260709 13:16:12.591094 30883 rpcz_store.cc:276] 0709 13:16:10.700162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.729545 (+ 29383us) service_pool.cc:224] Handling call
0709 13:16:12.590676 (+1861131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:12.593385 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.594200 31604 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:16:12.597923 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:12.571687  3117 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:12.547490  3157 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:12.600983  3103 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 1.065s	user 0.002s	sys 0.005s
I20260709 13:16:12.601423  3146 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.601935  3160 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.602386  3160 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.602706  3160 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.596201 31600 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:12.580462 31597 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:12.569597  3126 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:12.587815 30848 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:12.627926 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.584368  3124 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:12.647969  3150 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:12.646203  3117 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:12.658020 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.664408 30882 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:12.604055  3145 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:16:12.656452  3146 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.671664  3158 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:16:12.672292  3154 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:12.673116 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:12.673441  3009 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.619369  2966 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.645345  2961 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.659217  3148 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:12.678047 30880 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:16:12.669667  3117 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:12.677232  2860 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:12.718854 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:12.720132 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 126852us
I20260709 13:16:12.680547  3031 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.724359  3148 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:12.725222 31603 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:12.727244  2961 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:12.729173  2966 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:12.732630  3117 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.688868  3145 consensus_queue.cc:1243] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:12.715024  3154 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.880052  2558 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.734419 30882 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:12.881474  3170 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:16:12.881779  3009 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:12.735142 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.721500 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.882743 30880 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:12.885867  3160 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:12.871740 31026 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:12.872275 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.873483 31031 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 13. Ops: []
I20260709 13:16:12.876248 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.882812 30875 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:12.854295 30847 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:12.826119 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7d00 after lost signal to thread 29721
I20260709 13:16:12.867525 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:12.902748 31599 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:12.908310 30880 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:12.916217 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.919544 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.921633 31029 raft_consensus.cc:2368] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:12.919611  2635 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:12.942263 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.942390 31026 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:12.943244 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.949071 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:12.953316 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:12.953840 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:12.948171 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:12.956804 30953 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:12.957002 31031 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:12.962073 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:12.962853 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 130880us
I20260709 13:16:12.965060 31028 raft_consensus.cc:2368] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:12.967553 30955 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:16:12.925660  3009 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:12.977061 31029 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:16:12.959581  3124 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:12.961674  3054 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:12.977993 30953 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:12.976483 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:12.984870 30958 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 9: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:12.986531 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:12.982467  3124 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.004343  3009 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:13.005513 30979 debug-util.cc:398] Leaking SignalData structure 0x7b0800095de0 after lost signal to thread 30815
I20260709 13:16:13.009120 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 2132) took 1073 ms. Trace:
I20260709 13:16:13.009462  2961 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.013576 30876 rpcz_store.cc:276] 0709 13:16:11.935598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.092334 (+156736us) service_pool.cc:224] Handling call
0709 13:16:13.008929 (+916595us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54001257d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:13.009035 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987862784}
I20260709 13:16:12.959924  2635 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.016441 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.017313 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.023012 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:12.989868  3031 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.025704 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.013357  3124 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:13.036629 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56725.3us
I20260709 13:16:13.035281 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.031036  3054 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.050798 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.059707 30958 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:13.030287  2961 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.072043 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.072503  3117 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.072736  2635 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.073060  3117 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.075224  3117 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:13.075867 30883 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:13.076123 31029 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:13.077605  3009 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.080231 30883 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:16:13.080596 30883 pending_rounds.cc:85] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 4
I20260709 13:16:13.080808 30883 pending_rounds.cc:107] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:16:13.081017 30883 raft_consensus.cc:2889] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.082270 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.083815 30847 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.085280  2860 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:13.085767  2860 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:13.085979  2966 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:13.086190  2860 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.086503  2966 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:13.087001  2966 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.090015  3069 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:13.099435  2860 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.101336  2970 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.103019  2961 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.103408 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.104980 30883 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:13.105502 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.106259 31030 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:13.107048 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.108685 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.109479 31030 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:13.109664 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.110380 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.110838 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.111027 31030 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:13.111438 31028 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:13.112106 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7ec0 after lost signal to thread 30907
W20260709 13:16:13.112422 30979 debug-util.cc:398] Leaking SignalData structure 0x7b080005c7e0 after lost signal to thread 30908
W20260709 13:16:13.113502 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7ee0 after lost signal to thread 30982
W20260709 13:16:13.113766 30979 debug-util.cc:398] Leaking SignalData structure 0x7b080036b3e0 after lost signal to thread 30983
I20260709 13:16:13.114488 30874 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:13.114986 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48714 (request call id 2143) took 1175 ms. Trace:
I20260709 13:16:13.115273 30874 rpcz_store.cc:276] 0709 13:16:11.939122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.020538 (+ 81416us) service_pool.cc:224] Handling call
0709 13:16:13.114283 (+1093745us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b540001fd28. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a37924 00007f273fc20227 00007f273fc1fab8 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6
0709 13:16:13.114930 (+   647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15593344}
I20260709 13:16:13.117065 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.117733 31032 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
W20260709 13:16:13.120800  3165 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 13:16:13.122617 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.123258 31024 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:13.123863 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2730) took 1061 ms. Trace:
I20260709 13:16:13.124148 31024 rpcz_store.cc:276] 0709 13:16:12.062321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.122335 (+1060014us) service_pool.cc:224] Handling call
0709 13:16:13.123805 (+  1470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:13.123255 31028 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:13.128044  3153 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:13.128455  3153 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.129345  3153 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.130319  3153 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.133829  3160 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.137068 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.138053 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:13.139050 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.140403  2936 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:13.140967  2936 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:13.141372  2936 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.143743  2635 raft_consensus.cc:2764] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:13.144845 30878 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:13.146143  2866 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.143616 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.151687 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:13.152205 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:13.153384  2970 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:13.154026  2970 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:13.154937  2970 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.157560 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.165591 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.166049  2936 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.169632  2936 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.172825 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.173439 31024 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:13.173616  3069 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.085417 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.180442 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.187004 31030 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:13.189742 30953 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:13.199807 30875 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:13.203680 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.206018 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:13.228078  3054 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.229478  3054 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.230118  3054 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.233250  3054 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.233294  2860 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:13.239503 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.199323  2955 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:13.244699 30874 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:13.249725 31024 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:13.253315 31032 raft_consensus.cc:1275] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:13.241938  3160 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.185734  2866 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.199156  3126 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:16:13.291949 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:13.316778 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 264842us
I20260709 13:16:13.326705 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.333353 30998 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.312696  3124 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.325559  2955 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.363508 30880 raft_consensus.cc:2468] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:13.364277 30955 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:13.327565  3054 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:13.375630 30979 debug-util.cc:398] Leaking SignalData structure 0x7b0800315f80 after lost signal to thread 31056
W20260709 13:16:13.376113 30979 debug-util.cc:398] Leaking SignalData structure 0x7b0800168dc0 after lost signal to thread 31057
W20260709 13:16:13.376827 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 291458us
W20260709 13:16:13.377651 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08000bdda0 after lost signal to thread 31629
W20260709 13:16:13.378024 30979 debug-util.cc:398] Leaking SignalData structure 0x7b0800370060 after lost signal to thread 31630
I20260709 13:16:13.361888  3153 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:13.337652  2936 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:13.336092  3031 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.378114 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 221530us
I20260709 13:16:13.369769  2955 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:13.333779  3160 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.373581  3056 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:13.396464 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.399133 30958 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.384253  3126 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:13.402674 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.403573 30951 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:13.404321 30950 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.404809 30998 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.385322  2635 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.385998  3009 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:13.424685 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.391251  2936 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:13.425534 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.429798 30956 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 16: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:13.388833  3153 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.433760 30951 raft_consensus.cc:1275] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:13.431339 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.416765  3126 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:13.442433 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.444432  3032 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:16:13.446158 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.446934 31599 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:13.439566  2558 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:13.396498  3031 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.448385 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.448902 30956 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:13.449272 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.450029  3031 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.450316 31601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:13.450853 31601 raft_consensus.cc:606] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.451110  3124 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.451179 31601 raft_consensus.cc:614] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.452921 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.453609 31603 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:13.436705 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.454799 30957 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:13.440023  3056 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.456466 31603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b53c19478dc740149d296778042dd3a8"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:13.457115 30998 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.457119 31603 raft_consensus.cc:606] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.460139  3154 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.461277  3154 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.462956  3154 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:13.463322  3154 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:13.463955  2635 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.464195  3153 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.466370  2635 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.447853 30949 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:13.418401  3185 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:13.448946 31600 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:13.469380 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.471657 30953 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:13.474485 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.476323  3032 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:13.475922  2936 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.476717  3032 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.477603  3032 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.479023  3032 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.481848 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.480856 30950 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:13.472005  2558 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.483415 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.463688  3154 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:13.511664  2558 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.497210 30949 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:13.512856 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:13.499543 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 138510us
I20260709 13:16:13.514290 30957 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:16:13.514182 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.490543  3104 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.479027  3109 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:13.439654  3009 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:13.523162 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.527025 30847 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.529843  2860 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:13.523461  3104 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.543057 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.543828 30957 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:13.546595 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.512881  3160 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:13.553944 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.554611 30949 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:13.559685 31601 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:13.564028 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:13.564297 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 107233us
I20260709 13:16:13.564903 31597 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:13.486183  3185 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.565721 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.573144 30874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:13.572083 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:13.574386 31029 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:13.575663 30957 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:13.576735 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.577396 31032 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:13.573628 31601 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:13.576720 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.523444  3109 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.573967 30874 raft_consensus.cc:606] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.584111 30874 raft_consensus.cc:614] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.579835 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.585909 31601 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.581418 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.586462 31601 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:13.555282  2866 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:13.590811 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.587019 30875 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:13.587083 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.588395 30883 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:16:13.560609  2635 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:13.593626 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.594331 31601 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:13.595613 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 68702us
I20260709 13:16:13.596709 30847 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.597681 30877 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:13.596625 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:13.571687  2860 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.592955 30883 pending_rounds.cc:85] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 8
I20260709 13:16:13.603559 30883 pending_rounds.cc:107] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:13.603901 30883 raft_consensus.cc:2889] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.590106 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.606225 30997 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.607923  3204 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:13.611966  3184 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:13.613090  3184 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:13.616550 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.618698 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.619021 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.619051 30876 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:13.587255  3054 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:13.633682 30882 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:13.646507 30874 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:13.605139  2635 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:13.598677  2961 consensus_queue.cc:1048] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:13.572175  3126 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.592064  3042 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:16:13.638716  3117 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:13.666500 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 979) took 2975 ms. Trace:
W20260709 13:16:13.667258 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 109388us
I20260709 13:16:13.577208  3056 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.616442  3160 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:16:13.640985  3054 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:13.667033 30878 rpcz_store.cc:276] 0709 13:16:10.691218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.698724 (+  7506us) service_pool.cc:224] Handling call
0709 13:16:12.327601 (+1628877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.145352 (+817751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.176575 (+ 31223us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54001266d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:13.666214 (+489639us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54001266d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:13.666417 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5607448832}
W20260709 13:16:13.672220 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66109.1us
I20260709 13:16:13.615549  3184 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.675797 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2710) took 2218 ms. Trace:
W20260709 13:16:13.662604  2966 consensus_meta.cc:287] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.006s
I20260709 13:16:13.658133  3201 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:13.681885 31027 rpcz_store.cc:276] 0709 13:16:11.328552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.329752 (+  1200us) service_pool.cc:224] Handling call
0709 13:16:11.330382 (+   630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.488226 (+157844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.488269 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.488331 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:11.488373 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.536669 (+2048296us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001f2554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:13.536714 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.536836 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361944320}
I20260709 13:16:13.685873 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:13.685379 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 95370.2us
I20260709 13:16:13.686512 31605 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:13.689560  2866 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:13.648041  3198 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:16:13.700176 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.671269  3199 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:13.681016  3126 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:13.708166 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:13.700109  3193 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:16:13.712812 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 93867.3us
I20260709 13:16:13.698881  3207 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.703661  2970 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.716532 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.701903  3104 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:13.688726  2966 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.706684  3199 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:13.734990 31601 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:13.727023  3200 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
I20260709 13:16:13.744997 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.712118  3201 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:13.747036  3160 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.755896  3214 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:13.758261 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:13.758359  3214 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:13.759039  3214 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:13.759315  3202 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:13.760521  3151 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:13.760581 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:13.761737  3203 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:13.762810  3210 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:16:13.763845  3211 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:16:13.765246  3162 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:13.765744  3162 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.766122  3162 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.767349  3117 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:13.768955  3196 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:16:13.734517  3207 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.773813  3109 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.777068  2966 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.743450  3188 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:13.780323  3109 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.785535 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.786201 31601 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:13.758086  3160 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.790194 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:13.793956 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 90496.6us
I20260709 13:16:13.805193 31605 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:13.808974 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:13.817075 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.817308 30958 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:13.817682 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.742038  3199 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:13.747512  3009 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.825507 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.837047 31605 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:13.837168 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.837953 31604 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:13.830237  3069 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:13.839171 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49063.3us
I20260709 13:16:13.791172  3124 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.842394 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 127648us
I20260709 13:16:13.844321 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:13.842309 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.739794  2970 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.725549  2635 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.852415 31597 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:13.850162 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.848737 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:13.851244 30924 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.752074  3104 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:16:13.859174 30924 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:13.863142 31601 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:13.868425 31605 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:13.875787  3160 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.876170  3218 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.877017  3218 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.878095 31597 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:13.880010  3215 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:13.884617  3222 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:13.887022  2966 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:13.888988 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.841898  3198 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:13.889714 30957 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:13.822938  3204 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:16:13.900717 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 83119.2us
I20260709 13:16:13.923213 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.855571  3145 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:13.924538  3145 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.856060  2961 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:13.927999 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:13.930575 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.924563 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.751327  3054 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.928155 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:13.860002  3207 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:13.935361 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:13.934353  2961 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.872421  3185 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:13.849104  3124 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.925004  3145 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:13.938364 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 90053.5us
I20260709 13:16:13.944537 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:13.944929 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.945959  3223 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:16:13.948019 31598 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:13.948390 31598 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:13.949084 31598 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.949473 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:13.950047 31598 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.951146 31602 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:13.941421  2961 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:13.952313  3224 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:13.942349 30951 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:13.852988  3069 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:13.956786 30951 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:13.925500  3009 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.950083 31601 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:13.939711 30880 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:13.928623  3222 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.901855  3218 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:13.951517 31602 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:13.968974 31598 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:13.966266 30951 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:13.965905 30954 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:13.979241 31025 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:13.981602 31032 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:13.982892 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.942940  3207 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.977631 30847 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:13.977481 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:13.989230 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:13.957674  3069 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:13.991989 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:13.992875 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.020428 31598 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:13.965655  3198 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.007306 31602 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:13.993626  3166 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.117s	user 0.005s	sys 0.000s
I20260709 13:16:14.034626 31601 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:13.992975  3117 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:14.039743 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.056286 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:14.057260 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 985) took 1018 ms. Trace:
I20260709 13:16:14.074474 30955 rpcz_store.cc:276] 0709 13:16:13.039111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.048443 (+  9332us) service_pool.cc:224] Handling call
0709 13:16:13.048819 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.369843 (+321024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.056948 (+687105us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b540008b6d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:14.057187 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722137984}
I20260709 13:16:14.060597 30880 raft_consensus.cc:2368] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:14.042891  3145 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.043154 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.087018 30874 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:14.044857 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:13.970497  3009 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.045660  3188 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:16:14.046412 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.046247  3198 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.055141  2788 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:14.089622 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.089982  2788 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:14.090319 30883 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:14.090507  3009 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:14.090763  3198 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:14.090926 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.046689  2970 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.027752  3069 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:14.046893  3219 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:14.047649  3163 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:14.049759  3213 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:13.992976  2966 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:13.933468  3201 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:13.993945  3207 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.121320  3207 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:14.051707  3154 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.540s	user 0.004s	sys 0.003s
I20260709 13:16:14.007186  3212 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:16:14.106511  3162 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.112053 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:14.085704  2866 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:14.056681  3097 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.090446  2788 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:14.105654  3229 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:14.058604  2961 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.060096  3117 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:14.208719 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 96771.8us
W20260709 13:16:14.195045 30924 leader_election.cc:336] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Timed out: RequestConsensusVote RPC to 127.29.5.129:41351 timed out after 1.668s (SENT)
I20260709 13:16:14.204669 30954 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:13.994122  3222 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.210330 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.128768  3069 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:14.124354  3096 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:14.203322  3097 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.217895 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.219050  3097 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:14.219851  3223 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:14.221982 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:14.223325 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:14.219609 31570 leader_election.cc:400] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:14.224161  3084 consensus_queue.cc:1059] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:14.224815 31570 leader_election.cc:403] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:14.224399  3069 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.225201  3084 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:14.225435  3238 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:14.225611  3084 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.224196 31571 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.226922  3084 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.228314  3084 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.229360  3139 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:14.230059  3139 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:14.212719  2970 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.232448  3238 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:14.232908  3238 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.232990  3096 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.234161 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.233821  3238 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.178289  3219 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.235689 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.196544  2866 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:14.227677  3182 log.cc:927] Time spent T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.811s	user 0.004s	sys 0.000s
I20260709 13:16:14.207798  3185 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.214421  3117 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.288281  3219 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:14.291311  3214 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.002s
I20260709 13:16:14.279400 30955 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:14.266675  3204 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:14.291821  3214 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.294575 30882 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:14.295097  3214 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.266783  3104 consensus_queue.cc:1059] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:14.295962 30952 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:14.232175 31571 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:14.244495 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49469.3us
I20260709 13:16:14.178328  3154 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.204988  2966 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:16:14.283301  2866 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:14.278466 31570 leader_election.cc:400] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:14.314652 31570 leader_election.cc:403] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:14.307884  3214 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:14.207705  3054 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:16:14.315547 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:14.316221  3226 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:14.316645  3226 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.219615  3097 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:16:14.299906  3124 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:14.278322 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 313696us
W20260709 13:16:14.333571 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101472us
I20260709 13:16:14.318697  3224 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.329918  3124 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:14.338114 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 59857.7us
I20260709 13:16:14.354179 31571 leader_election.cc:400] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:14.306536  2788 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.370355 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.374025 30952 raft_consensus.cc:1240] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:14.375046 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.374881  3124 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.376063  3096 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:14.376295 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.377462 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.377583  3124 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.378227 30958 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:14.379231 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:14.379439 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.379791 30958 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:14.380522 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.382126 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 833) took 1459 ms. Trace:
I20260709 13:16:14.382627 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.376124 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.384671 31598 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:16:14.385015  3231 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.339s	user 0.002s	sys 0.000s
I20260709 13:16:14.385455 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.382470 31026 rpcz_store.cc:276] 0709 13:16:12.922854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.958974 (+ 36120us) service_pool.cc:224] Handling call
0709 13:16:12.968487 (+  9513us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:13.008104 (+ 39617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.008133 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:13.008813 (+   680us) log.cc:844] Serialized 78 byte log entry
0709 13:16:13.294295 (+285482us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:13.318105 (+ 23810us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.324627 (+  6522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.324728 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.226969 (+902241us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:14.381803 (+154834us) raft_consensus.cc:1685] finished
0709 13:16:14.381895 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.382049 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28335,"prepare.queue_time_us":23515,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":40142,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":26711,"spinlock_wait_cycles":32327936,"thread_start_us":285044,"threads_started":1,"wal-append.queue_time_us":360992}
W20260709 13:16:14.389204  3228 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
I20260709 13:16:14.389037 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:14.390242  3169 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:14.390684  3169 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.390825  3236 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.394136 31030 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:14.395862 31025 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:14.397915 31028 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:14.400101 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:14.404490 31024 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:14.342795  3185 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:14.413610 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.410650 30847 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:14.340157  3249 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:14.383652 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.417580 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.347514  3097 consensus_queue.cc:1243] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:14.317499  3226 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.447687 30879 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:14.457602 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.490168 31605 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:14.490684 30879 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:14.416390  2558 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:14.351612  3204 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:16:14.491569 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.498090 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.448127  3069 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:14.508134 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.508356 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.391671  3169 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.339530  3199 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.510519 31597 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:16:14.519819 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.496095  2558 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.521414 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.521777 31605 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:14.524097 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:14.505050  2788 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:14.524896 31605 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:14.456957  2688 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:16:14.497042  3214 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.528733 31605 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.531414 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:14.518869  3032 consensus_meta.cc:287] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.039s	user 0.004s	sys 0.009s
I20260709 13:16:14.474704  3148 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:16:14.529706 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.539487 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.531153 31605 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.517577  3069 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:14.527496  2558 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:14.521737  3249 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.547355 31028 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:14.542563 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:14.582530 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.583118 31024 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:14.583832 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.547719 30879 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:14.533465  3185 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:14.538158  2961 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.541282  3148 consensus_queue.cc:1243] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:14.521868  3097 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:16:14.629083 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.586292  3222 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:14.635012 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.634951 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.540706  3214 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.641556 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.630055  3185 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.642673  3185 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.650394 31597 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:14.654573  3220 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:16:14.655489  3220 consensus_queue.cc:1243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:16:14.655952  3256 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:16:14.656749  3252 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:16:14.658628  3253 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:16:14.659406  3244 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:16:14.664538 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.670450 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2275) took 1110 ms. Trace:
I20260709 13:16:14.644829  3162 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:14.653206  2955 consensus_meta.cc:287] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.248s	user 0.013s	sys 0.000s
I20260709 13:16:14.680898 30949 rpcz_store.cc:276] 0709 13:16:13.560229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.560455 (+   226us) service_pool.cc:224] Handling call
0709 13:16:13.579358 (+ 18903us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:13.597980 (+ 18622us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:14.091665 (+493685us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18003a27c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:16:14.177973 (+ 86308us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.415414 (+237441us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:14.457170 (+ 41756us) log.cc:844] Serialized 78 byte log entry
0709 13:16:14.457383 (+   213us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.457632 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.457994 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.489820 (+ 31826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.495804 (+  5984us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.670108 (+174304us) raft_consensus.cc:1685] finished
0709 13:16:14.670138 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.670370 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93555,"prepare.queue_time_us":291099,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":6680,"raft.queue_time_us":64031,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":76473,"spinlock_wait_cycles":48970752,"thread_start_us":233621,"threads_started":2,"wal-append.queue_time_us":303198}
I20260709 13:16:14.690461  2866 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.691010  3195 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:14.691918 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.694027 30876 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:14.695195 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.691490  3195 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.680399 31597 raft_consensus.cc:2376] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14. Re-sending same reply.
I20260709 13:16:14.696910 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:14.701979 30876 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:14.702562  2866 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.702664 31025 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:14.676239  3154 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.703838 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:14.701292 30879 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:14.679630 31601 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:14.703249  3117 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.699688 31030 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:14.705108 31601 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.708647 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.718135 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:14.716553 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:14.722806 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.722235 30922 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.734298 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.700345  2966 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:14.747298 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.669852  3069 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.750352 31601 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.716678  3199 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:14.765626 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44380.6us
W20260709 13:16:14.776638  3254 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:14.776723 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.750476  3124 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:14.784549 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:14.788595  3264 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:16:14.684692  3249 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.789074 30950 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:14.790356 30949 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:14.790529  2966 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.790433  3117 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.793761  2558 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.768703  3242 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:16:14.696326  2955 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.794413 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.796767  3188 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.811368 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:14.794502 31031 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:14.818463 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:14.800493  2860 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.796401  2961 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:16:14.832398 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:14.838788 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:14.839474 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.831254 31025 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:16:14.846014 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.843320 30879 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:14.847200 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.848049 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.849807 31571 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.847916 31025 pending_rounds.cc:85] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 6
I20260709 13:16:14.853196 31025 pending_rounds.cc:107] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:16:14.853542 31025 raft_consensus.cc:2889] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.828225  3096 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:14.828661  3199 consensus_queue.cc:1048] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:16:14.820977  3224 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:16:14.855798 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:14.845824  3267 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:14.830849  3106 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:16:14.863613 31571 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:14.852313  3223 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.003s
I20260709 13:16:14.865288 31031 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:14.821257  3263 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:16:14.803874  3195 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.845669  3097 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:14.868184 31025 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:14.842363  3204 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:14.855782  3265 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:16:14.902201  3242 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.902640  3097 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:14.903121  3097 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:14.903018  3242 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:14.904731  3178 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:14.905143  3178 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.905364  2966 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.907842 31605 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:14.908681 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.909835  3195 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:14.913514 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 825) took 2057 ms. Trace:
I20260709 13:16:14.913913 31023 rpcz_store.cc:276] 0709 13:16:12.855615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.872276 (+ 16661us) service_pool.cc:224] Handling call
0709 13:16:12.872588 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.872863 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:13.187178 (+314315us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.946852 (+759674us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b180040a200. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:14.912633 (+965781us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180040a200. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:16:14.912955 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.913140 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.913194 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:14.913256 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.913328 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.913447 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74493,"prepare.queue_time_us":120407,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":33182,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7476,"spinlock_wait_cycles":53495040,"thread_start_us":524580,"threads_started":2,"wal-append.queue_time_us":260858}
I20260709 13:16:14.915663 31605 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:16:14.916087 31605 pending_rounds.cc:85] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 9
I20260709 13:16:14.916289 31605 pending_rounds.cc:107] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:14.916501 31605 raft_consensus.cc:2889] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.916885  3185 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.917655 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.918416 31597 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:14.918918 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:14.920387  2558 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.921141 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.875747  2866 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:16:14.921833  2866 consensus_queue.cc:1243] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:14.922016  3106 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:14.922422  3106 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:14.922711 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.923238  3106 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.847538  2860 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.923913 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.923401 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.924525  3106 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.924700 31605 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:14.924860 31597 raft_consensus.cc:2410] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:16:14.925784  2860 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:14.842259  3188 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.928572  3188 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:14.861825  3219 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:14.930649  3139 consensus_queue.cc:1175] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95b998a6735f4180986a8b8f7d84b8fc" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:14.932027  3219 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:14.932976 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 69466.6us
I20260709 13:16:14.934141  2955 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:14.935246  3214 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:14.937582  2961 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:14.938120  2961 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:14.942044  3224 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.942656  3224 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:14.858681  3246 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:14.945070  3210 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:14.947192 30996 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:14.948181  3154 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:16:14.948345  3234 consensus_queue.cc:1175] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95b998a6735f4180986a8b8f7d84b8fc" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:14.949458 30996 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:14.950150  3154 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.953064 30996 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:14.876468 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:14.856930  3206 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:14.877435 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:14.895344 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.854949  3237 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:14.963464 31598 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:14.965553 31598 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12.
I20260709 13:16:14.978660 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:14.979632 30955 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:14.956213 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:14.985023 30958 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:14.983973 30953 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:14.953858  3148 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.026533 31605 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:14.960884  3223 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:14.985419  3267 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:16:14.964727  3185 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:14.977241  3237 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.872651  3192 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 13:16:14.982700  3215 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:14.982980  3234 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:16:15.041253 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 194086us
I20260709 13:16:15.043798 30922 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:15.045243 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:15.048926 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.047343 30922 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:15.043143  3237 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:15.045326  2788 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.002s
I20260709 13:16:15.043612  3214 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.060102 31599 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:16:15.063078  3180 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:16:15.067056 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:15.054531  3106 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:15.075652 30847 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:15.130234 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 76722.3us
I20260709 13:16:15.131430 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:15.132411 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 56836.6us
I20260709 13:16:15.135385 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.065236  2788 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:15.136083 30875 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.139025 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:15.130102  3069 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.151562  3278 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.154696  3279 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:15.148926  3222 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:16:15.154808  3280 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:15.157727  3282 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:16:15.193935 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 54958.9us
I20260709 13:16:15.170641 30875 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:15.075098  3214 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.198724 31571 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:15.178145 30955 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:15.178586  3223 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:15.183728  3124 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.118076  3180 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:15.203735  3180 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:15.204097  3180 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:15.187204 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 139942us
I20260709 13:16:15.204596  3126 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:15.204919  3180 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.180449  3224 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.200179 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.200680  3279 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:15.201289  3285 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:15.201886  3261 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.525s	user 0.001s	sys 0.001s
I20260709 13:16:15.202261  3214 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.202397  3177 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:15.129105  3106 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.223976  3177 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:15.225066  3177 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.186015  3222 consensus_queue.cc:1243] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:15.227306  3295 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:15.221146 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.179366  3069 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.205912  3280 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:15.249306 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:15.252424 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.251118 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:15.283558 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 68578.9us
I20260709 13:16:15.283290 30951 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:15.286103 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.284978 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2286) took 1383 ms. Trace:
I20260709 13:16:15.288295 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.288506 30954 rpcz_store.cc:276] 0709 13:16:13.901948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.224198 (+322250us) service_pool.cc:224] Handling call
0709 13:16:14.224512 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.224841 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.224867 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.225358 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.368587 (+143229us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:14.368635 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.368707 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.249010 (+880303us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b240010e1b8. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f27379f39c4 00007f27379f1acb 00007f2737bacdc9 00007f2737baca55 00007f2737babfb0 00007f273a822488 00007f273a822be8 00007f273a7fa398 00007f273a7f576a 00007f273a7f4bb6
0709 13:16:15.250280 (+  1270us) raft_consensus.cc:1685] finished
0709 13:16:15.250312 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.284903 (+ 34591us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1334,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":42009856,"thread_start_us":142826,"threads_started":1,"wal-append.queue_time_us":359926}
I20260709 13:16:15.300331  3279 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.249974  3295 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.185614  3278 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:15.308585 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.325786 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:15.218920  3223 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.327689 30951 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:15.357784 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.351846 31024 raft_consensus.cc:1217] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[11.10-15.12]   Dedup: 11.10->[13.11-15.12]
I20260709 13:16:15.402654 31031 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:15.402681 31024 pending_rounds.cc:85] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 10
I20260709 13:16:15.404107 31024 pending_rounds.cc:107] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:16:15.404409 31024 raft_consensus.cc:2889] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.366173 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.342697 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.231129  3180 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.406319 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.406952 30955 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.350612 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:15.378418 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.385082 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:15.331851 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.339572 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:15.358366 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:15.409013 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 69530.5us
I20260709 13:16:15.409550 31026 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:15.409924 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:15.410894 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:15.418591 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 435117us
I20260709 13:16:15.377188  3278 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.374142  3106 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.324759  3206 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:15.434485 30951 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:15.442643  3153 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.443264  3153 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.445540  3153 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:15.332019  3222 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:16:15.447932  3222 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:15.448721  3222 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:15.450534  3097 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:16:15.450706  3145 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:15.451218  3097 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.452310  3242 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:15.452839  3242 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.453459  3097 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.454882  3242 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.455552  3223 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.287374  3280 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.457605  3280 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.410629  3292 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.459004  3295 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.455425  3242 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:15.460035 31605 raft_consensus.cc:1240] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:15.460587 30954 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:16:15.461635 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.468417 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:15.468676 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77261.2us
I20260709 13:16:15.469136 30875 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.464773 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.368806  3294 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:16:15.331995  3124 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:16:15.475454 30874 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:15.479157 30879 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:15.480125 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.480638 30882 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:15.480448 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.500826 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.501482 30876 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.501771 30880 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.465555  2788 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:15.482825 30874 pending_rounds.cc:85] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 9
I20260709 13:16:15.511381 30874 pending_rounds.cc:107] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:16:15.511656 30874 raft_consensus.cc:2889] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.505558 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.514081 30877 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:15.466507  3242 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:15.520251 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.528225 30882 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:15.529502 30882 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:15.529516  3219 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:15.530534  3219 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:15.531373  3219 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.533123 31029 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:15.535509 30883 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:15.535708  3226 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:15.547920 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.549115  3237 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.551317  3237 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:15.555217 31600 raft_consensus.cc:2410] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:15.475368  3106 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:15.555157 30875 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:15.549414 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.560324 30955 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:15.564412 30876 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:15.561848 30878 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:15.565975 30875 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:15.518143  2788 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:15.570964 30875 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:15.572897 30878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 988) took 1531 ms. Trace:
I20260709 13:16:15.573282 30878 rpcz_store.cc:276] 0709 13:16:14.041064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.041259 (+   195us) service_pool.cc:224] Handling call
0709 13:16:14.041630 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.558049 (+1516419us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b5400121ea0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abd1dc0 00007f273ac5c1c0 00007f273ac5d231 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c
0709 13:16:15.570083 (+ 12034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.572831 (+  2748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147321216}
I20260709 13:16:15.467720  3206 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.575083 30998 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:15.579634  3296 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.580374 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:15.581070 30876 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.575143  3210 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:16:15.584116 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:15.585036  3296 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:15.584481 30880 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:15.574222  2788 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.567052  3106 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.570642  3145 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:16:15.636828 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 217271us
I20260709 13:16:15.605126  3296 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:15.614195  3069 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:15.606492 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 404463us
I20260709 13:16:15.591477 30876 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:15.645395 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:15.665524 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:15.622891  2558 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:15.666975  3301 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.667377 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:15.668802 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1894) took 1796 ms. Trace:
I20260709 13:16:15.669361  3292 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.669317 30956 rpcz_store.cc:276] 0709 13:16:13.872149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.872283 (+   134us) service_pool.cc:224] Handling call
0709 13:16:13.950763 (+ 78480us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:16:13.950975 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.092784 (+141809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.092831 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.101749 (+  8918us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.309062 (+207313us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.309119 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.668422 (+1359303us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400112454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:15.668486 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.668545 (+    59us) raft_consensus.cc:1685] finished
0709 13:16:15.668565 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.668734 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2879,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":27479,"spinlock_wait_cycles":356209792,"thread_start_us":204209,"threads_started":1,"wal-append.queue_time_us":400349}
I20260709 13:16:15.671991  3214 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:15.672233  3109 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:15.672441  3214 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.672758  3109 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:15.673719  3109 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.672844  3214 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.685292  3145 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:15.685791  3145 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:15.688465  3145 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.689638  3145 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.690778 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.690680  3194 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:15.693001  3206 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:15.693611 30956 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:15.691578 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.694986 30951 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:15.694281 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.695959 30950 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:15.697106  3148 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.697816  3260 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:15.698342  3260 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.698894  3154 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:15.697606  3148 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.700913  3162 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:15.701289  3162 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:15.701323  3148 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.702741 30950 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:15.703047  3260 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:15.692139 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46881.3us
I20260709 13:16:15.706563 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:15.706907  3153 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:15.711637 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.714869 30877 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:15.720602 30955 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:15.717538 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:15.616402  3209 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.709224 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:15.719233 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 51928.2us
I20260709 13:16:15.736282 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:15.605093  3210 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:16:15.739579 30922 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:15.738147 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:15.745041 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:15.746412 31603 raft_consensus.cc:2410] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:16:15.725337  3214 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.708317  3056 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:16:15.748320  3308 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:16:15.748183 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.749723 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.750689 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.751262 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.752182 30881 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:15.752862 31031 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:15.753254 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:15.689858  3296 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.754014 31605 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:15.754787 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:15.756467  3212 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.756822  3212 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:15.757048 31605 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:15.757886  3278 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.759925 31029 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:15.760286 31032 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:15.761008  3106 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:15.761364 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:15.761976 31597 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:15.614023  3242 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.757567  3212 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.576301  3201 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
I20260709 13:16:15.586746  3216 consensus_queue.cc:1059] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.204s
W20260709 13:16:15.836055  3290 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:16:15.819514  3148 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:15.822688 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.822002 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.845963 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:15.822365 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.851876 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1184) took 1050 ms. Trace:
I20260709 13:16:15.852087 31029 raft_consensus.cc:2410] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:15.763595 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:15.852789 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.762601 30883 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:15.782655 31597 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:15.800616 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.852290 31598 rpcz_store.cc:276] 0709 13:16:14.801892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.176464 (+374572us) service_pool.cc:224] Handling call
0709 13:16:15.176780 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.176996 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:15.507932 (+330936us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.851531 (+343599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.851584 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:15.851629 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.851690 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.851823 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10742,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":64187,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"thread_start_us":588440,"threads_started":2}
I20260709 13:16:15.822149  2872 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.745728  3209 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.857179  2872 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.857604  3238 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.858956  3209 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:15.859139  2872 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.746138  3260 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:15.856422  3304 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:15.862041  2966 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:15.862498  2966 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.862890  2966 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:15.856523 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93011.8us
I20260709 13:16:15.867424 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:15.751304 31023 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:15.869520 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:15.870075 31597 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.784504 30998 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:15.874053 31029 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:15.757160  3124 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:15.878198  3212 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.880838 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.882910 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:15.887698 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.889983 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:15.890919  2545 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:15.891568  2545 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:15.892937  2545 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.897410 30955 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:15.872625  3216 consensus_queue.cc:1243] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:15.900722  3106 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.900991 30956 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:15.901364  2558 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.901902  2558 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.902155  3300 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:15.903062  3300 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:15.903431  3300 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:15.901232 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:15.901273  3106 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.904280  3300 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.905560  3300 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:15.906355  3106 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:15.907922  2558 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.910518 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.911321 30950 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:15.910569  3242 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:15.916042  3212 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:15.916338 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.916802  3212 consensus_queue.cc:1059] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:15.910782 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:15.923825 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:15.866534  3260 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.925590  3260 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:15.931051  3180 consensus_meta.cc:287] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.005s
I20260709 13:16:15.931838 30879 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:16:15.932101  3069 raft_consensus.cc:3055] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:15.932562  3069 raft_consensus.cc:740] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:15.933442  3069 consensus_queue.cc:260] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.935253 31598 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:15.937230  2788 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:15.937830  3222 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:15.938740  3222 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:15.939126  3222 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:15.897914  3292 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:16:15.940034  3222 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:15.897363  3294 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:16:15.941216  3295 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:15.919135  3246 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:15.941087  3224 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:15.942719  3224 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:15.824069  3214 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:15.943621  3224 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:15.976073 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.053022 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:15.988624 31597 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
W20260709 13:16:15.978096 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.056443 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.953892 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 989) took 1757 ms. Trace:
I20260709 13:16:16.028405 31603 pending_rounds.cc:85] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:16:16.057847 31603 pending_rounds.cc:107] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:16.058240 31603 raft_consensus.cc:2889] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.059993 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:16.060734  3260 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:16.061089 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:16.062948 31029 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
W20260709 13:16:16.055402 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.944734  3124 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.057575 30952 rpcz_store.cc:276] 0709 13:16:14.196614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.296786 (+100172us) service_pool.cc:224] Handling call
0709 13:16:14.297073 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.374517 (+ 77444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.953640 (+1579123us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b540008c0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:15.953833 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176533760}
I20260709 13:16:15.944823  3304 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:16.091732 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 206993us
I20260709 13:16:16.041324  3236 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.188742 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.059051  3222 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.062364  3224 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:16.062186  3173 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.189517 30952 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:16.200106 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:16.206205 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.201481  3226 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:16.072511  3199 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.248157 31032 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:16.247848 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.253610 30954 raft_consensus.cc:1240] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:15.910494  2966 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:16.209386 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:16.211241 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:16.256680 31596 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:16.208981  3304 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.194764  3294 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.254168 30874 raft_consensus.cc:2368] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:16.278316 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.279027 30950 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:16.261253  2686 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.289214 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 421807us
I20260709 13:16:16.293026 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:16.262423  3238 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:16:16.302196 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.303297 30950 raft_consensus.cc:2410] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:16.268501  3213 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.255961  3199 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.193241  3124 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.209354  3236 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.328908 31571 leader_election.cc:400] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:16.330921 31571 leader_election.cc:403] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:16.263535  3226 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.260226  3173 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.282433  3304 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.314574  2788 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:16.297571  3300 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:16.318111  3326 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.320672  3214 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:16.359413 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 330955us
I20260709 13:16:16.320307  2545 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:16.364243 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.364163  3326 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.364573  2545 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:16.365549 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.366144 30950 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:16.365768  2545 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.366530  3326 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:16.363250 30848 connection.cc:256] RPC call timeout handler was delayed by -1.0725686190000943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 13:16:16.367190  3214 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:16.368428  3214 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:16.352456  3279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.013s	sys 0.003s
W20260709 13:16:16.369781  3279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.013s	sys 0.003s
I20260709 13:16:16.370457 30882 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:16.372505  3279 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:16.373260 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:16.373106  3279 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.374207  3326 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.375221 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:16.374780  3270 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:16.376745  3268 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:16.376875  3270 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:16.377847  3268 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:16.378904  3270 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:16.381703  3279 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:16.388782  3314 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:16:16.390448  3324 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:16:16.391567  3319 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:16.397863 30955 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:16:16.398257 30955 pending_rounds.cc:85] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 9
I20260709 13:16:16.398488 30955 pending_rounds.cc:107] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:16:16.398736 30955 raft_consensus.cc:2889] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.301362  2686 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.294342  3294 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.334959  3235 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14.
I20260709 13:16:16.305591  3178 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.400792  3106 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.415627  3124 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:16.416288  3260 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:16.416594  3317 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.492s	user 0.002s	sys 0.000s
I20260709 13:16:16.417829  3199 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:16.421768  3304 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:16.424898 31596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1198) took 2062 ms (client timeout 1861 ms). Trace:
W20260709 13:16:16.428669 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 236193us
I20260709 13:16:16.427160  3178 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.317167  3213 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:16.430555 31596 rpcz_store.cc:269] 0709 13:16:14.360668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.377199 (+ 16531us) service_pool.cc:224] Handling call
0709 13:16:16.423222 (+2046023us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54000104d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:16.423351 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4320124672}
I20260709 13:16:16.435092  3304 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:16.437173  2961 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:16.442739 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 246977us
W20260709 13:16:16.444999 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.445188 30923 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:16.427556  3106 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.450485 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:16.451297 31596 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:16.452500 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:16.453157 31596 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:16.454670 31596 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:16.466825 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:16.469265 30874 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:16.472445  3236 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:16.474910  3104 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.475396  3104 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.503624  2788 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:16.732388 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 265994us
I20260709 13:16:16.734131 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:16.742898 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:16.745950 30952 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:16.626114  3117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.048s	sys 0.064s
W20260709 13:16:16.667315  3334 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:16:16.621387  2966 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:16.509424  3106 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:16.683174  3332 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.692723  3213 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:16.703013  3226 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:16.682767  3304 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:16.747905  2788 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:16.750893  3124 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:16.767865 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:16.751683  3117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.050s	sys 0.070s
W20260709 13:16:16.757588  3222 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
W20260709 13:16:16.772085 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.781529 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.792462 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.774304  3104 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:16.773291  2788 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:16.799803 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1225) took 1505 ms. Trace:
I20260709 13:16:16.800187 31603 rpcz_store.cc:276] 0709 13:16:15.294112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.027605 (+733493us) service_pool.cc:224] Handling call
0709 13:16:16.028196 (+   591us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:16.065213 (+ 37017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.065589 (+   376us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:16.066244 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 13:16:16.316361 (+250117us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:16.316401 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.316472 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.799541 (+483069us) raft_consensus.cc:1685] finished
0709 13:16:16.799559 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.799710 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5912,"raft.queue_time_us":13521,"spinlock_wait_cycles":6504704,"thread_start_us":249770,"threads_started":1,"wal-append.queue_time_us":382787}
I20260709 13:16:16.804050 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:16.804817 31603 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:16.772195  3332 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:16.810603 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 433263us
W20260709 13:16:16.800395  3224 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
W20260709 13:16:16.811242 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.799285  3173 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:16.777225  3304 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.802940  2788 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:16.818128 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:16.822834 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 995) took 2296 ms. Trace:
I20260709 13:16:16.824986 30957 rpcz_store.cc:276] 0709 13:16:14.526370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.662106 (+135736us) service_pool.cc:224] Handling call
0709 13:16:14.662426 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.662652 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:14.662981 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.821817 (+158836us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.183424 (+361607us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b180047fb60. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:15.926630 (+743206us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b180047fb60. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:16.741567 (+814937us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b180047fb60. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:16:16.822400 (+ 80833us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.822456 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:16.822511 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.822601 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.822752 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2727,"prepare.queue_time_us":664,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":6944,"raft.queue_time_us":36197,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":10283,"spinlock_wait_cycles":30663040,"thread_start_us":221918,"threads_started":2,"wal-append.queue_time_us":204930,"wal-append.run_cpu_time_us":1620,"wal-append.run_wall_time_us":1057540}
I20260709 13:16:16.802459  3222 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:16:16.830760 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 63058.7us
I20260709 13:16:16.798599  3177 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:16.834635  3177 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.820494  3224 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:16.836001 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 95897.9us
I20260709 13:16:16.838784 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:16.845507  3316 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.917s	user 0.010s	sys 0.015s
I20260709 13:16:16.847448 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1002) took 1781 ms. Trace:
I20260709 13:16:16.847837 30958 rpcz_store.cc:276] 0709 13:16:15.065773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.065984 (+   211us) service_pool.cc:224] Handling call
0709 13:16:15.118154 (+ 52170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.136707 (+ 18553us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:15.149683 (+ 12976us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.703691 (+554008us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180047faa0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:16:15.876427 (+172736us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.877034 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.877577 (+   543us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:15.877619 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.877904 (+   285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.844795 (+966891us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:16.847150 (+  2355us) raft_consensus.cc:1685] finished
0709 13:16:16.847180 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.847382 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13634,"prepare.queue_time_us":14875,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":85004,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":13582,"spinlock_wait_cycles":35991552,"thread_start_us":172470,"threads_started":1,"wal-append.queue_time_us":755267}
I20260709 13:16:16.850708 30958 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:16.853626  3348 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:16.857820 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:16.858798  3348 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:16.869685 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.870404 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.872458  3339 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:16:16.877102 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.880358  3246 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:16.881022  3246 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:16.884486  3345 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:16.885906  3340 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:16.822644  3336 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:16.894061 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.895123 30951 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:16.901160 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:16.902701 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.903874 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.838325  3224 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.905104 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:16.943300 30949 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:16.950227 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:16.925652  3224 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:16.904978  3242 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.892364  3117 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:16:16.925375  3346 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:16.953389 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:16.954543 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 107687us
I20260709 13:16:16.953087  3351 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:16.973558 30949 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:16.973789 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:16.977552 30953 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:16:16.978053 30953 pending_rounds.cc:85] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 10
I20260709 13:16:16.978338 30953 pending_rounds.cc:107] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:16:16.978626 30953 raft_consensus.cc:2889] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.980077 30953 raft_consensus.cc:1217] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 13:16:16.980997 30953 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:16.959827  3104 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:16.976169  3242 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:16.989276  3173 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.992285  3341 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:16.968710  3346 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.991351 30952 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
W20260709 13:16:16.997397  3306 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.073s	user 0.005s	sys 0.001s
W20260709 13:16:17.000727 31600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1199) took 2639 ms (client timeout 1950 ms). Trace:
W20260709 13:16:17.002889 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.008332  3304 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:16.992916  3348 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:16:17.009629 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 846) took 1263 ms. Trace:
W20260709 13:16:17.011113 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 1.2266e+06us
W20260709 13:16:17.013137 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 58212.6us
I20260709 13:16:16.900065  3336 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:17.054301 31600 rpcz_store.cc:269] 0709 13:16:14.360946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.380295 (+ 19349us) service_pool.cc:224] Handling call
0709 13:16:17.000452 (+2620157us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54004deed4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:17.000628 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2699284352}
I20260709 13:16:17.011859  3216 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:17.113013 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:17.115494 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1184) took 2754 ms. Trace:
I20260709 13:16:17.117194 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:17.104118 31027 rpcz_store.cc:276] 0709 13:16:15.745863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.746049 (+   186us) service_pool.cc:224] Handling call
0709 13:16:15.755541 (+  9492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.755725 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:15.755981 (+   256us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.899882 (+143901us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.009119 (+1109237us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b18001c9ea0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:16:17.009275 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.009325 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:17.009380 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.009451 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.009571 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1097707,"prepare.queue_time_us":6332,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":1143956,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":25215,"spinlock_wait_cycles":57218304,"thread_start_us":132295,"threads_started":1,"wal-append.queue_time_us":159466,"wal-append.run_cpu_time_us":1326,"wal-append.run_wall_time_us":1001355}
I20260709 13:16:17.116024 31599 rpcz_store.cc:276] 0709 13:16:14.355255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.355411 (+   156us) service_pool.cc:224] Handling call
0709 13:16:14.355714 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.062015 (+706301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.108936 (+2046921us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400459054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:17.109109 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619235200}
W20260709 13:16:17.056478  3350 log.cc:927] Time spent T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:17.125571 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.132903 31602 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:17.091179  3163 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.053195  3346 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.012189  3104 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.133002 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.134049 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.104269  3332 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.133045 31030 raft_consensus.cc:3055] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:17.105144  3338 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:17.133569  3343 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:16:17.091840  3106 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:17.055687  3173 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.338584 31601 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:17.145587 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:17.394047 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 420325us
I20260709 13:16:17.394927 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:17.394979 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 249455us
I20260709 13:16:17.142688  3160 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:17.398358  3160 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:17.238806 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.401041 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.401677 31570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.528s (SENT) [suppressed 24 similar messages]
I20260709 13:16:17.187847  3117 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.140647  3360 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:17.405167 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 292249us
I20260709 13:16:17.185603 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.405699 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:17.406044 30996 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:17.159241 31031 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:17.167415 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:17.408195 31029 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:17.409773 31602 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:16:17.410670 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1176) took 3463 ms. Trace:
I20260709 13:16:17.412184 31030 raft_consensus.cc:740] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:17.413646 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:17.439234 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.444300 31023 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:17.139314  3235 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.444432 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 49560.4us
I20260709 13:16:17.411139 31602 rpcz_store.cc:276] 0709 13:16:13.947598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.950571 (+  2973us) service_pool.cc:224] Handling call
0709 13:16:13.950872 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.939784 (+988912us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b1800389340. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac95646 00007f273abcf58e 00007f273ac50f9e 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:16:17.111401 (+2171617us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b58000fe6d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:16:17.410347 (+298946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.410599 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648509056}
W20260709 13:16:17.186564  3357 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:17.137552  3210 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:17.137765  3151 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.452912 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:17.146456  3104 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:17.167793  3304 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:17.321825  3279 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:17.474098 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.393169  2966 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.476178  3353 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.417014  3213 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:17.403342  3117 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:17.481665 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.541549 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.443589  3109 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:17.482443  3359 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.151039  3177 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.143697  3163 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.483242  3151 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.484030  3210 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.484933 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.474393  2860 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:17.187353  3162 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.450289  3106 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.441751  3338 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.457175 31030 consensus_queue.cc:260] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.416522  3234 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.480497  3361 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:16:17.495554  3242 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.548162 31029 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:17.470862  3360 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.453718  3332 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.552660 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:17.616039  3332 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.616456  2686 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.616607 31602 raft_consensus.cc:2410] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:17.618310  3332 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.158320  2961 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.619145  3371 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.619305  2961 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.619964  3371 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:17.572028 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 170353us
W20260709 13:16:17.622457  3328 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.226s	user 0.001s	sys 0.008s
W20260709 13:16:17.624298 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.545136 31601 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:16:17.578166 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 172184us
I20260709 13:16:17.578398 31030 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:17.625291 30996 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12.
I20260709 13:16:17.583019 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.554428  3365 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.469492  3235 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.574602  3213 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:17.557271  2860 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.582636  3032 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.586426  3163 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.582650  3234 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.592777 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2305) took 1193 ms. Trace:
I20260709 13:16:17.596449  2545 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:17.598493  3355 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.603s	user 0.001s	sys 0.000s
I20260709 13:16:17.586483  3160 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.601914  3169 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.549757  3304 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:17.678982 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.602922  3069 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:17.603907  3210 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.606256  3106 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.607580 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2582) took 1787 ms. Trace:
W20260709 13:16:17.611634  3315 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.252s	user 0.000s	sys 0.005s
I20260709 13:16:17.624846 31601 pending_rounds.cc:85] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:16:17.550770  3359 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:17.648362 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.625949 31031 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:17.660135 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:17.722532 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.722817 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.723662 31029 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:17.540141  3279 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.723541 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:17.576550  3246 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.004s
I20260709 13:16:17.565816  3148 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:17.660887 30950 rpcz_store.cc:276] 0709 13:16:16.399557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.835279 (+435722us) service_pool.cc:224] Handling call
0709 13:16:16.835780 (+   501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:16.921693 (+ 85913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.921726 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:16.947208 (+ 25482us) log.cc:844] Serialized 52 byte log entry
0709 13:16:17.129386 (+182178us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:17.129446 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.129546 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.592524 (+462978us) raft_consensus.cc:1685] finished
0709 13:16:17.592546 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.592715 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86957,"raft.queue_time_us":67979,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16670,"thread_start_us":160801,"threads_started":1,"wal-append.queue_time_us":223878}
I20260709 13:16:17.602334  3338 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:17.728937 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 68861.4us
I20260709 13:16:17.551074  2966 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:17.664752  2788 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.000s
I20260709 13:16:17.717935 31601 pending_rounds.cc:107] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:17.712663 31030 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:17.723065 30882 rpcz_store.cc:276] 0709 13:16:15.820067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.904478 (+ 84411us) service_pool.cc:224] Handling call
0709 13:16:15.904826 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.370850 (+466024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.607240 (+1236390us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54000f9e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:17.607501 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070200576}
I20260709 13:16:17.661722  2686 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:17.620024  3368 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.687489  3214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.016s	sys 0.010s
W20260709 13:16:17.721128  3224 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.001s
I20260709 13:16:17.759220 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:17.805999 30950 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:17.736615  3328 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:17.764405 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:17.763150  3338 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:17.675504  3213 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.767690  3235 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.768029  3364 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.769451  3366 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:16:17.627275  3360 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.825384 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1230) took 1445 ms. Trace:
I20260709 13:16:17.770833 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1006) took 1861 ms. Trace:
I20260709 13:16:17.773254  3294 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.827939 30955 rpcz_store.cc:276] 0709 13:16:15.909280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.920101 (+ 10821us) service_pool.cc:224] Handling call
0709 13:16:15.920619 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.399124 (+478505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.770573 (+1371449us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540024c554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:17.770767 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096626560}
W20260709 13:16:17.834674 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.776315  3173 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.778086  3117 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.756963  3210 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.783582 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:17.842904 31597 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:17.723711  3359 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:17.728672  3296 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.790674 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.793488 31601 raft_consensus.cc:2889] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.716267  3032 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.727553  3376 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:17.719646  3379 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:16:17.801100  3214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.019s	sys 0.023s
I20260709 13:16:17.767572  3304 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.762221  3109 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:17.790215  3346 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.001s
I20260709 13:16:17.736057  3106 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:16:17.788899  3148 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:17.817106 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.853228  3371 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.680532  3104 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.821578 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:17.890935 30950 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 7: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:17.746382  2788 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.831733 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.670608  3365 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.838685 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.895059 31029 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:17.807436  2686 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.750294  3246 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.827785 31596 rpcz_store.cc:276] 0709 13:16:16.372661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.459375 (+ 86714us) service_pool.cc:224] Handling call
0709 13:16:16.459746 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.798542 (+338796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.798570 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.799151 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.945192 (+146041us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:16.945227 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.945294 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.597939 (+652645us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:17.801486 (+203547us) raft_consensus.cc:1685] finished
0709 13:16:17.801516 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.818207 (+ 16691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11341,"raft.queue_time_us":203279,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":55179136,"thread_start_us":455343,"threads_started":2,"wal-append.queue_time_us":154089}
I20260709 13:16:17.855413 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2578) took 2131 ms. Trace:
I20260709 13:16:17.816445  3338 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:17.861793 31031 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:17.869891 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1351) took 3231 ms. Trace:
W20260709 13:16:17.875782 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 145310us
W20260709 13:16:17.876794 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 48635.3us
I20260709 13:16:17.815841  3224 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.912671 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.913457 31026 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 8.
I20260709 13:16:17.914386  3224 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.914515 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.884840 31030 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 6.
I20260709 13:16:17.916047 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.916198 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.917207 31030 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:17.917256 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.918110 31031 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:17.918375 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:17.800966  3056 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:16:17.880597  3218 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:16:17.841753  3188 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:16:17.920581  3206 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.921280  3206 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.813714  3368 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.925314  3279 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.925731  3368 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.928798  2788 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.931001  2686 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.932204 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.932842 31605 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:16:17.933256 31605 pending_rounds.cc:85] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:16:17.933486 31605 pending_rounds.cc:107] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:17.933722 31605 raft_consensus.cc:2889] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.940969 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:17.941728 31596 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:17.944139 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:17.946864  3360 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.881419  3376 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.950032  3376 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.950790  2961 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.952387  3213 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.952971  2860 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.890285  3109 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.869539  3296 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.960439 31030 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:17.961614  3296 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.890480  3346 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.964490  3346 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:17.965322 31600 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:17.967500 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.909060 31601 rpcz_store.cc:276] 0709 13:16:14.638968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.667156 (+ 28188us) service_pool.cc:224] Handling call
0709 13:16:14.674545 (+  7389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.674139 (+999594us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b58005372d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:16:17.338355 (+1664216us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b58005375d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abb60aa 00007f273ac38447 00007f273ac50fe7 00007f273ac527de 00007f273ac5cb49 00007f273ac5d416 00007f273ac59d8f 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4
0709 13:16:17.869485 (+531130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.869805 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3858001536}
I20260709 13:16:17.827476  3364 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.907153 30881 rpcz_store.cc:276] 0709 13:16:15.724054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.752676 (+ 28622us) service_pool.cc:224] Handling call
0709 13:16:15.752980 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:15.800926 (+ 47946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.800956 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:15.801605 (+   649us) log.cc:844] Serialized 52 byte log entry
0709 13:16:16.195219 (+393614us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:16.208664 (+ 13445us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.208925 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.209020 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.621823 (+1412803us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:17.839427 (+217604us) raft_consensus.cc:1685] finished
0709 13:16:17.855105 (+ 15678us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.855316 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47546,"prepare.queue_time_us":52581,"raft.queue_time_us":49612,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":16451,"spinlock_wait_cycles":22859520,"thread_start_us":393189,"threads_started":1,"wal-append.queue_time_us":526428}
I20260709 13:16:17.918987 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.969842 31028 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:17.970498 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:17.975103 30950 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 7.
I20260709 13:16:17.932888 31029 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 6.
I20260709 13:16:17.867708  3210 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:17.973594  3213 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:17.993655 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:17.984232  3104 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:17.994364 31597 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:17.994637  3210 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.974052  2860 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.995311  2860 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.989675 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:17.996430 30953 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:17.996589 31601 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:17.990605 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.991983  3365 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.991340 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:17.993279  3213 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:17.986399  3364 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.995641 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:17.997480 30996 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 2.669s (SENT)
I20260709 13:16:17.998214 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:17.972281 31030 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:18.041023 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:18.450299 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 452155us
I20260709 13:16:18.439610 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:18.021126 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.452745 30996 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:18.450621 30951 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:18.395298 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 1008) took 2069 ms. Trace:
I20260709 13:16:18.456027 30874 rpcz_store.cc:276] 0709 13:16:16.326139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.326559 (+   420us) service_pool.cc:224] Handling call
0709 13:16:16.326920 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.469806 (+142886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.394915 (+1925109us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540039c1d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:18.395212 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281930624}
W20260709 13:16:18.010509 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.458969 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.459301 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 461831us
W20260709 13:16:18.146821 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.461580 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.911064  3338 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.459615 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:17.971104  3236 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.459368 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.237640  3380 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 13:16:18.525939 31027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.036s	sys 0.128s
I20260709 13:16:18.493981 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:18.526556 31027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.036s	sys 0.128s
I20260709 13:16:18.526763 31601 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:16:18.496522 31032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2752) took 2629 ms (client timeout 2853 ms). Trace:
W20260709 13:16:18.527772 31032 rpcz_store.cc:269] 0709 13:16:15.867513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.882615 (+ 15102us) service_pool.cc:224] Handling call
0709 13:16:18.496338 (+2613723us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54001f2a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:18.496465 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705721600}
I20260709 13:16:18.529970 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:18.501893 31596 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.000s
I20260709 13:16:18.532284 31596 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
W20260709 13:16:18.532753 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.503901 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1199) took 1442 ms. Trace:
I20260709 13:16:18.533953 31600 rpcz_store.cc:276] 0709 13:16:17.061414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.133075 (+ 71661us) service_pool.cc:224] Handling call
0709 13:16:17.133357 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.965864 (+832507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.503646 (+537782us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b5400459cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:18.503839 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912734080}
I20260709 13:16:18.504339  3184 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:18.506652  3206 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:18.508874  2860 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:18.489228  3154 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:18.457430  3054 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:18.508920  3305 log.cc:927] Time spent T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 2.584s	user 0.015s	sys 0.043s
I20260709 13:16:18.512329 31026 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:18.499691 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1227) took 3029 ms. Trace:
I20260709 13:16:18.513681 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1226) took 3038 ms. Trace:
I20260709 13:16:18.465966  2826 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:18.351791  3360 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.564086  3360 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.565155 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 855) took 1428 ms. Trace:
I20260709 13:16:18.565569 31026 rpcz_store.cc:276] 0709 13:16:17.136537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.511571 (+1375034us) service_pool.cc:224] Handling call
0709 13:16:18.512022 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.552273 (+ 40251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.565100 (+ 12827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.566356  3360 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:17.978092  3346 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:18.567513  3346 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.569763  3346 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:18.465770  3109 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:18.520994  3069 consensus_meta.cc:287] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.832s	user 0.004s	sys 0.004s
I20260709 13:16:18.522850  3236 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:18.413901  3148 consensus_meta.cc:287] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 13:16:18.537065 30951 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:18.573766 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2313) took 1677 ms. Trace:
I20260709 13:16:18.575173 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.438024  3246 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:18.542006 31029 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:18.543890 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.579324 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 853) took 1443 ms. Trace:
I20260709 13:16:18.546180 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 856) took 1407 ms. Trace:
I20260709 13:16:18.580875 31032 rpcz_store.cc:276] 0709 13:16:17.138962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.530255 (+1391293us) service_pool.cc:224] Handling call
0709 13:16:18.545480 (+ 15225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.545753 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.545790 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.545845 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:18.545898 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.545970 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.546105 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.546998 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.583019 31600 raft_consensus.cc:2410] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:16:18.517455  3213 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:18.549794 31598 rpcz_store.cc:276] 0709 13:16:15.470362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.192111 (+721749us) service_pool.cc:224] Handling call
0709 13:16:16.251244 (+ 59133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.428211 (+176967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.428252 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.428290 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:16.428324 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.499481 (+2071157us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400800a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:18.499525 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.499636 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406532352}
I20260709 13:16:18.550103 31605 rpcz_store.cc:276] 0709 13:16:15.469721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.053435 (+583714us) service_pool.cc:224] Handling call
0709 13:16:16.053732 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.934449 (+1880717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.507581 (+573132us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400303c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:18.507739 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4320634624}
I20260709 13:16:18.555846 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.548559  3206 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
W20260709 13:16:18.557147  2545 consensus_meta.cc:287] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.884s	user 0.007s	sys 0.003s
I20260709 13:16:18.558943 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1015) took 1690 ms. Trace:
I20260709 13:16:18.544162  2860 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.559652  3364 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:18.559954  2826 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.548113  3054 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.561825 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2231) took 3233 ms. Trace:
W20260709 13:16:18.563313  3359 consensus_meta.cc:287] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.693s	user 0.004s	sys 0.004s
I20260709 13:16:18.572855 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.657845 31601 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:18.575816 31597 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:18.574151 30951 rpcz_store.cc:276] 0709 13:16:16.896941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.040624 (+1143683us) service_pool.cc:224] Handling call
0709 13:16:18.573696 (+533072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.579245  3148 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:18.580054 31029 rpcz_store.cc:276] 0709 13:16:17.135959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.493359 (+1357400us) service_pool.cc:224] Handling call
0709 13:16:18.541764 (+ 48405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.579070 (+ 37306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.579268 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.578760  2955 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.616685 30955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.023s	sys 0.066s
W20260709 13:16:18.662012 30955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.023s	sys 0.066s
I20260709 13:16:18.617749 30949 rpcz_store.cc:276] 0709 13:16:16.868797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.981401 (+112604us) service_pool.cc:224] Handling call
0709 13:16:16.981760 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:17.439718 (+457958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.439781 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:17.440917 (+  1136us) log.cc:844] Serialized 52 byte log entry
0709 13:16:17.677554 (+236637us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:17.794722 (+117168us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.795808 (+  1086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.795907 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.903739 (+107832us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b180016ff00. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:18.558554 (+654815us) raft_consensus.cc:1685] finished
0709 13:16:18.558701 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.558873 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281147,"prepare.queue_time_us":72723,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":66,"raft.queue_time_us":166072,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":42645,"spinlock_wait_cycles":49566720,"thread_start_us":648494,"threads_started":3,"wal-append.queue_time_us":343261}
I20260709 13:16:18.646971 31024 rpcz_store.cc:276] 0709 13:16:15.328115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.328245 (+   130us) service_pool.cc:224] Handling call
0709 13:16:15.351588 (+ 23343us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:15.433545 (+ 81957us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:15.433589 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:15.434319 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 13:16:15.949838 (+515519us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:15.949893 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.949999 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.508192 (+2558193us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:18.561540 (+ 53348us) raft_consensus.cc:1685] finished
0709 13:16:18.561559 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.561765 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6946,"raft.queue_time_us":19635,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":31355264,"thread_start_us":440516,"threads_started":1,"wal-append.queue_time_us":450714}
W20260709 13:16:18.688503  3392 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:16:18.691016 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2244) took 1563 ms. Trace:
I20260709 13:16:18.691517 31027 rpcz_store.cc:276] 0709 13:16:17.128052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.128500 (+   448us) service_pool.cc:224] Handling call
0709 13:16:17.216296 (+ 87796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.700227 (+483931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.700273 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.700959 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.873000 (+172041us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:18.498882 (+625882us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b4800042b58. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
0709 13:16:18.526921 (+ 28039us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.527152 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.527221 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.690585 (+163364us) raft_consensus.cc:1685] finished
0709 13:16:18.690700 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.690937 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222380,"prepare.queue_time_us":26362,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":278610,"raft.run_cpu_time_us":11629,"raft.run_wall_time_us":1003799,"spinlock_wait_cycles":26408192,"thread_start_us":1023957,"threads_started":3,"wal-append.queue_time_us":763249}
I20260709 13:16:18.644467  3139 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.659897  3054 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.648895  2860 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.666638  3359 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:18.731101 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.670586  2955 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.649080  3364 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.718954  2966 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:18.727283  3032 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:18.706926  3139 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.723416  3336 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:18.753938  2860 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:18.772970  3364 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:18.760255  2826 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:18.774607  3359 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:18.843576  3148 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:18.850209 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.865936 31604 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:18.876562  3359 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.880402  2826 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.882251 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 430925us
W20260709 13:16:18.879980 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 388001us
I20260709 13:16:18.883329 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:18.881500 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 345897us
I20260709 13:16:18.885113 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:18.887115 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.887881 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.888528 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.888708 31596 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
W20260709 13:16:18.896173 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.904600 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.905428 31596 raft_consensus.cc:2368] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14.
I20260709 13:16:18.906009 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.906832 31600 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:18.910358 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.918597 31600 raft_consensus.cc:1240] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:16:18.919652 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:18.930853 31596 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:18.931358 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.933707 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:18.937091 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 52057.3us
I20260709 13:16:18.937397 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:18.938500 31598 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:18.882063  3223 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.918548  3285 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:18.930586  3364 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:18.932781  3394 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:18.933106  2860 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.955013 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.882578  3359 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:18.944176  3213 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.945755 31605 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:18.885166  2826 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:18.994633 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.956476  3336 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:18.998610 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 265189us
I20260709 13:16:18.948065  3223 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.022487 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:18.996073  3394 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:18.955955  3364 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:18.946094  3285 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:19.031744  3397 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:19.052897 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.053797 30922 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:19.053982 31602 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:19.032213  3151 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.038992 31027 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:19.039809 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:19.057462 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.058698 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.059281 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.061790 31599 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:16:19.062292 31599 pending_rounds.cc:85] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 10
I20260709 13:16:19.062556 31599 pending_rounds.cc:107] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:16:19.062894 31599 raft_consensus.cc:2889] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:18.992197  3213 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.064517 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:19.061694 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:18.958580  2860 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.066206 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.069185 30949 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:19.070005 30997 connection.cc:256] RPC call timeout handler was delayed by -1.2914504289999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:16:19.071564 30997 connection.cc:256] RPC call timeout handler was delayed by -1.1069504289998804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:16:19.074189 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.055559 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:19.076387 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.077100 30950 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.077667 30950 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:19.079847 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.029615  3402 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.051817  3394 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:19.065181  3246 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:19.025130  3336 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.068976  3360 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.082631  3184 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:19.097141 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.081985  3400 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:19.096709 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:19.102324 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1918) took 1303 ms. Trace:
I20260709 13:16:19.102810 30955 rpcz_store.cc:276] 0709 13:16:17.799066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.834947 (+ 35881us) service_pool.cc:224] Handling call
0709 13:16:17.835222 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.861457 (+ 26235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.861488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.861979 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.662535 (+800556us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:18.662597 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.662698 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.102098 (+439400us) raft_consensus.cc:1685] finished
0709 13:16:19.102121 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.102257 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7111,"raft.queue_time_us":18102,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":5223,"thread_start_us":775669,"threads_started":1,"wal-append.queue_time_us":1000842}
I20260709 13:16:19.100080 31027 raft_consensus.cc:2376] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15. Re-sending same reply.
W20260709 13:16:19.104959 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 166924us
I20260709 13:16:19.090937  3402 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:19.094882  3246 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:19.095449  3216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.910s	user 0.023s	sys 0.026s
W20260709 13:16:19.124862  3216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.957s	user 0.023s	sys 0.026s
I20260709 13:16:19.125321  3285 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.125548  3216 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:19.126009  3285 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:19.126406  3285 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.126784  3285 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.128147 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.124133 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.122936 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.124138 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2247) took 1979 ms. Trace:
I20260709 13:16:19.097312  3184 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:19.131659 31026 rpcz_store.cc:276] 0709 13:16:17.144920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.566440 (+1421520us) service_pool.cc:224] Handling call
0709 13:16:18.566789 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.567959 (+  1170us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:18.567990 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.568537 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.951591 (+383054us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:18.951632 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.951698 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.123927 (+172229us) raft_consensus.cc:1685] finished
0709 13:16:19.123949 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.124083 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":604,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":382690,"threads_started":1,"wal-append.queue_time_us":525512}
I20260709 13:16:19.131541 31027 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:19.134608 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.134963 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2251) took 1201 ms. Trace:
I20260709 13:16:19.140884 31029 rpcz_store.cc:276] 0709 13:16:17.933870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.675907 (+742037us) service_pool.cc:224] Handling call
0709 13:16:18.676280 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.676714 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.676756 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.677373 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.997757 (+320384us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:18.997828 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.997949 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.134754 (+136805us) raft_consensus.cc:1685] finished
0709 13:16:19.134785 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.134906 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26888,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3359,"thread_start_us":319958,"threads_started":1,"wal-append.queue_time_us":424108}
W20260709 13:16:19.142937 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 205345us
I20260709 13:16:19.150606 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.130862  3246 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:19.108814  3408 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:19.170094 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:19.133476  3084 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.121609  3402 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.174269 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.174436 31026 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:19.136169  3360 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:19.142899  3184 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:19.178421 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 122931us
W20260709 13:16:19.152103  3338 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.003s
I20260709 13:16:19.106813  2966 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:16:19.180338  3084 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.184028  3413 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:19.184662  3413 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.186820  3413 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.187350  3413 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.188120  2826 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.188656  3408 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.190529  2860 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.190946  3408 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:19.192742  3084 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.192577  3412 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:19.126582  3216 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.193316  3054 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.195418  3054 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.102490  3400 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.225005 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:19.200852  3359 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.224902 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:19.211051 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 103059us
I20260709 13:16:19.204914 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.199265 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:19.232519 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 52487.1us
I20260709 13:16:19.234403 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.236940 30882 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:19.210958 31026 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
I20260709 13:16:19.218776 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.243994 30922 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:19.236239 30877 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:19.254691 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.255405 30880 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:19.178607  3360 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.259572 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.260236 30880 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:19.261978 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.263789 30883 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:19.263362 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:19.264261 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 199781us
I20260709 13:16:19.266980 30881 raft_consensus.cc:2368] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:16:19.236306  3084 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.274626 30996 leader_election.cc:336] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425): Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 2.897s (SENT)
I20260709 13:16:16.457199 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:19.272593 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:19.274356 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.275946 30996 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:19.276925 30883 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.277829 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.278445 31596 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:19.278602 30883 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:19.279910 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.280470 31596 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:19.281646 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.284041 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.284906 31596 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:19.287937 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:19.276633 30847 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.210359  3338 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.263556  3360 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:19.293289 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.227398  3184 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.295217 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:19.195670  3413 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.296777 31598 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:19.299196 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:19.152048  3394 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.275243  3408 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.304745  3399 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:16:19.253854  3054 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:16:19.304095 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.326823 30881 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
W20260709 13:16:19.314021 31570 leader_election.cc:336] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.528s (SENT)
I20260709 13:16:19.328040 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.331245 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:19.332255 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 158632us
I20260709 13:16:19.288080  3364 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.293959  3151 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:19.338362 31605 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:19.337471 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1018) took 2152 ms. Trace:
I20260709 13:16:19.337906 31599 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:19.346527 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:19.339000 30952 rpcz_store.cc:276] 0709 13:16:17.184803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.408394 (+223591us) service_pool.cc:224] Handling call
0709 13:16:17.408676 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.568182 (+159506us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:17.656478 (+ 88296us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.047602 (+1391124us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800474fa0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273e6523c7 00007f273ac649a7 00007f273ac740bf 00007f273ac74038
0709 13:16:19.047865 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.204092 (+156227us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.204685 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.204851 (+   166us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:19.204898 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.204987 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.337252 (+132265us) raft_consensus.cc:1685] finished
0709 13:16:19.337280 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.337413 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72275,"prepare.queue_time_us":1354874,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3201,"raft.queue_time_us":190510,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":24660,"spinlock_wait_cycles":12095360,"thread_start_us":370810,"threads_started":3,"wal-append.queue_time_us":415744,"wal-append.run_cpu_time_us":1433,"wal-append.run_wall_time_us":1092742}
I20260709 13:16:19.350133 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.353190 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:19.287950  3084 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.294240  3109 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:16:19.333362  3213 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.361034 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.364856 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.336961  3262 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:19.363327 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.370527 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.372612  3234 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:16:19.336211  2860 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:16:19.373911  3413 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.375813  3338 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.377105  3084 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.350253  3421 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:19.380160  3421 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:19.380715  3421 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:19.384222 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2761) took 1699 ms. Trace:
I20260709 13:16:19.384621 31032 rpcz_store.cc:276] 0709 13:16:17.685198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.586071 (+900873us) service_pool.cc:224] Handling call
0709 13:16:18.604668 (+ 18597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.616650 (+ 11982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.616683 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.649633 (+ 32950us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.081630 (+431997us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:19.081670 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.081740 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.383981 (+302241us) raft_consensus.cc:1685] finished
0709 13:16:19.384002 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.384158 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":343,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":38454,"thread_start_us":372022,"threads_started":1,"wal-append.queue_time_us":552462}
I20260709 13:16:19.388226  2955 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.390295 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.392127 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.392935 30878 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:19.393683 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:19.394382 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.351824  3292 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:19.395324 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:19.397203 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.395825 31570 leader_election.cc:336] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.590s (SENT)
I20260709 13:16:19.398778 31600 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:19.399299 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.396854 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:19.400362 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 128117us
I20260709 13:16:19.400951 30877 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:19.391629 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.397178 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.351615  3419 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.405254  3419 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:19.349763  3416 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:19.405706  3419 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.405843  3416 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.406239  3416 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:19.396896 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.335878  3216 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:16:19.404554 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.407438 31603 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:19.414669 31602 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:19.418360  3285 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.408032 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.410360 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.420248 31597 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:19.410614 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.413905 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.422340 30879 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:19.424520  3285 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.426249 30879 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:19.336905  3408 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:19.432003 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 132896us
I20260709 13:16:19.364871  3364 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:19.434245 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.366482  3151 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:19.444723 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.437448 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:19.441958 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.442485 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2306) took 3037 ms. Trace:
I20260709 13:16:19.446226 30957 rpcz_store.cc:276] 0709 13:16:16.405399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.843399 (+438000us) service_pool.cc:224] Handling call
0709 13:16:16.843816 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.844095 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:16.844477 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.591357 (+746880us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b180015e740. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:17.597345 (+  5988us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b180015e740. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:19.275092 (+1677747us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b180015e740. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a8024bc 00007f2737b5048b 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287
0709 13:16:19.275462 (+   370us) log.cc:844] Serialized 14 byte log entry
0709 13:16:19.442106 (+166644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:19.442169 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:19.442214 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.442296 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.442423 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33569,"prepare.queue_time_us":306,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":2450,"raft.queue_time_us":104764,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":43650,"spinlock_wait_cycles":31439360,"thread_start_us":396384,"threads_started":3,"wal-append.queue_time_us":207814,"wal-append.run_cpu_time_us":1033,"wal-append.run_wall_time_us":1001068}
I20260709 13:16:19.442994  2788 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:19.449882  2788 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.398274  3213 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:19.452865 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.453958  3402 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.394176  3414 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:19.457835 30878 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:19.413561  3084 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:19.429672  3405 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:16:19.407167  3139 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.443373  3292 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:19.472759 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 109694us
I20260709 13:16:19.474865 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:19.477547 30847 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:19.479782 30847 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:19.446293  3364 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.451043  3421 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:19.466310  3399 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:19.444175  3285 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:19.394858  3426 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:16:19.464649  3054 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:19.492462 30882 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:19.508896 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.505697 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50793.2us
I20260709 13:16:19.514104 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:19.457279  3148 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:16:19.487250  3364 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:19.520267  3424 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:19.503927  3054 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:19.494450  3417 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:19.517603  3213 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.536188 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 852) took 2400 ms. Trace:
W20260709 13:16:19.535494 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 77264.6us
I20260709 13:16:19.539932  2558 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.548235  2558 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.551342  2558 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.536120  3291 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:16:19.508553  3285 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:19.552235 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 265048us
I20260709 13:16:19.557041 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2766) took 1829 ms. Trace:
I20260709 13:16:19.559403 31024 rpcz_store.cc:276] 0709 13:16:17.727598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.672346 (+944748us) service_pool.cc:224] Handling call
0709 13:16:18.672835 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.673300 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.673340 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.673975 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.006123 (+332148us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:19.006168 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.006250 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.556812 (+550562us) raft_consensus.cc:1685] finished
0709 13:16:19.556833 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.556973 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"thread_start_us":322573,"threads_started":1,"wal-append.queue_time_us":430709}
I20260709 13:16:19.524072  3400 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.535949  3425 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:19.563597  2558 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:19.556613  2860 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:16:19.564132  2558 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.564517  2558 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:19.565250  3285 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.573056  3408 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:19.574819  3421 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.558205  3184 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.546187  3417 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.537984  3213 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.561534 30922 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:19.533872  3442 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:19.576256 31030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2246) took 2434 ms (client timeout 3024 ms). Trace:
I20260709 13:16:19.577975 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:19.538723 31031 rpcz_store.cc:276] 0709 13:16:17.135678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.492614 (+1356936us) service_pool.cc:224] Handling call
0709 13:16:18.521585 (+ 28971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.522003 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:18.522280 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.880874 (+358594us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.881042 (+   168us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.886082 (+  5040us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.886262 (+   180us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:18.886320 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.886416 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.389730 (+503314us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b1800386560. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d522 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:19.535938 (+146208us) raft_consensus.cc:1685] finished
0709 13:16:19.535965 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.536126 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3153,"prepare.queue_time_us":231613,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":748,"raft.queue_time_us":186618,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":7120,"spinlock_wait_cycles":75668352,"thread_start_us":357872,"threads_started":1,"wal-append.queue_time_us":484893}
I20260709 13:16:19.544486  3292 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:19.584143 31030 rpcz_store.cc:269] 0709 13:16:17.141894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.918063 (+776169us) service_pool.cc:224] Handling call
0709 13:16:19.576072 (+1658009us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b540007b554. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:19.576181 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95033728}
I20260709 13:16:19.608706 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.610015 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.610356 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.610888 30880 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:19.611406 30883 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:19.612452 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.614006 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.614734 30879 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:19.616396 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.617312 30882 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:19.587100  3213 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.605213 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:19.586171  3427 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:19.590996  3442 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.587438  3285 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:19.605722  3216 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:16:19.580282  3430 consensus_queue.cc:1059] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 13:16:19.664261 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 107065us
W20260709 13:16:19.639930 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.606383  3441 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:16:19.685935 30998 leader_election.cc:400] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:16:19.719436 30998 leader_election.cc:403] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:19.619340  3425 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.620306  3428 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.642822 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:19.745491 30878 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:19.712483  3442 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:19.641891  3148 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:19.686009  3429 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:16:19.712069  3285 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:19.729645  3246 consensus_meta.cc:287] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.002s
I20260709 13:16:19.730293  3417 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.728437  3419 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.751506  3246 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.730826  3446 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:19.754266  3446 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:19.755234  3446 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.739913  3402 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.715912 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:19.728416  3436 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:19.625105  3450 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.750713  3148 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:19.762719 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89046.3us
W20260709 13:16:19.777729 31570 leader_election.cc:336] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.885s (SENT)
I20260709 13:16:19.759991 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:19.765228 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 251159us
I20260709 13:16:19.779336 30883 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:19.760340  3246 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.783058 30998 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:19.750737  2558 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.778430 31570 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.779472 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:19.766847 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 50863us
I20260709 13:16:19.787595 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:19.791244  3154 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:19.792842  3360 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.760247  3419 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.769539  3439 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.760990  3285 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:19.782384  3148 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.785065  3450 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.761133  3428 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.768639  3425 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.797710  3213 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.802024  3216 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:19.788911  3226 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:19.799116  2558 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.751431  3416 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.787298  3453 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:19.803033 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 306910us
I20260709 13:16:19.806540 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.818323 30958 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:19.818343 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:19.819115 30958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2318) took 1891 ms (client timeout 1953 ms). Trace:
W20260709 13:16:19.819610 30958 rpcz_store.cc:269] 0709 13:16:17.927391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.935602 (+  8211us) service_pool.cc:224] Handling call
0709 13:16:19.806383 (+1870781us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:16:19.819033 (+ 12650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83006208}
I20260709 13:16:19.807796 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:19.800410 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 157745us
I20260709 13:16:19.808947 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1016) took 2939 ms. Trace:
W20260709 13:16:19.809443 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.810842 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.828788  3416 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.829279  3246 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:19.829953  3246 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.828909  3213 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:19.832170  3246 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:19.807943  3370 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 2.082s	user 0.009s	sys 0.005s
I20260709 13:16:19.787303  3364 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.821372 30953 rpcz_store.cc:276] 0709 13:16:16.869371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.981951 (+112580us) service_pool.cc:224] Handling call
0709 13:16:16.982924 (+   973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.996860 (+1013936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:19.808708 (+1811848us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001941d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:19.808884 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330369920}
I20260709 13:16:19.805449  3419 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:19.852453 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.853106 31032 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:16:19.854532 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.840384 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:19.856380 31600 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:19.844573 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:19.844723 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:19.808334  3216 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.848660 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.862232 31030 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:19.849447 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.859210 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:19.868539 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:19.869402 31597 raft_consensus.cc:3060] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:19.879316 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.879570 31597 raft_consensus.cc:2468] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:19.880376 31029 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:19.881984 30996 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:19.883823 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:19.847826  3444 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:19.892885 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:19.893967 31597 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:19.875905  3216 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:19.860111  3151 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:19.860625  3441 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:19.876436  3394 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:19.903554 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.904886 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.903245 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:19.904189 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:19.903889 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.903645 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:19.942202  3370 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:19.945592 30950 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:19.945614 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.947434 30952 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:19.947961 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:19.886489  3218 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:16:19.878280  3419 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:19.888093  3444 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:19.945006 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.846635  3453 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.896929  3219 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:19.950433 30951 raft_consensus.cc:2410] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:16:19.950778 30958 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:19.948268 30953 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:19.887382  3416 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:19.952945 30957 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:19.896503  3056 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:19.897589  3291 raft_consensus.cc:2804] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:19.895535  3417 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:19.946019  3292 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.945772  3418 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:19.902797  3451 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.944026  3440 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.973024 30952 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:19.955520  3444 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:19.957382 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:19.898294  3400 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:16:19.955489 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:19.980728 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 92067.1us
I20260709 13:16:19.898267  3442 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.988693 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:19.992050 30950 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:19.990715 30949 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:19.992503 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:19.969947  3056 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:19.949544  3441 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:20.006199 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47982us
I20260709 13:16:20.006234 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:20.007247  3462 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.011675 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:20.012071 30997 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:19.985705  3291 raft_consensus.cc:697] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:19.975469  3416 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.991359  3451 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.023034  3163 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:20.023494  3163 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.023921  3163 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.024343  3450 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.024552  3451 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.015925  3457 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:20.029567  3419 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:19.984009  3292 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.032598 30955 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:19.995898  3465 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:16:20.033802  3292 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.033910  3465 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.034387  3465 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:20.034731  3465 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:20.038453 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.002146  3056 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.008767  3453 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.048625  3291 consensus_queue.cc:237] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.049392  3416 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:19.987519  3418 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.053131  3418 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.055787 30955 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
W20260709 13:16:20.056115 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.058504  3428 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.059104 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.060381  3364 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.061089  3184 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:20.061467  3184 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:20.062166  3442 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.062280  3184 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:19.995169  3440 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.018889  3360 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.004360  3400 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:20.065692 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2245) took 2930 ms (client timeout 2521 ms). Trace:
I20260709 13:16:20.065795  3400 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:19.981628  3417 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:20.066668 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.068642 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.071460 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.072259 30952 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.066514  3425 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.073766 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.063542  3184 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:20.066165 31028 rpcz_store.cc:269] 0709 13:16:17.135678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.831435 (+695757us) service_pool.cc:224] Handling call
0709 13:16:20.065493 (+2234058us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b5400146754. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:20.065619 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173047680}
I20260709 13:16:20.092260 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.076685 31600 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:20.080199 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.081708  3417 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:20.082116  3461 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:16:20.083220  3236 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:20.086078  3154 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.088140 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.088616 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.089562 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.089478  3400 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.109009 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.176940 30875 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 8: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:20.095533 30847 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:20.204972 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 109558us
I20260709 13:16:20.086091  2788 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:20.077466 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.206040 30883 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:20.097944 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.122154 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.165067 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.208482 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.209292 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:20.210470 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.098255 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.133323 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1344) took 6275 ms. Trace:
I20260709 13:16:20.131991 31598 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:20.162889 30876 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:20.153491 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.178334 30952 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:20.095239 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:20.213613 30877 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:20.214243 31600 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 16: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:20.214509 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.215101 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.116997 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.215678 31600 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:20.121687 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1374) took 1050 ms. Trace:
I20260709 13:16:20.216653 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.217734 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.111882 30998 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:20.065838  3440 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.188493  3439 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 7. Current term is 8.
I20260709 13:16:20.188858  3054 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.192044  3414 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:20.193810 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.193439  3216 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.193666  3465 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.118733  3285 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.102389  3336 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:20.119656  3441 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:20.163401  3148 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.100298 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.196228  3223 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:20.196359  3400 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.197016  3430 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:20.300413 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.253919  3206 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.200232 31024 raft_consensus.cc:2410] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:16:20.139117  3444 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.201951 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.104943  3453 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.177563 30956 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 10: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:20.211071 30883 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:20.211848 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.314036 30996 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:20.218252 31600 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:20.239823  3414 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:20.315623 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.315965 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:20.316702 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.317082  3403 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:20.317387 31600 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 17: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:20.317646  3403 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.318152  3403 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.318190 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.319424 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.222064 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.223323 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.321432 31600 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:20.215520 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.321561 31571 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.322130 30877 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:20.322247 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:20.216598 31599 rpcz_store.cc:276] 0709 13:16:19.071611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.079509 (+  7898us) service_pool.cc:224] Handling call
0709 13:16:20.121484 (+1041975us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54006702d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:20.121629 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590491520}
W20260709 13:16:20.231936 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 120169us
I20260709 13:16:20.232126 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1371) took 1238 ms. Trace:
I20260709 13:16:20.231961 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.236295 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.238535 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:20.254376 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.256276 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.257532 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.211472  3226 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:20.259819 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.222533  3394 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:20.221485  3153 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:20.261649  2788 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:20.264457 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.265172 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.265877 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.267495 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.269876 31601 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
W20260709 13:16:20.280249 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.270519 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 271632us
I20260709 13:16:20.288463 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.199353 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.301132 30957 raft_consensus.cc:2376] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14. Re-sending same reply.
I20260709 13:16:20.302002 30924 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:20.258728  3054 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.303236 31026 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
W20260709 13:16:20.308401 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 296791us
I20260709 13:16:20.242065  3409 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:20.157774  3056 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:20.262081  3163 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.312901 31603 raft_consensus.cc:2393] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 9: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:20.212867 31604 rpcz_store.cc:276] 0709 13:16:13.857726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.857905 (+   179us) service_pool.cc:224] Handling call
0709 13:16:13.858172 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.866406 (+5008234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.132886 (+1266480us) spinlock_profiling.cc:243] Waited 5.01 s on lock 0x7b540015b8d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:20.133203 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11515482496}
I20260709 13:16:20.320621 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1924) took 1253 ms. Trace:
I20260709 13:16:20.322793 31600 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.460366 30779 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 5 to 8, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 8 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:20.324390 31571 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.480042 30875 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:20.480398  3177 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:20.481212 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:20.481786 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 157477us
I20260709 13:16:20.481949 30875 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:20.481276 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.483027 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.483644 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:20.485062 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.368481 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.486675 30949 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:20.470038 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.487538 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.487625 31031 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:20.471684 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.488296 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:20.419138 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:20.489848 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 187975us
I20260709 13:16:20.490406 30952 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:20.378353 31025 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:20.491108 30924 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:20.489943 31596 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:20.491331 31605 rpcz_store.cc:276] 0709 13:16:18.993630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.995475 (+  1845us) service_pool.cc:224] Handling call
0709 13:16:20.231907 (+1236432us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400720e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:20.232067 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724083072}
I20260709 13:16:20.492487 30876 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:20.493188 30956 rpcz_store.cc:276] 0709 13:16:19.067032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.068194 (+  1162us) service_pool.cc:224] Handling call
0709 13:16:20.108858 (+1040664us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5800050a98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:16:20.320563 (+211705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12868864}
W20260709 13:16:20.322736 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 100744us
I20260709 13:16:20.494503 30956 pending_rounds.cc:85] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 8
I20260709 13:16:20.494784 30956 pending_rounds.cc:107] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:20.495044 30956 raft_consensus.cc:2889] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:20.380398 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.454900 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.497539 30955 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:20.505991 30924 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.506675 30949 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:20.510514 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.473469 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1207) took 1083 ms. Trace:
I20260709 13:16:20.512470 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.512364 31598 rpcz_store.cc:276] 0709 13:16:19.390277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.392647 (+  2370us) service_pool.cc:224] Handling call
0709 13:16:20.131727 (+739080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.222806 (+ 91079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.473185 (+250379us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54006702d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:20.473383 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698910464}
I20260709 13:16:20.485285 30951 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:20.516037 31600 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:20.525571 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.529166 31032 raft_consensus.cc:2393] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 17: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:20.529739 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.530218 30883 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:20.531627 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.531829 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.483747 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:20.538992 30955 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:20.542484 30952 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 13:16:20.543694 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.544373 30952 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:20.544534 30953 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 8: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:20.545384 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.545734 30958 raft_consensus.cc:2410] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:16:20.547528 30952 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:20.542994 30998 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:20.549134 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:20.550367 31601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1247) took 1663 ms (client timeout 2137 ms). Trace:
W20260709 13:16:20.550761 31601 rpcz_store.cc:269] 0709 13:16:18.887087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.888222 (+  1135us) service_pool.cc:224] Handling call
0709 13:16:20.550203 (+1661981us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54007f30d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:20.550302 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3174835456}
I20260709 13:16:20.551290 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.551545 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:20.552680 30953 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:20.549718 31605 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.547428 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.554608 30952 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:20.555346 30950 raft_consensus.cc:2410] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:16:20.542426 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 58734.3us
I20260709 13:16:20.551829 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:20.455930  3162 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.325181  3336 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:20.315026  3206 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.558207 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.374231  3219 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.557260 31601 raft_consensus.cc:2410] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:16:20.488909  2545 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.567572 30957 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:16:20.572731 31601 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:20.417685  3084 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:20.505445  3409 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:20.445325  3148 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.586068 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.417722  3462 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:20.524426  3364 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.535732  3359 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:20.528558  3223 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:20.464291  3446 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:20.575944 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:20.612583 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 61110.4us
I20260709 13:16:20.584978 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.589505 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.594049 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.613549 30848 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.613722 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.614102 30955 raft_consensus.cc:2376] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12. Re-sending same reply.
I20260709 13:16:20.325356  3154 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:20.626276 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.627694 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.603106 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.629447 30950 raft_consensus.cc:2376] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17. Re-sending same reply.
I20260709 13:16:20.604310 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.605387 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.630928 30958 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:20.607002 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.528919  3236 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:20.633087  3236 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.636528 30952 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:20.637497 30881 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:20.638413 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:20.635603  3236 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:20.639431 31031 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:20.614676 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.615267 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:20.559002  3417 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.549487  3218 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:20.615655 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:20.618414 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:20.528553  3032 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
W20260709 13:16:20.726711 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 111147us
I20260709 13:16:20.727491 30848 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.727631 31599 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:20.325991  3453 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.622326 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.729664 30878 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:20.622453  3421 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.622817  3413 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:20.623310 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:20.628391 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.632529  3465 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:20.613289 31604 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:20.640038  3336 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.610666 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:20.640877 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.752197 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.641939  3285 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.642095  3206 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:20.643080  3216 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.532840  2788 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:20.546499  3460 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.455s	user 0.004s	sys 0.000s
I20260709 13:16:20.696182 31605 raft_consensus.cc:2410] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:16:20.698026 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 59703.4us
I20260709 13:16:20.810407 30998 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:20.698868 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:20.699227 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.701675 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.722066 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.587234  3151 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.632547 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.621860  3419 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:20.816666 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:20.817054 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 118262us
W20260709 13:16:20.733924 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 119298us
W20260709 13:16:20.646482  3291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.062s
I20260709 13:16:20.739089 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.740198 31599 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:20.591249  3394 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:20.747855 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.753158 31025 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:20.596218  3409 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:20.756018  2860 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:20.745797  3278 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:20.756031 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:20.757529  3453 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.757654 30877 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:20.568497  3408 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:16:20.608749  3364 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.308737  3430 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.609180  3223 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:20.606464  3084 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.712417  3154 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.745591  3270 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:20.738685  3359 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:20.812961 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.933007 31031 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:20.894393  3452 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:20.813819 30875 raft_consensus.cc:2393] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 16: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:20.814370 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.816646 31596 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:20.830087 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.820907 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:20.597654  2545 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.910809  3163 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:20.887972 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:20.825690  3419 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:20.741371  3218 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:20.759835  3412 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:16:20.725809  3184 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 13:16:20.853363 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.898622 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:21.021781 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1385) took 1213 ms. Trace:
W20260709 13:16:20.840835 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 101810us
I20260709 13:16:20.901265 31030 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.024634 30874 raft_consensus.cc:2410] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:21.024992 30848 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.022413 31602 rpcz_store.cc:276] 0709 13:16:19.807944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.808102 (+   158us) service_pool.cc:224] Handling call
0709 13:16:19.827626 (+ 19524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.828056 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.828093 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.828609 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:16:19.945296 (+116687us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:20.002732 (+ 57436us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.003001 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.003104 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:20.099422 (+ 96318us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b1800388fc0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d557 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:20.475721 (+376299us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:21.021496 (+545775us) raft_consensus.cc:1685] finished
0709 13:16:21.021530 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.021715 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23802,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":19643,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":169,"spinlock_wait_cycles":105314688,"thread_start_us":152683,"threads_started":2,"wal-append.queue_time_us":171839}
W20260709 13:16:20.826309  3139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.004s	sys 0.020s
W20260709 13:16:20.825603  3291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.008s	sys 0.066s
I20260709 13:16:20.918327 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:20.812530  3151 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.823726  2558 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.841342  3148 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:20.829381  3216 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:20.932240 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:21.060585 31024 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:21.004040  3336 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:20.813243 31026 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:20.943535 30880 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:20.943745 31032 raft_consensus.cc:2393] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:20.927707 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.062981 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2775) took 1043 ms. Trace:
I20260709 13:16:21.063390 31026 rpcz_store.cc:276] 0709 13:16:20.019977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.632251 (+612274us) service_pool.cc:224] Handling call
0709 13:16:21.062911 (+430660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:20.616814  3462 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:20.945628 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 336693us
I20260709 13:16:20.947093 30875 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:20.999809 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 185498us
W20260709 13:16:21.046041  3139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.004s	sys 0.020s
I20260709 13:16:20.921417  3442 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:20.927127  3223 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:20.923470  3364 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.002033 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.082844 31031 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:20.925644  3444 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.007097 31599 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:21.008190 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:20.932088  3032 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:21.009289 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 188476us
I20260709 13:16:20.932441  3270 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.943601  3177 raft_consensus.cc:2764] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:21.026978 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:21.068475 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2781) took 1047 ms. Trace:
I20260709 13:16:21.100144 31032 rpcz_store.cc:276] 0709 13:16:20.021457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.829730 (+808273us) service_pool.cc:224] Handling call
0709 13:16:21.068406 (+238676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.074620 31571 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:20.893208  3260 consensus_queue.cc:1059] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:16:21.009613  3466 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:21.014106  3419 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:21.079603 31602 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:21.083158 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:21.112799 30958 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:21.083232 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:21.114135 30950 raft_consensus.cc:2393] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:21.085572 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:21.114758 30955 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:21.087368 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.027204  3359 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.059871  3151 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.090376 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 343413us
I20260709 13:16:20.999967  3452 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.092332 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2772) took 1073 ms. Trace:
I20260709 13:16:21.138911 31031 rpcz_store.cc:276] 0709 13:16:20.019278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.933799 (+914521us) service_pool.cc:224] Handling call
0709 13:16:21.092254 (+158455us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.094030  3032 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:21.093982 31027 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.094959 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:21.060184  3148 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.027815  3278 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:21.106186 31570 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:21.161971 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 55852.9us
I20260709 13:16:21.162707 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:21.163568 31570 leader_election.cc:400] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:21.164052 31570 leader_election.cc:403] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.110983 31024 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:21.116659 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2777) took 1096 ms. Trace:
I20260709 13:16:21.060539  3154 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:16:21.099427  3270 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.077618  3109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.004s	sys 0.025s
I20260709 13:16:21.165747 31025 rpcz_store.cc:276] 0709 13:16:20.020454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.063678 (+1043224us) service_pool.cc:224] Handling call
0709 13:16:21.116585 (+ 52907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:21.171172 30956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.012s	sys 0.024s
W20260709 13:16:21.171650 30956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.012s	sys 0.024s
I20260709 13:16:21.149367 31028 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:21.148002 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1387) took 1339 ms. Trace:
W20260709 13:16:21.153659  3472 log.cc:927] Time spent T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:16:21.154950  3462 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.165763 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2786) took 1142 ms. Trace:
I20260709 13:16:21.166574 30878 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:21.164337  3148 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.139204  3359 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:21.233014  3359 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:21.173247  3400 consensus_meta.cc:287] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.873s	user 0.011s	sys 0.000s
I20260709 13:16:21.174294  3452 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.214489 30958 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:21.234205  3400 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:21.234972  3400 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:21.175520 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2263) took 1293 ms. Trace:
I20260709 13:16:21.176044  2788 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.178747  3056 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:21.180755 31596 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:21.182946  3032 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:21.236001 31029 rpcz_store.cc:276] 0709 13:16:19.881929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.883866 (+  1937us) service_pool.cc:224] Handling call
0709 13:16:21.174684 (+1290818us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b5400334b20. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273abd1dc0 00007f273ac5de18 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6
0709 13:16:21.175353 (+   669us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540009e2d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.175467 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645537280}
I20260709 13:16:21.237207  3032 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.175945  3469 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:16:21.184067 30779 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 8 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:21.240424 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1386) took 1431 ms. Trace:
I20260709 13:16:21.239959 30779 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 5 to 6, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 6 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.240797 31597 rpcz_store.cc:276] 0709 13:16:19.808673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.894963 (+ 86290us) service_pool.cc:224] Handling call
0709 13:16:19.896487 (+  1524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:19.949178 (+ 52691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:19.949208 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:19.989051 (+ 39843us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.284526 (+295475us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:20.312781 (+ 28255us) log.cc:844] Serialized 14 byte log entry
0709 13:16:20.492562 (+179781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.492635 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.240217 (+747582us) raft_consensus.cc:1685] finished
0709 13:16:21.240236 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.240369 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14684,"prepare.queue_time_us":28038,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":4195,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":65007,"thread_start_us":275664,"threads_started":1,"wal-append.queue_time_us":770373}
I20260709 13:16:21.241658 30779 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:21.242952 30779 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 6 to 7, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 7 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.243531  3400 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.244942 30779 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 10 to 11, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 11 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:21.185138  3162 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
I20260709 13:16:21.193323 30874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2587) took 1585 ms. Trace:
I20260709 13:16:21.188758  3270 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.222733 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:21.224020 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2269) took 1169 ms. Trace:
I20260709 13:16:21.160463  3465 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:21.283546 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2332) took 1017 ms. Trace:
I20260709 13:16:21.155624  3278 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:21.193339 31027 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:21.164152  3054 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.247082 30874 rpcz_store.cc:276] 0709 13:16:19.608251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.608421 (+   170us) service_pool.cc:224] Handling call
0709 13:16:21.193117 (+1584696us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400126bd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.193258 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3253913344}
I20260709 13:16:21.246688 30779 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.229480 31024 rpcz_store.cc:276] 0709 13:16:20.092307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.916107 (+823800us) service_pool.cc:224] Handling call
0709 13:16:21.165665 (+249558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.315860 31024 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:21.112109  3216 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:16:21.252307 31023 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:16:21.317058 30954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.067s	sys 0.138s
I20260709 13:16:21.148195 31599 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
W20260709 13:16:21.317463 30954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.067s	sys 0.138s
I20260709 13:16:21.253593 31028 rpcz_store.cc:276] 0709 13:16:20.054120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.117329 (+1063209us) service_pool.cc:224] Handling call
0709 13:16:21.149108 (+ 31779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.223725 (+ 74617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.223959 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:21.289713  3403 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.971s	user 0.009s	sys 0.002s
I20260709 13:16:21.205153 31030 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
W20260709 13:16:21.224403  3474 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 13:16:21.256251  3430 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.256687  3485 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
W20260709 13:16:21.256763 30777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 352) took 20763 ms (client timeout 15000 ms). Trace:
W20260709 13:16:21.257825  3484 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:21.267109  3450 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:21.076898  3394 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:21.269223  3414 consensus_meta.cc:287] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.894s	user 0.004s	sys 0.007s
I20260709 13:16:21.262116  2545 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:21.271492 31596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1236) took 1016 ms. Trace:
I20260709 13:16:21.345419 31596 rpcz_store.cc:276] 0709 13:16:20.255523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.054859 (+799336us) service_pool.cc:224] Handling call
0709 13:16:21.180398 (+125539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.236487 (+ 56089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.271294 (+ 34807us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54006a54d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.271431 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239126784}
I20260709 13:16:21.272157  3291 raft_consensus.cc:3055] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:21.274288  3478 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
I20260709 13:16:21.276209 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1392) took 1443 ms. Trace:
W20260709 13:16:21.297508 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 202597us
I20260709 13:16:21.355454 31603 rpcz_store.cc:276] 0709 13:16:19.833215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.728816 (+895601us) service_pool.cc:224] Handling call
0709 13:16:20.729156 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.064564 (+335408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.064611 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.064669 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:21.064716 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.275974 (+211258us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400730354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:21.276021 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.276149 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770771840}
I20260709 13:16:21.356149 30924 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.297675  3438 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:21.318068 30923 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.015s	sys 0.011s
W20260709 13:16:21.358464 30923 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.015s	sys 0.012s
W20260709 13:16:21.358842 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 649796us
I20260709 13:16:21.246053  3148 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.319242 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2774) took 1299 ms. Trace:
I20260709 13:16:21.365942 31030 rpcz_store.cc:276] 0709 13:16:20.019704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.652372 (+632668us) service_pool.cc:224] Handling call
0709 13:16:21.319165 (+666793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.367410 31030 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:21.279028  3184 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:16:21.319700 30883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.022s	sys 0.070s
W20260709 13:16:21.360610 30923 leader_election.cc:336] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.853s (SENT)
I20260709 13:16:21.277798  3109 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 13:16:21.347884 30996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.012s
I20260709 13:16:21.318849  3160 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.376556  3160 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:21.380152 31023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 851) took 4244 ms (client timeout 1885 ms). Trace:
I20260709 13:16:21.380321  3278 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:21.380532 31023 rpcz_store.cc:269] 0709 13:16:17.135452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.446431 (+310979us) service_pool.cc:224] Handling call
0709 13:16:21.379964 (+3933533us) spinlock_profiling.cc:243] Waited 3.76 s on lock 0x7b54001b1cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.380087 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8645044608}
I20260709 13:16:21.381013 30779 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 7 to 9, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 9 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.384532  3448 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:21.384968  3448 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:21.385799  3448 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.387060  3448 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.328441 30777 rpcz_store.cc:269] 0709 13:16:00.494159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.519929 (+ 25770us) service_pool.cc:224] Handling call
0709 13:16:21.256512 (+20736583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:07.711612 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:07.714826 (+  3214us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:07.714874 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:16:07.714902 (+    28us) tablet.cc:662] Decoding operations
0709 13:16:07.716549 (+  1647us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:07.716604 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:07.716632 (+    28us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:16:07.718169 (+  1537us) tablet.cc:701] Row locks acquired
0709 13:16:07.718190 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:07.718345 (+   155us) write_op.cc:270] Start()
0709 13:16:07.718473 (+   128us) write_op.cc:276] Timestamp: P: 1783602967718290 usec, L: 0
0709 13:16:07.718492 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:07.719232 (+   740us) log.cc:844] Serialized 7466 byte log entry
0709 13:16:07.957597 (+238365us) op_driver.cc:464] REPLICATION: finished
0709 13:16:08.371541 (+413944us) write_op.cc:301] APPLY: starting
0709 13:16:08.376449 (+  4908us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:09.455124 (+1078675us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b18003187c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f273a9990ec 00007f273a9e5c0a 00007f273a9e54f7 00007f273a9e5490 00007f273a99cf48 00007f273e6b11bb 00007f273e6b1532 00007f273e6f8b93 00007f273e5a5de3
0709 13:16:09.577435 (+122311us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:09.577463 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:09.851214 (+273751us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:09.851533 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:16:09.851581 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:09.862500 (+ 10919us) log.cc:844] Serialized 172 byte log entry
0709 13:16:10.016593 (+154093us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.023990 (+  7397us) write_op.cc:454] Released schema lock
0709 13:16:10.024051 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:10.029790 (+  5739us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:10.029818 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53851,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":307774,"apply.run_cpu_time_us":62078,"apply.run_wall_time_us":1742641,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":59549,"prepare.run_cpu_time_us":85663,"prepare.run_wall_time_us":169725,"raft.queue_time_us":56792,"raft.run_cpu_time_us":91394,"raft.run_wall_time_us":199226,"replication_time_us":238939,"spinlock_wait_cycles":5671296,"thread_start_us":522050,"threads_started":5,"wal-append.queue_time_us":359268,"wal-append.run_cpu_time_us":62281,"wal-append.run_wall_time_us":2431327}]]}
I20260709 13:16:21.391703  3216 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.392401  3216 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:21.326684  3403 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.396096  3184 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:21.396374 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:21.397225 30874 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:21.397056  3184 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.397742  3403 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.399418 30998 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:21.400334 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1390) took 1590 ms. Trace:
I20260709 13:16:21.400926 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2769) took 1382 ms. Trace:
I20260709 13:16:21.400947  3216 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:21.401413 31027 rpcz_store.cc:276] 0709 13:16:20.018545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.211980 (+193435us) service_pool.cc:224] Handling call
0709 13:16:21.400708 (+1188728us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54003f5cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.400870 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333939968}
I20260709 13:16:21.402522 30882 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:21.383529 30779 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 2 to 9, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 9 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.342149  3450 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:21.285264 30949 rpcz_store.cc:276] 0709 13:16:20.266445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.507343 (+240898us) service_pool.cc:224] Handling call
0709 13:16:20.507633 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.507870 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:20.697534 (+189664us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.097022 (+399488us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.281877 (+184855us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800463180. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:16:21.283090 (+  1213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.283158 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:21.283225 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.283316 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.283473 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5213,"prepare.queue_time_us":503896,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":19115,"raft.queue_time_us":13157,"spinlock_wait_cycles":40585472,"thread_start_us":537450,"threads_started":2}
I20260709 13:16:21.364807 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:21.368620 30883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.022s	sys 0.070s
I20260709 13:16:21.224392 31598 rpcz_store.cc:276] 0709 13:16:19.808958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.560537 (+751579us) service_pool.cc:224] Handling call
0709 13:16:20.606342 (+ 45805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.000449 (+394107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.000478 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.000522 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:21.000557 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.147758 (+147201us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540014f0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:21.147826 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.147947 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905847040}
I20260709 13:16:21.328368  3084 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:21.348875  3291 raft_consensus.cc:740] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:21.370718 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.400699 31601 rpcz_store.cc:276] 0709 13:16:19.809721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.573856 (+764135us) service_pool.cc:224] Handling call
0709 13:16:20.574232 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.576687 (+  2455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.576753 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.596270 (+ 19517us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.095822 (+499552us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:21.095859 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.095920 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.400132 (+304212us) raft_consensus.cc:1685] finished
0709 13:16:21.400154 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.400279 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1808,"raft.queue_time_us":19473,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":34761,"thread_start_us":328274,"threads_started":1,"wal-append.queue_time_us":703153}
I20260709 13:16:21.404641 31031 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:21.353147 31024 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
W20260709 13:16:21.373944 30996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.012s
I20260709 13:16:21.414623 31024 pending_rounds.cc:85] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 6
I20260709 13:16:21.414894 31024 pending_rounds.cc:107] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:16:21.415154 31024 raft_consensus.cc:2889] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.408128 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:21.358016  3218 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:21.357919  3438 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:21.414774 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 596387us
I20260709 13:16:21.417748 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:21.411458 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.373768  3285 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:21.428730 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 68145us
I20260709 13:16:21.401859  3216 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:21.435220 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.349184  3414 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.437229 31023 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:21.442481 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.431919 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.452463 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:21.453315 31030 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:21.453208 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.455622 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:21.459657  3160 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.460223 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:21.460932 31023 raft_consensus.cc:2376] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17. Re-sending same reply.
I20260709 13:16:21.461766 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.462687 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.462689 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:21.463342 31023 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:21.463452 30874 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:21.426895  3438 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:21.429442  3295 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:21.470811 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.464695 30998 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:21.431922  2788 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:21.501886 30876 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:21.478387 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 453428us
I20260709 13:16:21.432133  3359 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:21.437393  3216 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.498739 30779 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 9 to 10, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 10 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.451320  3162 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:21.468773  3270 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.503638  3160 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:21.508598 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:21.468490  3426 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:21.473608  3295 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:21.531628 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.533721 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.542285 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.518141 31030 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:21.536111 30779 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 6 to 8, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 8 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.546407 31030 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:21.520381  2788 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:21.522583  3216 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:21.531512  3359 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.578558 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:21.581435 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2795) took 1322 ms. Trace:
W20260709 13:16:21.610303 31605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.025s
I20260709 13:16:21.589298 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:21.615501 31605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.000s	sys 0.026s
I20260709 13:16:21.610728 30779 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 7 to 9, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 9 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:21.580636 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:21.589289 30882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48716 (request call id 2593) took 1967 ms (client timeout 1502 ms). Trace:
I20260709 13:16:21.464222  3450 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:21.622473 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.621865 30779 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:21.547799  3295 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:21.617082 30882 rpcz_store.cc:269] 0709 13:16:19.621696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.625776 (+  4080us) service_pool.cc:224] Handling call
0709 13:16:20.481145 (+855369us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800000c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc200a0 00007f273fc1f984 00007f273919a6d4 00007f273919a662
0709 13:16:21.589060 (+1107915us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54000d4dd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.589216 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117529216}
I20260709 13:16:21.614929 31031 rpcz_store.cc:276] 0709 13:16:20.259183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.141799 (+882616us) service_pool.cc:224] Handling call
0709 13:16:21.404329 (+262530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.414147 (+  9818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.581159 (+167012us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54003f5cd0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:21.581356 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542508416}
I20260709 13:16:21.538795  3160 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.541484  3278 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:21.620611 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:21.554570  3403 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:21.529484  3162 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.521277  3291 consensus_queue.cc:260] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.667676  3403 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:21.669047 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2220) took 1520 ms. Trace:
W20260709 13:16:21.589819  3493 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:16:21.664186 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:21.681527 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.692934 30883 rpcz_store.cc:276] 0709 13:16:20.148334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.736642 (+588308us) service_pool.cc:224] Handling call
0709 13:16:20.736987 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.739992 (+  3005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.740021 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.740472 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.407716 (+667244us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:21.408239 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.408339 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.668785 (+260446us) raft_consensus.cc:1685] finished
0709 13:16:21.668814 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.668974 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2390,"raft.queue_time_us":3313,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10783,"thread_start_us":599514,"threads_started":1,"wal-append.queue_time_us":901686}
W20260709 13:16:21.698575 31571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.011s	sys 0.024s
W20260709 13:16:21.694285 31602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.035s
I20260709 13:16:21.659094  3160 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.700552 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.024s	sys 0.043s
I20260709 13:16:21.590214  3054 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:16:21.701484  3426 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:21.662866  3412 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.012s	sys 0.019s
I20260709 13:16:21.703946 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:21.706955 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:21.703322 31027 raft_consensus.cc:2410] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:16:21.732399 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.026s	sys 0.049s
I20260709 13:16:21.705628 30874 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:21.706038 31025 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.024s	sys 0.032s
W20260709 13:16:21.733743 31025 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.025s	sys 0.038s
W20260709 13:16:21.733027 31570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.022s
W20260709 13:16:21.733119 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 566114us
I20260709 13:16:21.623363  3442 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:16:21.617545  3488 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
W20260709 13:16:21.741242 31029 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.015s
I20260709 13:16:21.617802  3491 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.121s
W20260709 13:16:21.743686 31029 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.006s	sys 0.015s
I20260709 13:16:21.748833 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:21.699928  3487 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:16:21.749622 30878 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.696089  3450 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:21.699352 31602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.000s	sys 0.036s
W20260709 13:16:21.734485 31571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.025s
W20260709 13:16:21.734689 31570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.011s	sys 0.023s
W20260709 13:16:21.735795 31568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.020s
I20260709 13:16:21.787885 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:21.808890 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1237) took 1275 ms. Trace:
W20260709 13:16:21.809777 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 735191us
I20260709 13:16:21.809293 31602 rpcz_store.cc:276] 0709 13:16:20.533768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.118479 (+584711us) service_pool.cc:224] Handling call
0709 13:16:21.146814 (+ 28335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.147003 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:21.179954 (+ 32951us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.808537 (+628583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.808592 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:21.808632 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.808698 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.808835 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45416,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":76328,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":628262,"threads_started":1}
I20260709 13:16:21.810597 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:21.811350 31568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.014s	sys 0.020s
I20260709 13:16:21.803664 30874 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:21.754951 31026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.028s
W20260709 13:16:21.814352 31026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.007s	sys 0.028s
W20260709 13:16:21.815990 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 652475us
I20260709 13:16:21.741693  3109 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:21.739006  3412 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.012s	sys 0.019s
I20260709 13:16:21.826519 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:21.759055  3486 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
W20260709 13:16:21.736042  3482 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:16:21.832499 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:21.753381  3497 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.835227 31599 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:16:21.730227  3426 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:21.699321  3403 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.850862 31599 pending_rounds.cc:85] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 9
I20260709 13:16:21.851218 31599 pending_rounds.cc:107] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:16:21.851481 31599 raft_consensus.cc:2889] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:21.733906  3494 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:21.854646 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:21.855350 31598 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:21.764807  3032 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:21.844112 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:21.845688 31601 raft_consensus.cc:2410] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:21.834461 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:21.824880  3218 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.762647  3148 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.854410  3412 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:21.847633 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:21.885569 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:21.886439 31601 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:21.888454 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.844672  3139 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.848980  3499 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:21.865420  3151 consensus_meta.cc:287] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.002s
I20260709 13:16:21.764079  3163 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:16:21.802685  3336 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:21.824546  3414 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:21.827828  3400 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:21.883654  3236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.027s	sys 0.030s
I20260709 13:16:21.859694 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:21.904551 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:21.929877 31602 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:21.821091 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:21.822927 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:21.904141  3480 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:16:21.862099  3497 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.892210  3412 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:21.900871  3148 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:21.901194  3501 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:21.767212  2788 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:21.914214  3394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.017s	sys 0.038s
W20260709 13:16:21.938962  3236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.027s	sys 0.031s
I20260709 13:16:21.945030  3442 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:16:21.976436  3477 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:16:21.909035  3499 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.944702  3412 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:21.972205  3394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.018s	sys 0.039s
I20260709 13:16:21.923345  3218 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.903352  3139 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.938242 31598 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:21.946825 31603 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:21.913242  3154 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
W20260709 13:16:21.973387  3223 consensus_meta.cc:287] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.004s
W20260709 13:16:22.133001 30957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.000s	sys 0.044s
I20260709 13:16:22.121815 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39074 (request call id 1028) took 1914 ms. Trace:
I20260709 13:16:22.173477 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1399) took 1361 ms. Trace:
W20260709 13:16:22.224097 30957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.000s	sys 0.055s
W20260709 13:16:22.224853 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 84078.5us
I20260709 13:16:22.225795 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1040) took 1620 ms. Trace:
I20260709 13:16:22.224258 31604 rpcz_store.cc:276] 0709 13:16:20.812001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.176076 (+364075us) service_pool.cc:224] Handling call
0709 13:16:21.176330 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.176632 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:21.748939 (+572307us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.172598 (+423659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.172751 (+   153us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:22.172896 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.173030 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.173245 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46928,"prepare.queue_time_us":131865,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":104388,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":454,"thread_start_us":918497,"threads_started":2,"wal-append.queue_time_us":322435}
I20260709 13:16:21.921775  3336 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.226243 30957 rpcz_store.cc:276] 0709 13:16:20.820136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.820274 (+   138us) service_pool.cc:224] Handling call
0709 13:16:20.893523 (+ 73249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.893738 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:21.348302 (+454564us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.225118 (+876816us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.225236 (+   118us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.225362 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.225498 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.225703 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120189,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4246,"thread_start_us":1330382,"threads_started":2,"wal-append.queue_time_us":711882}
I20260709 13:16:22.215692  3444 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:22.009956  3364 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.000s
I20260709 13:16:22.273586  3364 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:22.170116 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 347104us
I20260709 13:16:21.906723  3032 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.276672 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:22.278975  3032 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.114460 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2231) took 1278 ms. Trace:
I20260709 13:16:22.279956 30876 rpcz_store.cc:276] 0709 13:16:20.835990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.888963 (+ 52973us) service_pool.cc:224] Handling call
0709 13:16:20.913968 (+ 25005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.502499 (+588531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.113754 (+611255us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400196754. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:22.114202 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351459200}
I20260709 13:16:22.282009  3509 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:22.283012  3409 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.379s	user 0.013s	sys 0.005s
W20260709 13:16:22.136051 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.015s	sys 0.020s
W20260709 13:16:22.283936 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.022s	sys 0.022s
W20260709 13:16:22.172495 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 351294us
I20260709 13:16:22.284636  3054 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:22.285187  3054 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:22.285462 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:22.110862 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 490058us
I20260709 13:16:22.286932 31571 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:21.979815  3162 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.156416 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:22.129338 30880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.026s	sys 0.041s
I20260709 13:16:22.143878 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2330) took 1877 ms. Trace:
I20260709 13:16:22.130692 30881 raft_consensus.cc:1240] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:22.142627 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2327) took 1877 ms. Trace:
W20260709 13:16:22.007887  3419 consensus_meta.cc:287] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.002s
I20260709 13:16:21.977913  3442 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:22.061683  3494 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.004860  3497 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:21.978972  3498 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:16:21.993810  3499 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:21.996096  3500 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:16:21.964828  3501 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:22.398366  3501 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.400312  3403 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.360555  3236 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.360670 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.403183 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:22.131904 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.010s	sys 0.019s
I20260709 13:16:22.403927 30952 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:22.404036 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.015s	sys 0.025s
W20260709 13:16:22.405297 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 973414us
I20260709 13:16:22.182188 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1257) took 1962 ms. Trace:
I20260709 13:16:22.407944 31605 rpcz_store.cc:276] 0709 13:16:20.219157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.931226 (+712069us) service_pool.cc:224] Handling call
0709 13:16:20.999452 (+ 68226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.003520 (+  4068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.003550 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.005431 (+  1881us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.615980 (+610549us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:21.616021 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.616088 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.181524 (+565436us) raft_consensus.cc:1685] finished
0709 13:16:22.181571 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.181903 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3678,"raft.queue_time_us":3924,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11819,"thread_start_us":547773,"threads_started":1,"wal-append.queue_time_us":880794}
I20260709 13:16:22.194855  3506 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:22.197223  3508 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:22.410032  3506 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.410149  3508 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.410532  3506 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.410715  3508 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:22.199330  3278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.014s	sys 0.018s
I20260709 13:16:22.412374 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:22.412920  3278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.014s	sys 0.018s
I20260709 13:16:22.413331 30951 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:22.413388  3278 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:22.414850 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:22.199738 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.417564  3295 consensus_meta.cc:287] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.751s	user 0.005s	sys 0.014s
I20260709 13:16:22.203393  3430 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:22.418241  3430 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.418443  3419 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.420030  3430 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:21.973309  3466 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.276s
I20260709 13:16:22.421766 31597 raft_consensus.cc:2368] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14.
W20260709 13:16:22.418255  3426 consensus_meta.cc:287] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.004s
W20260709 13:16:22.422416 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 135690us
I20260709 13:16:22.422801  3426 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.423271 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.425832  3426 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.227983  3444 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.286576  3054 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:22.003014  3417 consensus_meta.cc:287] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.276s	user 0.012s	sys 0.000s
I20260709 13:16:22.122653 30878 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:22.250043  3336 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.218905  3139 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.218971  3218 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.218330  3452 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:21.968755  3148 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.250321  3414 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:22.314810 30880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.026s	sys 0.046s
I20260709 13:16:22.307579 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.321774 30950 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.415004  3278 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.439289 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:22.440013 30949 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:22.289096 30956 rpcz_store.cc:276] 0709 13:16:20.265913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.494002 (+228089us) service_pool.cc:224] Handling call
0709 13:16:20.494332 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.495545 (+  1213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.495574 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.524989 (+ 29415us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.224316 (+699327us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:21.224374 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.224467 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.143312 (+918845us) raft_consensus.cc:1685] finished
0709 13:16:22.143359 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.143677 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":699006,"threads_started":1,"wal-append.queue_time_us":994956}
I20260709 13:16:22.224115 30879 rpcz_store.cc:276] 0709 13:16:20.207371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.768156 (+560785us) service_pool.cc:224] Handling call
0709 13:16:20.768525 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.768892 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.768925 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.769403 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.091796 (+322393us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:21.091854 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.091943 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.121179 (+1029236us) raft_consensus.cc:1685] finished
0709 13:16:22.121260 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.121570 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4711,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5325,"thread_start_us":321878,"threads_started":1,"wal-append.queue_time_us":584850}
I20260709 13:16:21.907689  3151 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:22.444934 31602 consensus_meta.cc:287] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.514s	user 0.014s	sys 0.000s
I20260709 13:16:22.450642 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:22.451747 30956 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.452852 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:22.289373 30954 rpcz_store.cc:276] 0709 13:16:20.265043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.266315 (+  1272us) service_pool.cc:224] Handling call
0709 13:16:20.266635 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:20.284490 (+ 17855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.284533 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:20.285249 (+   716us) log.cc:844] Serialized 52 byte log entry
0709 13:16:21.317828 (+1032579us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:21.317872 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.317949 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.141886 (+823937us) raft_consensus.cc:1685] finished
0709 13:16:22.141938 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.142346 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17393,"raft.queue_time_us":20511,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8235,"thread_start_us":949691,"threads_started":1,"wal-append.queue_time_us":1302726}
I20260709 13:16:22.337158 31027 raft_consensus.cc:2393] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.311734  3409 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.364583 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:22.365137 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.368204 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 80641.7us
I20260709 13:16:22.456624 30955 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.457067  3417 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.457770 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.458163 31032 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.457783  3409 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:22.363095 30846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.000s	sys 0.026s
W20260709 13:16:22.460011 30846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.000s	sys 0.026s
I20260709 13:16:22.459964  3494 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:22.461313 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.453087  3148 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.381312 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2768) took 2362 ms. Trace:
W20260709 13:16:22.388427 31029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.019s	sys 0.009s
I20260709 13:16:22.392710  3442 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.396332 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1041) took 1478 ms. Trace:
I20260709 13:16:22.421348  3419 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:22.216013  3184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.008s	sys 0.021s
I20260709 13:16:22.423506 31571 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.282963  3509 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:22.445668 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.446161  3414 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:22.469810 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.447412 30880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2238) took 1142 ms. Trace:
I20260709 13:16:22.448450 31031 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.448247  2860 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:22.449118  3452 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:22.360559 31025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.003s	sys 0.019s
I20260709 13:16:22.451624  3054 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.351835 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.487542 31602 raft_consensus.cc:2410] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 12 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:16:22.447340  3151 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.456316  3336 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.459328 31027 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.357496 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.460364 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:22.381801 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 205874us
I20260709 13:16:22.466032 30951 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.223836  3223 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:22.433949  2558 consensus_meta.cc:287] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 1.365s	user 0.010s	sys 0.008s
W20260709 13:16:22.476457 31029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.020s	sys 0.010s
W20260709 13:16:22.479338 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.018s	sys 0.011s
W20260709 13:16:22.427634  3219 consensus_meta.cc:287] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 1.846s	user 0.013s	sys 0.002s
I20260709 13:16:22.418201  3295 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.494218 31600 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.494262  3414 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.495313  3223 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:22.494858  3509 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.496137 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.483218  3452 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.473196 30880 rpcz_store.cc:276] 0709 13:16:21.305072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.305260 (+   188us) service_pool.cc:224] Handling call
0709 13:16:21.305682 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.305963 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.306001 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.306576 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.446902 (+1140326us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:22.446985 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.447093 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.447152 (+    59us) raft_consensus.cc:1685] finished
0709 13:16:22.447163 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.447355 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1139760,"threads_started":1,"wal-append.queue_time_us":704279}
I20260709 13:16:22.500481 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2797) took 1068 ms. Trace:
W20260709 13:16:22.496735  3184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.008s	sys 0.024s
I20260709 13:16:22.496050 30957 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:22.508180 31027 rpcz_store.cc:276] 0709 13:16:21.422520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.458436 (+1035916us) service_pool.cc:224] Handling call
0709 13:16:22.458981 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.490516 (+ 31535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.490727 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:22.499992 31025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.003s	sys 0.020s
W20260709 13:16:22.503202 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.018s	sys 0.011s
I20260709 13:16:22.497056 30958 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:22.508299 30949 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:22.464761 31026 rpcz_store.cc:276] 0709 13:16:20.018298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.064290 (+1045992us) service_pool.cc:224] Handling call
0709 13:16:21.082503 (+ 18213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:21.098204 (+ 15701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.098246 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:21.098965 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 13:16:21.814887 (+715922us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.338504 (+523617us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.380220 (+ 41716us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.380568 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.380742 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.380832 (+    90us) raft_consensus.cc:1685] finished
0709 13:16:22.380848 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.381061 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15189,"prepare.queue_time_us":192716,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":103,"raft.queue_time_us":32837,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":27585,"thread_start_us":1105649,"threads_started":2,"wal-append.queue_time_us":844296}
W20260709 13:16:22.510792 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 87489.9us
I20260709 13:16:22.476918  3364 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.463603  3444 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.467236 30953 rpcz_store.cc:276] 0709 13:16:20.918058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.918244 (+   186us) service_pool.cc:224] Handling call
0709 13:16:20.918556 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.918909 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.918944 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.919422 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.455681 (+536259us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:21.455720 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.455805 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.395870 (+940065us) raft_consensus.cc:1685] finished
0709 13:16:22.395912 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.396116 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":713,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6459,"thread_start_us":456082,"threads_started":1,"wal-append.queue_time_us":821218}
I20260709 13:16:22.485267  3417 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.508471 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.517445 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:22.516120  3466 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.520877 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2273) took 1813 ms. Trace:
I20260709 13:16:22.513592  2558 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.525529 30879 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:22.513796  3219 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.528541  3471 raft_consensus.cc:2764] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:22.528652 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.529681 30950 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.527667 30848 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:22.531329 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.532135 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2271) took 1825 ms. Trace:
W20260709 13:16:22.522697 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 786992us
I20260709 13:16:22.532265  3278 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:22.537220  3419 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:22.537900  3419 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:22.538864  3412 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.004s
I20260709 13:16:22.539089  3419 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.540639 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.541656  3336 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.532572 31025 rpcz_store.cc:276] 0709 13:16:20.706318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.169240 (+462922us) service_pool.cc:224] Handling call
0709 13:16:21.184089 (+ 14849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.184325 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:16:21.734201 (+549876us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.531191 (+796990us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.531567 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.531704 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.531757 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:22.531858 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.531945 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.532080 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3218,"prepare.queue_time_us":811429,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":134,"raft.queue_time_us":5321,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"thread_start_us":1327465,"threads_started":2,"wal-append.queue_time_us":741857}
I20260709 13:16:22.542220  2860 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:22.543346 30923 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:22.544056 30958 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:22.544246 30997 leader_election.cc:336] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.587s (SENT)
I20260709 13:16:22.546911  3409 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:22.548432  3452 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.548710 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2219) took 2400 ms. Trace:
I20260709 13:16:22.550202 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2773) took 2530 ms. Trace:
I20260709 13:16:22.550505 30950 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.550608 31032 rpcz_store.cc:276] 0709 13:16:20.019493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.101107 (+1081614us) service_pool.cc:224] Handling call
0709 13:16:21.101510 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.458642 (+1357132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.549892 (+ 91250us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400347e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:22.550150 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3119089536}
I20260709 13:16:22.534750 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:22.552156 30950 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:22.552631 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1235) took 2308 ms. Trace:
I20260709 13:16:22.553015 31600 rpcz_store.cc:276] 0709 13:16:20.243931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.022552 (+778621us) service_pool.cc:224] Handling call
0709 13:16:21.022906 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.505608 (+1482702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.552336 (+ 46728us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54006b21d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:22.552578 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3382646144}
I20260709 13:16:22.555436 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:22.556540  3364 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:22.555745 31571 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:22.556156  3426 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:22.549248 30958 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.553679 30950 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.553678 30954 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.549067 30881 rpcz_store.cc:276] 0709 13:16:20.148058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.640683 (+492625us) service_pool.cc:224] Handling call
0709 13:16:20.641787 (+  1104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.316140 (+1674353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.548425 (+232285us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54002aab54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:22.548647 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3421881728}
I20260709 13:16:22.523043  3442 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:22.563030 30998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.014s
I20260709 13:16:22.570147 31025 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:22.571969  3184 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:22.572685  3184 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.574142 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2796) took 1151 ms. Trace:
I20260709 13:16:22.575275  3184 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.569936 30950 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:22.535398 31570 connection.cc:256] RPC call timeout handler was delayed by -1.1853863300000285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:16:22.584936 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:22.586061  3448 consensus_meta.cc:287] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 1.198s	user 0.009s	sys 0.012s
W20260709 13:16:22.586683 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 628500us
I20260709 13:16:22.587184 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.588335  3223 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:22.588920  3223 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:22.589359  3223 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:22.573138 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.576802 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2798) took 1154 ms. Trace:
I20260709 13:16:22.577250  3471 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:22.577862 30998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.007s	sys 0.014s
I20260709 13:16:22.578209  3417 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.579641  3444 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.580032 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2281) took 1003 ms. Trace:
I20260709 13:16:22.570181  3426 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:22.592887 31027 rpcz_store.cc:276] 0709 13:16:21.422798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.533575 (+1110777us) service_pool.cc:224] Handling call
0709 13:16:22.576185 (+ 42610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.576451 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.576481 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.576525 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.576559 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.576614 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.576718 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.539390  3412 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.534580 30924 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:22.601267  3160 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.006s
I20260709 13:16:22.605129 30951 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.586710 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.547567  3409 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.521458 31029 rpcz_store.cc:276] 0709 13:16:20.706974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.237354 (+530380us) service_pool.cc:224] Handling call
0709 13:16:21.237788 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.238039 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:21.748230 (+510191us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.518203 (+769973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.520336 (+  2133us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:22.520428 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.520548 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.520777 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":767478,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":7243,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":156,"thread_start_us":1257140,"threads_started":2}
I20260709 13:16:22.594761 31031 rpcz_store.cc:276] 0709 13:16:21.576873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.809220 (+232347us) service_pool.cc:224] Handling call
0709 13:16:22.579823 (+770603us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400146c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:22.579972 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295722240}
I20260709 13:16:22.574546 31030 rpcz_store.cc:276] 0709 13:16:21.422240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.547134 (+124894us) service_pool.cc:224] Handling call
0709 13:16:22.162907 (+615773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.163650 (+   743us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:22.164340 (+   690us) log.cc:844] Serialized 14 byte log entry
0709 13:16:22.348559 (+184219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:22.348610 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:22.355177 (+  6567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.357923 (+  2746us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.573726 (+215803us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003773d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:22.573924 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26010,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":99,"raft.queue_time_us":8843,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":21399,"spinlock_wait_cycles":1246126336,"thread_start_us":173606,"threads_started":1}
I20260709 13:16:22.618120 30952 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:22.619051 31024 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:22.616845 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.610013 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:22.591962  2558 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:16:22.623083 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:22.623818 30922 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.132:42425 timed out after 2.007s (SENT) [suppressed 47 similar messages]
W20260709 13:16:22.609923 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 762364us
I20260709 13:16:22.634684 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:22.625286 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.637234 31600 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.639930 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.616358  3151 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:22.676160  3151 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.678586  3151 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.679122 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:22.681015  3466 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.681617  3466 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.682096 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.684036  3466 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:22.681630 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.684939 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.685335 31604 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:22.685807 31599 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
W20260709 13:16:22.688383 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 164450us
I20260709 13:16:22.689783 31601 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:22.690162 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:22.695528  3409 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.696130 30953 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:22.699033  3518 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:22.700155  3518 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:22.700454  3518 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:22.700937 30878 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.701272  3518 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.702708  3518 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.702869  3260 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.703586  3260 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.705991  3260 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:22.706302 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:22.706568  3260 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:22.708086  3148 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:22.708474 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.709161 30879 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:22.711069  3414 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:22.715973  3508 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.718532  3508 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.626578 31027 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.643143  3394 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:16:22.643989  3291 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.644688 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.646471 30880 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:22.624773  3426 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.647472  3430 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.727316 30876 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:22.591589  3526 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:16:22.652686  3412 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:22.653743  3450 consensus_meta.cc:287] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.825s	user 0.017s	sys 0.000s
I20260709 13:16:22.656132 30950 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:22.656682  3501 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.658800 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:22.659322  3219 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:22.659987 30875 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:22.660329 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.660784 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.661550 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:22.662227  3417 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.664089  3539 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:22.609948  3506 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:22.737615 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 77408.5us
I20260709 13:16:22.737658  3539 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:22.738446  3539 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.739094  3506 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:22.739215  3501 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.665046 30998 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:22.740190 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 75274.2us
I20260709 13:16:22.739992  3219 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.742169 31602 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:22.742317  3219 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.742602  3154 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:22.743191  3154 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.744171  3154 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.620091  3160 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.748315  3160 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.741974  3471 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:22.667104 30954 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:22.668256 31032 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:22.754094 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:22.668140 31024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 881) took 1247 ms (client timeout 1623 ms). Trace:
W20260709 13:16:22.669569  3438 consensus_meta.cc:287] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.159s	user 0.001s	sys 0.016s
I20260709 13:16:22.624945  3364 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.672263 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.673316 31031 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:22.673918 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.663450 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:22.647822  3216 consensus_meta.cc:287] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.878s	user 0.004s	sys 0.015s
I20260709 13:16:22.728734 30996 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:22.730960 30847 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:22.736927 31600 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.664712  3505 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:22.761844 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:22.762549 30877 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:22.666323 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:22.763291 30881 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:22.755362 31024 rpcz_store.cc:269] 0709 13:16:21.420676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.455312 (+ 34636us) service_pool.cc:224] Handling call
0709 13:16:22.667946 (+1212634us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400347454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:22.668069 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457857920}
I20260709 13:16:22.763928 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.764457 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:22.764593 31032 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:22.765090 31024 raft_consensus.cc:2376] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11. Re-sending same reply.
I20260709 13:16:22.765623 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.765975 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:22.766515 31032 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.766597 31024 raft_consensus.cc:2376] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13. Re-sending same reply.
I20260709 13:16:22.734455 31597 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:22.762151  3505 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.769490  3505 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:22.770361 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 183799us
I20260709 13:16:22.767516 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.771231 31024 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
W20260709 13:16:22.771414 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45641.3us
I20260709 13:16:22.772243  3151 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:22.767382 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.773608 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:22.732874  3184 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.734361  3336 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.776988 30877 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:22.771253 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.783111 31602 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
W20260709 13:16:22.792914 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.737658  3526 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:22.810205 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:22.820215 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 93362.6us
I20260709 13:16:22.821122 30847 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:22.823611 30883 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:22.824276 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:22.832329 31029 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 15: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.833180 30998 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:22.834246 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.828485 30996 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:22.828060 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:22.765923  2788 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:16:22.777386  3364 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.827553  3151 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.778373  3438 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.801066  3216 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.830395  3278 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:22.849261 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 84278us
I20260709 13:16:22.846189 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:22.846652 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.853739 31031 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.838405  3409 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:22.854251 31030 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:22.852474 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:22.857399 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:22.838406  3219 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:22.845765  3394 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:22.869223 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.882877 30955 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:22.882961 31602 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:22.895252 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 70735us
W20260709 13:16:22.900269 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 142258us
W20260709 13:16:22.901579 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 130429us
I20260709 13:16:22.903707 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.849759  3526 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:16:22.908809 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.911173 31026 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:22.891213  3394 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:22.898414  3162 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:22.910899  3409 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.856552  3278 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.916327  3148 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.919814 31023 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:22.909844  3505 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:22.922650  3109 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:22.925786 30949 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:22.931888 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.932552 31604 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:22.919620 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.933080 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.922020  3557 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:22.986668  3557 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.987841  3223 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.989058  3557 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:22.989847 31601 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:22.990221  3223 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:22.859444  3151 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.939865 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.940798 30996 leader_election.cc:400] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14.
I20260709 13:16:22.993302 30996 leader_election.cc:403] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.993515  3151 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:22.993810 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 53225.8us
I20260709 13:16:22.941543 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.995016 31599 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:22.997388  3448 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:22.997813  3448 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:22.942577 31030 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:22.942492  3438 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:23.000706 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.001446 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:22.944684  3409 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.953341 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.024281 31598 raft_consensus.cc:2376] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14. Re-sending same reply.
I20260709 13:16:23.025610 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.027130 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.955305  3162 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:23.028894  3162 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:22.956332 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.032812 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:23.033308 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.033672  3154 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.034103 31605 raft_consensus.cc:2376] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15. Re-sending same reply.
I20260709 13:16:23.034428  3559 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:23.034914  3559 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:22.957613 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 48912.6us
I20260709 13:16:23.036223 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2799) took 1613 ms. Trace:
I20260709 13:16:23.036456 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.036612 31023 rpcz_store.cc:276] 0709 13:16:21.423068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.544601 (+121533us) service_pool.cc:224] Handling call
0709 13:16:23.036014 (+1491413us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000c4ed4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:23.036165 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2861462912}
I20260709 13:16:23.038057  3526 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:22.959990  2860 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.038182  3539 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.039752  3054 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:22.961582  3548 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:23.041653  3054 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:22.968182  3364 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:22.968552  3546 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:22.970861 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:22.949635 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 103088us
I20260709 13:16:22.985081  3109 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:22.985817  3216 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:22.992844 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.997207 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.947836  3278 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.008556 31597 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:23.009990 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.907389  3499 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
W20260709 13:16:23.011462 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.058238 30847 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:22.982297  3505 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:23.072633 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.019636 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.021375  3295 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.035792  3559 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:22.900143  3513 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:23.035352 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.048007 31600 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:23.028896 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.039611  3539 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.059270 31604 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:23.079195 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.077132 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:22.935446  3394 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:23.013098 31032 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:23.076526 31596 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:23.080541 31598 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:23.084103 31603 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.084717 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.070817  3444 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:23.070849  3419 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:23.089004 31601 raft_consensus.cc:2393] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:23.074651  3505 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:23.103557 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.085438 30955 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:23.092875 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.094209 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:23.097090 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.075587  3403 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.073441  3223 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.086251 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.099999 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.100939 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:23.099041 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:23.146524 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 49566.5us
I20260709 13:16:23.147212 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.108642 30953 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:23.110232 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.110872 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:23.149075 30951 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:23.111334 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 59157.7us
I20260709 13:16:23.112910 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.115933  3513 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.116899 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:23.117508 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 146849us
I20260709 13:16:23.057698  3148 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:16:23.143673 31027 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:23.097855  3419 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:23.133148 31028 raft_consensus.cc:2410] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:16:23.136263  3559 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:23.137292 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 66091.6us
I20260709 13:16:23.167486 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.137758 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:23.103454  3278 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:23.138571 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.159621 31603 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:23.129022  3109 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.098318  3444 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:23.182785 31600 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.189107 31602 raft_consensus.cc:2410] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:16:23.182466 31599 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:23.186408 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.191609 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.192929 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.193615 30949 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:23.185659 31601 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:23.194599 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:23.202134 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.204532 30956 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.159035  3151 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14.
I20260709 13:16:23.205204 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.191877 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.209231 31597 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:23.207544 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.182519  2860 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.211261 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:23.194500  3291 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.192101  3216 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.214596 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:23.222733 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 85096.8us
I20260709 13:16:23.223276 31603 raft_consensus.cc:1240] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:16:23.217974 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.164299  3364 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:16:23.216616 30949 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:23.224263 31597 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:23.226897 30878 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:23.208498  3278 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:23.211861  3442 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:23.236770 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.225821  3417 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.214046  3450 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:23.248631 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.236361 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:23.249907 30882 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.252996 30875 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:23.256047 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 70817.8us
I20260709 13:16:23.257053 30922 leader_election.cc:400] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:23.257385 30922 leader_election.cc:403] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:23.258100 30922 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.259274 30922 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.260056 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.260880 30879 raft_consensus.cc:2393] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:23.230899  3419 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.262553 31598 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:16:23.262588 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.263820 30879 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 15: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:23.265228  2558 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:23.265690  2558 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:23.266753  2558 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.268591 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.269567  3444 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:23.270217 30879 raft_consensus.cc:2393] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:23.270547  3444 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:23.272156  3450 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.274358  3450 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.277928  3419 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.269043 30883 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:16:23.279599 30883 pending_rounds.cc:85] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 10
I20260709 13:16:23.279891 30883 pending_rounds.cc:107] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:16:23.279976 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.281436 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:23.282313  3509 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.282423  3219 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:23.283504 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.243959 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.280170 30883 raft_consensus.cc:2889] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.233908  3148 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.308104 31600 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:23.283468  3219 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:23.309568 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 58136.9us
I20260709 13:16:23.310024 31601 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
W20260709 13:16:23.312500 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 53287.2us
I20260709 13:16:23.297593  3364 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:23.316505  2558 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.326495 31596 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:23.304291  3518 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.306813  3417 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:23.340592 30879 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:23.326947  3148 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.343612 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 96618.1us
I20260709 13:16:23.362654 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:23.322618  3562 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:23.345481 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 101597us
I20260709 13:16:23.346067  3278 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.365784 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:23.349073 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65733.2us
I20260709 13:16:23.350715 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.325400  3154 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:16:23.352178 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.347535  3403 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:23.322710  3160 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.373202 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.341429  3223 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.375563 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:23.370754 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:23.378788  3148 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.379155  3562 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:23.379714 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.383646 30877 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:23.414193 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:23.356526  3032 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:23.383448  3471 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:23.373503  3403 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.375492  3364 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:23.384639  2860 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:23.384850  3219 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.391955 31028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 877) took 1972 ms (client timeout 2082 ms). Trace:
I20260709 13:16:23.392571 30957 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:23.393690 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.397644 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:23.398838 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:23.400043 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:23.400254  3513 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:23.401046 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:23.354332  3438 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:23.406129 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 67025.8us
I20260709 13:16:23.368152  3535 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.421854 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45625.9us
W20260709 13:16:23.426136 31028 rpcz_store.cc:269] 0709 13:16:21.419534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.544077 (+124543us) service_pool.cc:224] Handling call
0709 13:16:23.391688 (+1847611us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54003f57d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:23.391893 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3487923968}
I20260709 13:16:23.427052 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:23.423391  3564 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:16:23.461825 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 143731us
I20260709 13:16:23.375895  3160 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.415128  3499 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:16:23.444558  3417 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.465183  3559 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.519173 30883 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:23.520767 30956 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:23.462870  3364 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:23.478039  3501 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.465588  3513 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.478740  3526 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.528087 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.443796  3032 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.535909 31029 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:16:23.456310  3535 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:23.530041 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 150445us
I20260709 13:16:23.537307 31029 pending_rounds.cc:85] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 10
I20260709 13:16:23.540993 31029 pending_rounds.cc:107] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:16:23.541280 31029 raft_consensus.cc:2889] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.541149 30996 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:23.515538 30951 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:23.565531 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 80250.1us
I20260709 13:16:23.566581 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.576027 30876 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
W20260709 13:16:23.580317 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 168436us
I20260709 13:16:23.580485 31023 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:23.509984  3336 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:16:23.585287 30924 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.581372 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:23.589177 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 110585us
I20260709 13:16:23.551692  3154 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.529954  3559 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.589361 30848 leader_election.cc:336] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.953s (SENT)
I20260709 13:16:23.536324  3526 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:23.540660  3501 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.541373  3513 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.592509  3417 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:23.553650  3216 consensus_queue.cc:1059] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:16:23.594007  3054 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:23.600718 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.613121 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.593056  3154 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:23.620482 31599 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:23.624097 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:23.627174 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.582188  3448 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.550915  3562 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:23.615948  3336 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:23.636193 30876 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:23.620350  3154 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:23.626253  3394 consensus_meta.cc:287] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.002s
W20260709 13:16:23.646925 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48677.6us
I20260709 13:16:23.626157  3584 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.618906  3054 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:23.650300 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44217.6us
I20260709 13:16:23.628693  3417 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:23.654873 30922 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.659324 30882 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:23.663333  3160 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.664199  3032 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.668212  3054 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.670894  3576 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:16:23.672312  3575 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:16:23.673460  2860 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:23.680212 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.680255 30879 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:23.678484  3154 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.684511  3430 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:23.684968  3430 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:23.685673  3154 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.685983  3430 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.649396  3448 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.664136  3559 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:23.674606  3572 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:16:23.705547  3586 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:23.675364 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 86089.1us
I20260709 13:16:23.678529  3403 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.679414 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.689229 31596 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:16:23.690037 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:23.692358  3570 log.cc:927] Time spent T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:16:23.693282  3417 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.673605  3571 log.cc:927] Time spent T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:23.701258 30883 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:23.702903 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:23.706085 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44633.7us
I20260709 13:16:23.651574  3278 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.618794  3364 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.712718 31596 pending_rounds.cc:85] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 12
I20260709 13:16:23.730630 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.731127 31596 pending_rounds.cc:107] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 13:16:23.731426 31596 raft_consensus.cc:2889] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.728312 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.732439  3154 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:23.773623 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 118846us
I20260709 13:16:23.774091  3513 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:23.774487 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.776467  3438 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.776886  3438 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:23.777261  3438 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:23.783955 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.785648 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.657181  3394 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.786870 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:23.787086 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.794646 31031 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:16:23.793570 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 208342us
I20260709 13:16:23.726068  3559 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:23.800872 31604 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:23.772907  3430 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:23.662875  3584 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.794015  3505 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.002s
I20260709 13:16:23.772403  3154 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:23.731245  3419 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:16:23.813349 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.749191  3278 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:23.818715 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 155079us
I20260709 13:16:23.822168 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.822197 31604 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:23.823314 30882 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:23.813715  3154 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.813311  3535 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:23.817189  3559 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:23.651684  3499 consensus_queue.cc:1175] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74f5a5b7556240508983221981af4ab4" responder_term: 12 status { last_received { term: 11 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:23.840118  3591 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.840644  3591 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.840994  3591 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.814100  3505 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.850690  3526 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:23.849117 31604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:23.856581 31604 raft_consensus.cc:606] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.856946 31604 raft_consensus.cc:614] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:23.858317 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 82646.6us
I20260709 13:16:23.859194 30922 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.860781 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:23.868831 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 46734.5us
I20260709 13:16:23.872427 31604 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:23.874033 31602 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:23.872509  3336 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:23.877058  3278 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.878293  3295 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:23.880296 30922 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.885128  3505 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.885890 30880 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:23.871594  3501 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.892268 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.893882 30998 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:23.894204  3403 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.894806 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:23.895526  3535 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:23.896057  3151 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:23.896411 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.896555  3151 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:23.896749 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.896957  3535 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:23.897403  3535 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.897472 31596 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:23.897830  3535 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:23.898216 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:23.899756  3032 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:23.901571 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.903637  3573 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:23.904058  3336 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:23.904762  3573 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:23.905236  3573 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:23.906286  3573 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.897574  3151 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:23.912388  3573 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:23.916491  3394 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.916764 30922 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.907971 31602 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:23.903110 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:23.934022  2860 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:23.934482  2860 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.937029 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:23.944124 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:23.944782 31596 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:23.934901  2860 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:23.931078  3336 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:23.946200 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:23.950698 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 80590.6us
I20260709 13:16:23.951624 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:23.930202  3584 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.950491  3054 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:23.960882  3394 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:23.964423  3518 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:23.965368  3438 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.981377  3438 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:23.983672  3578 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:23.984110  3578 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:23.985002  3578 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.986313  3578 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:23.992674 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 264303us
I20260709 13:16:23.995983 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:23.996820 31025 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:23.953778  3601 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.976490  3394 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.005988 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:24.009217 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.010030 31025 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:23.978683  3518 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:24.013187 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:23.993240  3494 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.029330  3494 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.012279  3602 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:24.032382  3602 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:24.032815  3602 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.035957  3595 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:24.037454  3595 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:24.038516  3471 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:24.038903  3471 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:24.039472  3593 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:16:24.039845  3471 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:23.999512  3438 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.011656  3216 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:24.022127  3518 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.012279  3394 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.022372  3336 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.023234  3590 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:24.020045 31030 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
W20260709 13:16:24.052839 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.055637 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:24.012459  3219 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:24.057420 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.001672  3601 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.019471  3513 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:24.058444 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.068696 30875 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
W20260709 13:16:24.068773 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 152070us
I20260709 13:16:24.069361 30875 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:24.069754 30922 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.006523  3448 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:16:24.051011  3562 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.051800  3438 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.076996 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:24.019685  3032 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:16:24.086953  3494 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.087468 31603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:24.053802  3154 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.088095 31603 raft_consensus.cc:606] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:24.088454 31603 raft_consensus.cc:614] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:24.089439  3154 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.090665  3559 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:24.020533  3260 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:16:24.093688  3505 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:24.093955  3601 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.094117  3505 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.094575  3505 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:24.096540 31603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:24.097131 31603 raft_consensus.cc:606] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:24.099932  3562 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.102360  3562 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.103222 31023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:24.103873 31023 raft_consensus.cc:606] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:24.104243 31023 raft_consensus.cc:614] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:24.105245  3591 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.066087  3518 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.107441  3591 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.085034  3438 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:24.108884  3592 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:16:24.058063  3583 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:16:24.068174  3219 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.076602  3590 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:24.113663  2860 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.117901 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:24.140054 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2290) took 1328 ms. Trace:
I20260709 13:16:24.146067 31029 rpcz_store.cc:276] 0709 13:16:22.811215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.880767 (+ 69552us) service_pool.cc:224] Handling call
0709 13:16:23.392401 (+511634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.596623 (+204222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.997550 (+400927us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54003f57d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:24.139867 (+142317us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54003f57d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:24.139999 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415990912}
I20260709 13:16:24.041023  3160 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:24.071630  3513 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.121301 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:24.123291 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 129853us
I20260709 13:16:24.154361 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:24.154853 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.125922 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:24.116460  3417 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:24.084206  3295 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.057849  3409 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
W20260709 13:16:24.150525 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 526456us
I20260709 13:16:24.152567 31603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:24.154363  3513 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:24.157096 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 72295.9us
I20260709 13:16:24.171806 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1417) took 1159 ms. Trace:
I20260709 13:16:24.159322 31603 raft_consensus.cc:606] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:24.159328 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.140576  3219 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.111641  3535 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.173529 31597 rpcz_store.cc:276] 0709 13:16:23.012069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.235646 (+223577us) service_pool.cc:224] Handling call
0709 13:16:23.284196 (+ 48550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.307214 (+ 23018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.307277 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.348091 (+ 40814us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.563818 (+215727us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:23.590461 (+ 26643us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.983278 (+392817us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18003691c0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737ae7c0a 00007f2741227219 00007f2737b6fa40 00007f2737b6a4e4 00007f2737b6a455 00007f273ac52060 00007f273ac64716 00007f273ac75287 00007f273ac75208
0709 13:16:24.161554 (+178276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.161704 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.161747 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:24.171493 (+  9746us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.171706 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28457,"prepare.queue_time_us":24642,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":411608,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8325,"spinlock_wait_cycles":4184320,"thread_start_us":393345,"threads_started":2,"wal-append.queue_time_us":316662}
I20260709 13:16:24.177035 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.179877 31027 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:24.158447  3417 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:24.148986  3394 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.172744  3578 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:24.208271 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:24.194934 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 243416us
I20260709 13:16:24.199949 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:24.200198 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:24.212210 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.194110  3591 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:24.194350  3054 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.199030  3417 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.197516  3559 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:24.178507  3295 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.207718  3578 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:24.223376 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.223455  3054 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.230382  3607 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:24.252707  3607 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:24.253520  3054 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.255498  3394 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.256784  2860 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.238482  3599 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:24.261202  3599 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:24.261456  3605 log.cc:927] Time spent T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:24.261710  3599 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.264150  3535 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:24.269942 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 69814.4us
W20260709 13:16:24.300863 30997 leader_election.cc:336] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.552s (SENT)
I20260709 13:16:24.302531 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:24.307526 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 99165.7us
I20260709 13:16:24.314850 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:24.316951 31604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
W20260709 13:16:24.317564 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.266471  3591 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.321424 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:24.322547 31602 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:16:24.322491 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:24.271520  3578 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.291601  3587 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.332587 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 120449us
I20260709 13:16:24.259526  3505 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.314200  3154 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:24.230321  3559 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:24.342056 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.339871  3223 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:24.353004 31025 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:24.226409  3611 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.133s
W20260709 13:16:24.355602 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.353569  3438 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.357033  3295 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.357749  3438 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:24.365630  3612 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:16:24.366639  3609 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:16:24.370044  3591 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.379001  3505 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.382405  3559 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:24.385370 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.387656 31602 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:24.238008  3562 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:24.391914 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:24.409229 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:24.410056 31025 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.391152  3562 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.416677  3562 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.419400 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:24.420595 31603 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:24.419899 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:24.423142 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:24.427474 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:24.428498 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.429162 30881 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:24.389133  3573 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.435927 31025 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:24.436510 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:24.440201 30874 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:24.321591  3602 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.339020  3587 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.441519 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.240128  3590 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.448818 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:24.452927 31029 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:24.449326 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.417694  3448 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:24.445194 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:24.447263 31032 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 9.
I20260709 13:16:24.454775 30882 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:24.456419 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:24.418548  3154 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:24.468847 30951 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:16:24.470367 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:24.466585  3295 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:24.473434  3295 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.482319 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:24.476099 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.484015 30950 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:24.484133 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:24.485006 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.485183 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.485580 30950 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:24.485882 30949 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:24.486733 30955 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:24.488142 30954 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:24.489094 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.489655 30953 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:24.467785  3448 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:24.492410  3615 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:24.499665 30882 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:24.500301 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.501032 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.514256 30876 raft_consensus.cc:2368] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17.
I20260709 13:16:24.501717 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.515511 30883 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:24.448028  3573 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.503969  3505 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.475615  3295 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.520821 30880 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:24.524693 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:24.521178 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 214177us
I20260709 13:16:24.530717 31597 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:16:24.531225 31597 pending_rounds.cc:85] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
I20260709 13:16:24.530711 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.531633 31597 pending_rounds.cc:107] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:16:24.532076 30951 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 17.
I20260709 13:16:24.536145 30950 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:24.532045 31597 raft_consensus.cc:2889] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.528441 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:24.538502 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.539269 30953 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:24.540978 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:24.541898 30955 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:16:24.545280 30954 raft_consensus.cc:2393] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:24.549113 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:24.565456 30951 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:24.566346  3448 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.573941  3219 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.582928 30877 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:24.584676  3587 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.584832  3494 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:24.586469  3602 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.592236  3573 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:24.593166 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.599143 31599 raft_consensus.cc:1240] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:16:24.600059 31604 raft_consensus.cc:606] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:24.600517 31604 raft_consensus.cc:614] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:24.604121 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.614661 31029 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:24.616762 30874 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:24.524444  3505 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.630862  3505 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.619261 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:24.645793 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 380159us
I20260709 13:16:24.675169 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.682128 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:24.682837 31030 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:24.686111  3594 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.692104 30954 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:24.653611  3535 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:24.698087 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 169733us
I20260709 13:16:24.702656 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.703547 30951 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
I20260709 13:16:24.654153  3559 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:24.713084 31031 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:24.718353 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:24.683341  3623 raft_consensus.cc:2764] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:16:24.727955 30848 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:24.706833  3594 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.732991 30951 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:24.726578 31597 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:24.699321  3610 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:24.683578  3586 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:24.673794  3513 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.735333 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:24.695204 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 357904us
I20260709 13:16:24.774673 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:24.714152  3535 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:24.737145 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.825397 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.737977 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.951592 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:24.882637 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.862136  3417 consensus_meta.cc:287] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.001s
W20260709 13:16:24.862798 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.773329 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:24.954025 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 216944us
I20260709 13:16:24.774354 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:24.763381  3471 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:24.746680 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.762395 30876 raft_consensus.cc:1240] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:24.968152 30954 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.940117 31030 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
W20260709 13:16:24.949154  3628 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:16:24.750243  3394 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:24.800331 30924 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:24.941586 31597 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:24.973066 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 244045us
I20260709 13:16:24.973237 30881 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
W20260709 13:16:24.974241 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 174037us
W20260709 13:16:24.769337  3599 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
W20260709 13:16:24.774526  3603 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.674s	user 0.011s	sys 0.000s
I20260709 13:16:24.951905 31031 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:24.752048 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:24.860737  3590 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.784277  3219 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:24.992733  3599 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.900051  3562 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:24.961633 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:25.000262  3624 log.cc:927] Time spent T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.270s	user 0.000s	sys 0.003s
I20260709 13:16:24.966167 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:25.001395  3632 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:25.002363 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.008219  3154 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:25.008401 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 256468us
I20260709 13:16:25.008718  3154 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.993072  3364 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:24.804442 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:25.009609  3364 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.010155  3364 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:24.966416 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:24.808594  3509 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:24.970112 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:24.967500  3054 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:24.819378  3414 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.974993 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:25.070585 31025 raft_consensus.cc:2368] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17.
I20260709 13:16:24.977293 31026 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:24.820448  3578 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.009097  3154 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:24.969014 30954 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:24.737269  3559 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:24.738262  3518 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.242s
I20260709 13:16:25.069790 31596 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:24.967516  3595 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:25.074294 31597 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:25.074900 30951 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:16:24.747716  3594 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:25.077775 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 102845us
I20260709 13:16:25.117976 31025 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.118476 30924 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:24.973253  3622 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:24.750391  3610 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.079411 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:25.122120 31026 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:25.127008 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.971333  3151 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:16:25.128464 31603 raft_consensus.cc:1240] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:25.135623 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.132730 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:24.968107  3417 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.138687 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.143735 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:25.144541 31030 raft_consensus.cc:2393] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:25.144801  3559 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.145368 30958 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:25.146382 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.146714 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.147343 30956 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:25.148398 30952 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.149549 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:25.148550  3640 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:25.145377  3559 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:16:25.152726  3409 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.153281  3409 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.154851 31602 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:25.148308  3594 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.156744  3599 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.135886  3448 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:25.157925 31596 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:25.158423  3448 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:25.158926  3448 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.171535  3578 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:25.140766  3535 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.173535  3610 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:25.175547  3562 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.116416  3617 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:25.176849  3617 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.178930 31030 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:25.184083 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.185038  3513 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.185367  3336 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.186949 30923 leader_election.cc:400] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17.
I20260709 13:16:25.187362 30923 leader_election.cc:403] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:25.188021  3336 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:16:25.075819  3590 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.079963  3414 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.193958  3414 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.200615 30949 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:25.082762  3295 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:25.131065  3602 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.131573  3586 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.179523  3617 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.125947  3595 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.199654  3336 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17.
I20260709 13:16:25.155238  3409 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:25.078547  3509 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:25.214303  3584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.016s	sys 0.023s
I20260709 13:16:25.226051 30957 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:25.229436 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:25.232192 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:25.248082 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:25.250236 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:25.256779 31028 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:25.247449 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:25.260279 31026 raft_consensus.cc:2410] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:16:25.193981  3590 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.207353  3562 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:16:25.234519  3584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.016s	sys 0.023s
I20260709 13:16:25.275542 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:25.282672 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 316313us
I20260709 13:16:25.283460 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:25.288386 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 168322us
I20260709 13:16:25.289330 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:25.291733 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.297184 30848 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:25.297825 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.264786  3417 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.229329  3617 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:16:25.307698 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.311153 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.268455  3394 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:25.218720  3586 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.261325  3295 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:16:25.341809 30924 leader_election.cc:400] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17.
I20260709 13:16:25.296622  3054 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:25.354604 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:25.355326 30881 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:25.355634 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.369663 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 72576.8us
I20260709 13:16:25.350207  3513 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.306864  3594 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:25.307142  3518 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:16:25.348574 31570 connection.cc:256] RPC call timeout handler was delayed by -1.33704833600018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:16:25.356950  3645 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.357225 31604 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:16:25.358032  3647 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.340188  3336 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.304637  3414 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.340118  3223 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:25.427706  3650 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:16:25.428102  3223 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.430169  3223 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.411170  3151 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.337850  3602 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:16:25.435453  3631 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.586s	user 0.002s	sys 0.000s
W20260709 13:16:25.436291  3642 log.cc:927] Time spent T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:16:25.437719  3629 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.589s	user 0.001s	sys 0.001s
I20260709 13:16:25.410458  3646 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.360034  3643 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.415220 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:25.409123  3562 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:25.431610 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 231904us
I20260709 13:16:25.343858 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.431823 31604 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:25.412276 31570 connection.cc:256] RPC call timeout handler was delayed by -1.0400483360001544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:16:25.438588  3633 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.361s	user 0.001s	sys 0.001s
I20260709 13:16:25.414201  3594 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:25.440153 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 188491us
W20260709 13:16:25.445732 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 102042us
W20260709 13:16:25.447913 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.448796 30848 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:25.450903 30924 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.452123 30848 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:25.452893 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:25.414840  3513 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.423375  3644 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:25.479259 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.478633 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.454680  3594 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:25.444375  3562 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:25.458088  3650 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:25.427196  3645 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.444168  3595 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.485991 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:25.450536  3602 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:25.461658  3584 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:25.460917  3641 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:16:25.500523  3223 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:16:25.508229  3650 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:25.508682  3650 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.450837  3643 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.474664  3587 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:25.509684  3587 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:25.510638  3587 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.511219  3586 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.461892  3647 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:25.510965  3562 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.511435  3154 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.500792  3651 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:16:25.485541 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.441478  3151 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.514353 30953 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:25.484071  3509 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:25.500370 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:25.509095  3650 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.490283 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:25.455272  3518 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:25.525872 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.526731 31597 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:25.525945  3616 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 1.010s	user 0.003s	sys 0.000s
I20260709 13:16:25.528406  3223 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.529184  3223 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:25.529750 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1435) took 1412 ms. Trace:
I20260709 13:16:25.530215 31598 rpcz_store.cc:276] 0709 13:16:24.117446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.118464 (+  1018us) service_pool.cc:224] Handling call
0709 13:16:24.118838 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.124909 (+  6071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.124940 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.135903 (+ 10963us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.336109 (+200206us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:24.336198 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.336944 (+   746us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.442190 (+1105246us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:25.529439 (+ 87249us) raft_consensus.cc:1685] finished
0709 13:16:25.529461 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.529689 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12281,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2017,"spinlock_wait_cycles":5349760,"thread_start_us":150820,"threads_started":1,"wal-append.queue_time_us":290559}
I20260709 13:16:25.528221 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:25.534209  3595 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:25.534458 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:25.534773  3595 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:25.535173  3595 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:25.535939  3648 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:25.536839  3648 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.537020  3649 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:25.537518  3649 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:25.539629  3448 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.527701 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.541505 31597 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:25.513936  3154 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.541846  3448 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.543977 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:25.505813  3645 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.473568  3054 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.546654 30955 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:25.544799  3513 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:25.501499  3364 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.514480  3651 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:25.547395  3223 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:25.499509 30957 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:25.510963  3643 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.568949 30950 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:25.569598 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.570827  3646 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.571035  3223 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:25.560117 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:25.560509 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 106166us
I20260709 13:16:25.562758  3657 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:25.564654  3364 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.562772 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.566191 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.461728  3394 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:25.566948  3635 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.488s	user 0.001s	sys 0.000s
I20260709 13:16:25.568300 30958 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:25.568894 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.570921 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.572974 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:25.573088 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:25.557165 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.577258  3223 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.577929  3151 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.538350  3649 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.578063  3594 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:25.578891 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 93039.4us
I20260709 13:16:25.556788  3651 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:25.600924 31598 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:25.602317 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:25.580971 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.562337 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:25.584636 31597 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.594363 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:25.596148 30996 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:25.592993  3471 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.004s
I20260709 13:16:25.599241 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.608462 30952 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.608601  3643 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:25.608312  3651 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.593094  3154 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.601063  3647 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.616103 31597 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:25.611640 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:25.612733 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 50494.6us
I20260709 13:16:25.643230 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:25.614995 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.644632 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.645668 31598 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:25.647017 31601 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.595254  3364 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.647753 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53499.4us
I20260709 13:16:25.649464 31601 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:25.659263 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:25.659927  3587 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:25.660674  3587 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:25.660547  3509 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:25.661762  3509 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:25.662145  3509 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:25.662348  3448 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:25.662844  3448 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.663276  3448 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.661783  3587 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.602771  3559 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.669667 30952 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.593183  3644 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:16:25.671476 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 73551.1us
I20260709 13:16:25.600967  3518 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:25.640707  3513 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:25.641013  3643 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.647159  3649 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.686336 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:25.641000  3409 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:25.647153  3154 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.691604 31025 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:25.668433  3657 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:25.691481 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.696558 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.692618 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:25.690953 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.667588  3648 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.663081  3509 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.632514  3595 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.703625 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1438) took 1058 ms. Trace:
I20260709 13:16:25.705818 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1443) took 1012 ms. Trace:
I20260709 13:16:25.692268  3643 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:25.706418 31600 rpcz_store.cc:276] 0709 13:16:24.693651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.337847 (+644196us) service_pool.cc:224] Handling call
0709 13:16:25.349169 (+ 11322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.349383 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:16:25.501998 (+152615us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.705371 (+203373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.705440 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:25.705519 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.705602 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.705738 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1592,"prepare.queue_time_us":175984,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":1714,"thread_start_us":333324,"threads_started":2}
I20260709 13:16:25.694911  3154 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:25.694257  3663 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.670519  3364 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.649876  3647 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.697572  3645 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:25.704216 31605 rpcz_store.cc:276] 0709 13:16:24.645576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.678022 (+ 32446us) service_pool.cc:224] Handling call
0709 13:16:24.678357 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.707999 (+ 29642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.708043 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.708512 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.876932 (+168420us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:24.876987 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.877178 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.566372 (+689194us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:25.699037 (+132665us) raft_consensus.cc:1685] finished
0709 13:16:25.699062 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.703553 (+  4491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21349,"raft.queue_time_us":21564,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":13974,"spinlock_wait_cycles":86602112,"thread_start_us":121403,"threads_started":1,"wal-append.queue_time_us":226579}
I20260709 13:16:25.697976  3513 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:25.722540 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:25.736519 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.689512  3578 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:16:25.708922  3651 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:25.743187 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 54621.2us
I20260709 13:16:25.745095 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:25.697695  3409 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.689416  3559 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.726266  3494 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:25.698324  3518 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.750026 30953 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:25.751482 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:25.759392 30952 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:25.755590  3559 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.757685 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.738183  3509 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:25.753839  3409 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:25.734547  3584 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:25.710728  3648 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.761457 31605 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:25.736094  3645 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
W20260709 13:16:25.771077 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 68804.7us
I20260709 13:16:25.735486  3650 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.775478  3647 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.776463  3650 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.779623  3647 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.780068  3409 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:25.780189  3647 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.751853  3494 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:25.784056 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.784260  3494 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:25.785252  3647 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.760344  3594 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.789579 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:25.790899 30956 raft_consensus.cc:2376] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13. Re-sending same reply.
I20260709 13:16:25.793949  3160 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:25.796108  3513 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.796491 31599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1292) took 1399 ms. Trace:
I20260709 13:16:25.797096 31599 rpcz_store.cc:276] 0709 13:16:24.396957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.397963 (+  1006us) service_pool.cc:224] Handling call
0709 13:16:24.417672 (+ 19709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.599710 (+182038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.796123 (+1196413us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54005d3254. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:25.796405 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416552832}
I20260709 13:16:25.780588  3409 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:25.730695  3663 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.773037  3645 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:25.851933 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.839332  3409 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:25.859589 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:25.868846 30924 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:16:25.856505  3667 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:16:25.856518  3665 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:25.876362 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:25.879163 30878 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:25.880357 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:25.880981 30882 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:25.881799 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:25.882608 30874 raft_consensus.cc:2410] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:16:25.883900  3364 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.886125  3518 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.887796 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:25.873304  3647 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:25.889514  3595 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.893983 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:25.879032 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:25.896358 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:25.895341 30883 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
W20260709 13:16:25.872892 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 114487us
I20260709 13:16:25.903640 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:25.908821 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:25.912374 30924 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:25.898259  3595 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:25.898342  3644 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:25.893479  3587 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:25.851706  3154 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.874797  3559 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:25.867025  3448 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:25.906994  3657 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:25.905936  3518 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:25.931537 30876 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:25.875857  3617 consensus_queue.cc:1059] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:16:25.901679  3647 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:16:25.939095  3364 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:25.949131  3518 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.958626  3364 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.986101  3691 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:25.940467  3595 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.988685  3364 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:25.996474  3595 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.930138  3584 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.992316  3645 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.945045  3644 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:26.012197 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:26.012827 31029 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.013120  3644 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.947914  3587 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:25.968888  3518 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.015297  3587 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.017226  3645 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:25.999689  3643 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.002928  3662 raft_consensus.cc:3055] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:16:26.003870  3685 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:16:26.004591  3675 log.cc:927] Time spent T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:16:26.008481 31596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54194 (request call id 1274) took 1740 ms (client timeout 2309 ms). Trace:
I20260709 13:16:26.008246  3657 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.009584  3663 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.011113  3448 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:25.964159  3154 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:26.032521 31596 rpcz_store.cc:269] 0709 13:16:24.267957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.268268 (+   311us) service_pool.cc:224] Handling call
0709 13:16:26.008285 (+1740017us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540014f0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:26.008398 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565509376}
W20260709 13:16:26.044205 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.057726 31029 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:26.026072  3643 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.024669  3662 raft_consensus.cc:740] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.021764  3494 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.080817  3662 consensus_queue.cc:260] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.082216  3662 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.063062  3617 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.019757  3409 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:26.062884  3364 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.083472  3494 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.111375  3364 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.113799 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:26.114473 30874 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.118924 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.119583 31596 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:26.124782 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.133666 31596 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:26.135126  3649 raft_consensus.cc:993] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:26.135319 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:26.135622  3223 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:26.136862  3649 raft_consensus.cc:1081] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:26.137756 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.138530  3587 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.138737  3394 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:26.139137  3658 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.139266  3587 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:26.102979  3617 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.142287  3691 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.144343 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:26.146173 30958 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:26.144521 30880 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:26.148051 30874 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
W20260709 13:16:26.149418  3634 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 1.198s	user 0.005s	sys 0.000s
I20260709 13:16:26.164660 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:26.165894 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.149657  3409 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:26.150995 30950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:44258
I20260709 13:16:26.167085 30950 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.167352 30950 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:26.152616 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 249042us
I20260709 13:16:26.152449  3518 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.168860 31025 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:16:26.169831 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.153640 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1300) took 1663 ms. Trace:
I20260709 13:16:26.170441 30882 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:26.139693  3658 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:26.170764 31603 rpcz_store.cc:276] 0709 13:16:24.489920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.646932 (+157012us) service_pool.cc:224] Handling call
0709 13:16:24.647197 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.136756 (+489559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.153356 (+1016600us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400541354. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:26.153575 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100049792}
I20260709 13:16:26.159659 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1433) took 2042 ms. Trace:
I20260709 13:16:26.171710 31601 rpcz_store.cc:276] 0709 13:16:24.116807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.117399 (+   592us) service_pool.cc:224] Handling call
0709 13:16:26.147921 (+2030522us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400323a54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:26.159597 (+ 11676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3428738816}
I20260709 13:16:26.172453 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.169860  3518 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.171301 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:26.173457 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.173624 30882 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.152967  3656 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.175451 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:26.175969  3658 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:26.176247 31030 raft_consensus.cc:1240] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:26.162643 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:26.142800  3394 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.177409 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.178653 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:26.179116 30878 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:16:26.181233 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.181550 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:26.181798 31603 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:26.183403  3617 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.172057 30880 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:26.159386  3295 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:16:26.184077 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.184554  3535 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.185091 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.185179  3535 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.185772  3562 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.187322  3535 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.177583  3394 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:26.164911  3691 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.188455  3394 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.189287 30882 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:26.189631  3394 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.189844  3691 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.168745 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:26.190507 31603 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 17.
I20260709 13:16:26.190727 30951 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:26.184608 31599 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.192605 30878 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 17.
I20260709 13:16:26.193302 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.194075 30958 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:26.201640 31603 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:26.239491 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:26.386461 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.300519 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.239161 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.257002 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:26.284826 31030 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:26.322962 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.302066 30951 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:26.282648 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.389127 31600 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:26.389858  3602 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.264076 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.325069 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.391465  3651 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.403985  3602 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.404695  3651 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.407344  3651 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:26.394125  3692 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:16:26.393998 31026 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:26.395874  3664 consensus_queue.cc:1059] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:26.263824  3448 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:16:26.412449  3663 raft_consensus.cc:3055] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:26.412958  3663 raft_consensus.cc:740] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:26.261538  3644 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.153s
I20260709 13:16:26.414037  3448 consensus_queue.cc:1243] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:16:26.414700  3646 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:26.415299  3650 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:26.314764  3417 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.416584  3417 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.417292  3448 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:26.417627  3417 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.256457  3535 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.419024  3417 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.198068  3154 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.420598  3154 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:26.421191 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.421427  3509 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:26.421818  3509 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:26.422590  3509 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.423399  3154 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:26.263422 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 62629.4us
I20260709 13:16:26.239090 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:26.429378 31029 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.429733 30996 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:26.329210 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:26.433290 30955 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:26.241348 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:26.322294 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.202620 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:26.436342 30958 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:26.436499 31605 raft_consensus.cc:2393] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:26.324867 30957 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:26.215807 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.350136 31599 raft_consensus.cc:2468] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:26.251166 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 83222.4us
I20260709 13:16:26.440559 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.441334 30874 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:26.442158 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.442808 30874 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:26.217957 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.215168 31570 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:26.443732  3336 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:26.444146 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:26.444283 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 229229us
I20260709 13:16:26.443681 30874 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:26.446007  3622 raft_consensus.cc:2804] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:26.446676  3622 raft_consensus.cc:697] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:26.446936  3648 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:26.447921 30952 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:26.450714  3590 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:26.454133 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:26.454326  3336 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:26.455659  3336 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:26.457639 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.458580 30883 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:26.459177 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.454171 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:26.347457 30950 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.407615  3602 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.458005  3364 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:26.462190 30949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 1055) took 1381 ms (client timeout 1731 ms). Trace:
I20260709 13:16:26.462334  3364 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.462724 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.463187  3364 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:26.462601 30949 rpcz_store.cc:269] 0709 13:16:25.081262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.081424 (+   162us) service_pool.cc:224] Handling call
0709 13:16:26.461999 (+1380575us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b54002b7d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:26.462115 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166813568}
I20260709 13:16:26.467435 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.469831 30922 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:26.314550  3184 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.294529  3645 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:16:26.295553 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:26.322822 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.424610 30951 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:26.426779 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.437554 31032 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:26.403275 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.460736 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.458536 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:26.320658  3687 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.245s	user 0.000s	sys 0.003s
I20260709 13:16:26.324084 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.471107 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.574923 31598 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:16:26.575309 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.471410 30878 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 13. Ops: []
I20260709 13:16:26.400714 31028 raft_consensus.cc:2368] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 16. Current term is 17.
I20260709 13:16:26.472108 30882 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:26.423714  3509 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.577950  3651 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:26.578457  3651 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:26.478966 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:26.579276  3651 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.479612 30950 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.480801 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.581199 31600 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:26.486817 31029 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:26.470814  3602 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:26.498420  3697 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:16:26.500792 30876 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:26.447887  3622 consensus_queue.cc:237] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.476532  3184 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:26.586701  3184 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.587695  3184 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.588577 31599 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:16:26.504464  3691 consensus_queue.cc:1059] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:26.505077  3658 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:26.475044  3617 consensus_queue.cc:1059] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:16:26.506001 30958 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 11. Current term is 13. Ops: []
I20260709 13:16:26.506989 31596 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:26.507103 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:26.607429 31604 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:26.607878 31604 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:26.489830 31571 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.510624 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:26.513720 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 73771.6us
I20260709 13:16:26.475392  3364 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.533505 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:26.533527  3559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.018s
I20260709 13:16:26.531669  3151 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.615005 31604 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:26.569748 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 111277us
W20260709 13:16:26.563722 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 268222us
I20260709 13:16:26.591249 31601 raft_consensus.cc:2368] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 16. Current term is 17.
I20260709 13:16:26.620044 31604 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.591424 30847 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:26.592209 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.595960 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.622260 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.620610 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:26.605252 31599 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:26.612546 30997 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:26.613382 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 123625us
I20260709 13:16:26.624701 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:26.625159 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:26.614866 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 81454.1us
I20260709 13:16:26.622025  3417 raft_consensus.cc:3055] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:26.626407  3417 raft_consensus.cc:740] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.627343  3417 consensus_queue.cc:260] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.628647  3417 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.629714  3151 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.596186  3394 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:26.631960  3394 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.632018  3151 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.632488  3394 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:26.632653  3617 raft_consensus.cc:3055] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:16:26.617342  3559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.000s	sys 0.019s
I20260709 13:16:26.633100  3617 raft_consensus.cc:740] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.633332  3559 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.634057  3617 consensus_queue.cc:260] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.634222  3559 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:26.635262  3617 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.636828 31601 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:26.603128  3611 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.626112 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.518810  3673 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:26.596403  3409 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:26.638931 31032 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:26.639484 30997 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.613852 30877 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.641871 30996 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:26.646006 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.647346 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.648010 31599 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:26.651288 30848 leader_election.cc:400] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 16. Current term is 17.
I20260709 13:16:26.651752 30848 leader_election.cc:403] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.617913  3622 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.619174  3590 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:26.644784  3409 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.662228 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:26.663939  3694 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
I20260709 13:16:26.664269  3680 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.664749  3680 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:26.665694  3680 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.666235  3505 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 16. Current term is 17.
I20260709 13:16:26.667014  3505 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:26.667171  3680 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.667419  3505 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.667896  3505 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:26.668286  3573 raft_consensus.cc:2804] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:26.668879  3573 raft_consensus.cc:697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:26.662122  3647 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:26.669724  3573 consensus_queue.cc:237] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.661474 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1972) took 1103 ms. Trace:
I20260709 13:16:26.621132  3653 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.673333 30953 rpcz_store.cc:276] 0709 13:16:25.557974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.576181 (+ 18207us) service_pool.cc:224] Handling call
0709 13:16:26.661287 (+1085106us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540008cfd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:26.661403 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334955264}
I20260709 13:16:26.658421 30924 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:26.661958  3409 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.675287 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.677034 31604 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:26.640749  3646 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:26.662181  3160 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.659178  3587 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:16:26.672755  3590 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:26.685854  3590 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.669726  3647 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.644469  3260 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:26.688460 30958 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:26.688597  3647 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.689947  3647 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.691802  3223 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:26.692726  3054 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:26.693240  3054 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:26.694285  3054 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.679476 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:26.696018 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.681082 31571 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.656236  3578 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.682313  3471 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:26.645273  3644 raft_consensus.cc:2764] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:26.682786  3702 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:26.683830  3649 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:26.684005  3653 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.684228  3648 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:26.640960  3658 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.684877  3646 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:26.718844 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:26.719461 31029 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.707520 30922 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:26.681145 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.720592 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:26.656461  3611 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.681788 30781 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:26.680112 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:26.703127 30877 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:26.695552  3054 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:26.706271 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:26.700327  3260 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.705636  3676 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:16:26.723191 31597 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:26.728102 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.730458 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.731421 30880 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:26.653688  3151 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:16:26.774248 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 53731.3us
I20260709 13:16:26.731009  3647 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:26.773042 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.708122  3223 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:26.777338 31598 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:26.778189 30879 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:26.781397 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:26.725060  3646 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:26.782979 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 131802us
I20260709 13:16:26.783988 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.716804  3336 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.784052  3663 consensus_queue.cc:260] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:26.812177 31029 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:26.739838  3260 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:26.791361 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 111330us
I20260709 13:16:26.793850  3578 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.795403  3653 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.798062  3651 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:26.801368  3643 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:26.724535  3664 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:26.724916  3518 consensus_queue.cc:1059] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:16:26.730064  3702 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.813625 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:26.786819 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 63039.3us
W20260709 13:16:26.835371 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 129157us
W20260709 13:16:26.820353 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 229035us
I20260709 13:16:26.820869 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:26.784222  3662 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:26.776114  3647 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.804387 30848 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:26.806936  3295 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:26.836205 31604 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:26.836771 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.808573  3680 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:16:26.836306 30847 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:26.776655  3505 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.830353  3651 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.838137 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:26.852746 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.861788 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.818333  3673 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:26.850363  3587 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:26.856030 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:26.857167 31032 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:26.867969  3702 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.864281  3712 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:26.839119  3647 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.852471  3663 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:26.840185  3295 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.872975 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:26.855365  3336 raft_consensus.cc:3055] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:26.885143 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 103887us
I20260709 13:16:26.898962 31602 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:26.866088  3651 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:26.857522  3662 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.865167  3509 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.903959 31023 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:16:26.900484  3707 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:26.894330  3295 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:26.914278 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:26.893345  3673 consensus_queue.cc:1243] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:26.836910  3664 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.899322  3414 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:26.925132 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.896235  3336 raft_consensus.cc:740] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:26.903908  3719 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:26.934566 31024 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:26.951269 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.952149 31024 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:26.954787 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:26.857640  3658 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.955438 31027 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:26.951411  3505 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:26.904493  3409 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:26.962281  3679 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:26.962704  3611 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:26.963284  3709 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:16:26.965987  3711 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:26.971378  3662 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.972199  3336 consensus_queue.cc:260] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.973217  3664 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.017202 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.018846 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:26.987494 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 180677us
I20260709 13:16:26.938009  3719 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:26.923166  3160 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:27.029290 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.030208 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:26.921793  3509 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:26.996232 31027 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:27.001284 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.002681 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.004292 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.005642 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:27.036892  3535 consensus_meta.cc:287] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.618s	user 0.003s	sys 0.007s
I20260709 13:16:27.029026  3719 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.037388  3535 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.039921  3509 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:27.040410 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.040769 30957 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:16:27.040989  3336 raft_consensus.cc:3060] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.041232 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.041711 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.042423 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:27.042766 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.044549 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.045302 31027 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:27.046072 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.047060 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.047986  3722 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.048208 30958 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:27.048746  3722 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:27.049256  3722 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:27.049568  3622 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.050099  3722 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.051306  3394 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.053381  3394 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.030097 31024 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:27.059691 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.025377 31032 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:27.019345  3711 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.035243 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.061055 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.026705 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.061496 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.062858 31031 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.062572 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.063648 30953 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 11: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:27.063560 31025 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:16:27.030874 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 157915us
I20260709 13:16:27.070677 31023 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.070906 30956 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:27.071875 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.072284 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.072515 31025 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:27.073268 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.075150 31024 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.075708 30923 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:27.077358 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 60215.4us
W20260709 13:16:27.078042 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 43815.6us
I20260709 13:16:27.081482 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.083568 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:27.087610 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 307718us
I20260709 13:16:27.082080 31025 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:16:27.096380 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 142069us
I20260709 13:16:27.105168 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.106241 31030 raft_consensus.cc:1240] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:16:27.106598 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.107146 31597 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:27.110440 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.079975  3622 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.111663 31570 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.080667  3417 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:27.080492  3587 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:27.116690  3559 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:27.118000  3658 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.994207  3679 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:27.119163  3717 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:16:27.120363 30953 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:27.072060  3364 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:16:27.086369  3509 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.130738  3611 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.130987  3518 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:27.132880  3703 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.560s	user 0.004s	sys 0.000s
I20260709 13:16:27.134369  3681 raft_consensus.cc:3055] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:27.138001  3409 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:27.138484  3693 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:27.080295  3646 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.140013  3651 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:27.141170 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.158102 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46623.1us
W20260709 13:16:27.158160 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53064.8us
I20260709 13:16:27.159195  3559 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.196161 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:27.160857  3573 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:27.161305  3739 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.175401 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.189497 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.190013 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.190690 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.203455 30949 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.204697 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.206183 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.199788 30876 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.209312 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.209378 30956 raft_consensus.cc:1240] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:16:27.201053 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.211993 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.213526 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.183933  3681 raft_consensus.cc:740] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:27.161362  3658 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.192432  3611 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.222178 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.222965 31027 raft_consensus.cc:2368] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16.
I20260709 13:16:27.202627  3559 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:27.234817 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.215349  3509 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.245396 30876 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:27.247906 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.248564 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.249924 30998 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:27.250242 30949 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:27.209683  3679 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.224251  3409 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:27.270727 30951 raft_consensus.cc:2410] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:16:27.272027 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.273320  3651 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.273522  3658 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.274120  3658 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.267920  3721 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.277990  3711 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.278054  3721 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:27.278687  3721 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.279453  3666 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:27.280074 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.277462  3724 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.280930 31596 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:16:27.264751  3295 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:27.281791  3590 consensus_meta.cc:287] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
I20260709 13:16:27.254637  3726 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.282238  3590 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.283126  3295 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:27.279546  3054 consensus_meta.cc:287] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.003s
I20260709 13:16:27.282953  3650 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.261034  3646 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:27.280884  3617 consensus_meta.cc:287] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.003s
I20260709 13:16:27.255097  3223 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.292464 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:27.257997  3737 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.293330 31596 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:27.289562 30880 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:16:27.294299 30880 pending_rounds.cc:85] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 10
I20260709 13:16:27.294613 30880 pending_rounds.cc:107] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:16:27.294898 30880 raft_consensus.cc:2889] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.277678  3714 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:16:27.268126  3336 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.300900  3590 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.256608  3578 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:16:27.292459  3414 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:27.312570  3414 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.223006  3587 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.321771 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.323511 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:27.323927 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 257879us
I20260709 13:16:27.324072 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.324641 30949 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.324753 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.325084 30847 leader_election.cc:400] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 16. Current term is 17.
I20260709 13:16:27.325927 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.327186  3736 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:27.339690  3718 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 13:16:27.284171  3471 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:16:27.340193  3737 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:27.330269 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.341180  3737 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.300072 30953 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:27.321883  3394 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.324270 30875 raft_consensus.cc:2368] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13.
W20260709 13:16:27.333112 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.249780  3611 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.311081 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:27.335198 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 127737us
I20260709 13:16:27.351564 30949 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:27.352577 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.353855 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.344365 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.370538 30924 leader_election.cc:400] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13.
I20260709 13:16:27.370900 30924 leader_election.cc:403] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:16:27.366631 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:27.364105 30876 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:27.368952 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.380605 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.264127  3719 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.381780 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.214402  3739 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.280095  3666 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.384982 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:27.391021  3260 consensus_meta.cc:287] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.007s
I20260709 13:16:27.384060 31597 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:16:27.378717  3160 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.362962  3673 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.396026 31597 pending_rounds.cc:85] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 9
I20260709 13:16:27.363157  3417 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:27.362689  3223 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:27.394958 31600 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.387310  3648 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.384615  3336 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.398885  3720 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:16:27.399912  3750 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13.
I20260709 13:16:27.363087  3647 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.397989 31031 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:27.385361  3676 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.405872 31597 pending_rounds.cc:107] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:27.420611 31597 raft_consensus.cc:2889] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:27.406605 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 156737us
I20260709 13:16:27.403203  3724 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.403996 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.362208  3394 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.388104  3726 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:27.289573  3681 consensus_queue.cc:260] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.422915 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:27.384703  3573 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:16:27.407516 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 159674us
I20260709 13:16:27.420331  3154 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.431488  3666 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.432768  3719 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.433561  3739 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.433756  3559 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.434665 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.421252  3648 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:27.438771 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68609.1us
I20260709 13:16:27.483410  3648 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.483996 31570 leader_election.cc:400] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16.
I20260709 13:16:27.484368 31570 leader_election.cc:403] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:27.455147  3587 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:27.485059  3587 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.440352  3509 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:27.486703  3509 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:16:27.487064  3587 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.418669  3223 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.446695 30958 raft_consensus.cc:2393] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:27.491192 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.492096 30955 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:27.448446  3737 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.404755  3260 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.422590  3336 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.463088 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:27.449393  3409 consensus_queue.cc:1059] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:27.484266  3184 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.512264  3260 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:27.496639 30881 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:27.498003  3559 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.512883  3336 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.499475 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:27.513717 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.513664  3737 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.514516 30881 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:27.515617 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:27.515935  3737 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:27.516480  3223 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:27.516999  3584 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.517483  3584 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.517735 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:27.519052  3394 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.519403  3584 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.520130 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.520408 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.517781 31604 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:27.453878 30883 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:27.526014 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.501155 31600 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:27.504268 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.507757 30949 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:27.509799 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.511986  3184 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.462054  3712 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.527905 30877 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
W20260709 13:16:27.529598 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 125679us
I20260709 13:16:27.532140  3584 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.537652 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:27.539718 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.540161 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.541695  3737 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:16:27.549328 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.549978 31032 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:27.551470 31032 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:27.553151 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.553623 30883 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:27.553874 31032 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:27.550976 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:27.450394  3726 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.556361 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.542672  3336 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.570333 30956 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:16:27.565526 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.571817 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.572685 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.573279 31603 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:27.567638 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.568296 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.506166  3648 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:16:27.569094 31027 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:27.574277 31023 raft_consensus.cc:2410] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:16:27.576478 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.574656 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:27.544306  3761 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.553849  3646 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:27.585361 30875 raft_consensus.cc:1240] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:27.583600 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.586108 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.588590 31027 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.586733 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.589562 31029 raft_consensus.cc:1240] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:27.591457 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.555702  3584 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:27.595350  3712 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:27.603138  3712 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.603492  3712 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:27.604809 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.604635  3505 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:27.606559  3505 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:27.607407  3505 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:27.608518 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.608969  3505 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:27.609742 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.610152  3505 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.569828  3336 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.617509 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.596765 31029 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:27.618124 30956 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:27.581717  3578 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:27.628069 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.612632  3505 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:27.619730  3336 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.601382  3573 consensus_queue.cc:1059] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:16:27.581429  3644 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:16:27.656574 30875 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:27.626081  3587 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.650563  3184 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:27.652179  3757 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.652632  3731 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:27.615525  3260 consensus_queue.cc:1059] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:16:27.613999  3223 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:16:27.671394  3740 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:27.672786  3584 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.578388  3394 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:16:27.662843 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:26.780514 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.676896 30956 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:27.678314 30956 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:16:27.679922  3740 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:27.680949 30956 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:27.680786  3740 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.684940  3762 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:27.685617  3762 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:27.688634  3715 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.849s	user 0.002s	sys 0.001s
I20260709 13:16:27.688377  3721 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.690467  3721 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.696669 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2383) took 1525 ms. Trace:
I20260709 13:16:27.668910  3587 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.697150 30954 rpcz_store.cc:276] 0709 13:16:26.171185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.175243 (+  4058us) service_pool.cc:224] Handling call
0709 13:16:27.696468 (+1521225us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400112954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:27.696607 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100915584}
I20260709 13:16:27.698763  3587 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.700176 31028 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:27.703394 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.704258 30875 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:27.705569 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.706187 31603 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:27.706290 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.707047 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.707784 31027 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:27.709475 31023 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:27.712940 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.714706 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.715404 30954 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:27.666046  3757 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.720108 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:27.665668  3646 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:16:27.716585  3711 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:27.720928  3757 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.748646  3622 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:27.749094  3622 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:27.749866  3622 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.755224  3617 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:27.757189  3617 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:27.755483 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 190034us
I20260709 13:16:27.759821 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.760555  3611 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:27.761343  3417 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:27.761611  3671 consensus_queue.cc:1059] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:27.762468  3671 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:27.762827  3671 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:27.765784  3647 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.769205  3578 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:27.770208  3578 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.770994  3645 raft_consensus.cc:3055] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:27.771380  3645 raft_consensus.cc:740] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:27.772017  3471 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:27.772470  3471 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:27.772159  3645 consensus_queue.cc:260] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.773387  3645 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:27.773300  3471 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.774358 31571 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:27.762490 30923 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:27.778555 31029 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:27.786350 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:27.787199 30957 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:27.777582 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:27.776932 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.788820 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:27.792687 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:27.747466  3681 raft_consensus.cc:3060] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:27.803874 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:27.751504  3509 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16.
I20260709 13:16:27.824445 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:27.825450 30997 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:27.824707 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.804502 30880 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.824688 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:27.790381 31603 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:27.802327 31599 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.805624 31029 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:27.828646 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.829257 31598 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:27.831380 31597 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:27.834338 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:27.828780 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:27.729583  3711 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.843255 30882 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:27.804351  3471 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:27.790356  3559 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.849709 31599 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:27.855429 31596 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:27.802870  3714 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:27.804744  3184 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:27.830770  3417 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:27.885398 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.888293 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:27.837137  3587 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:27.930575 31030 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.895534  3054 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:27.891201  3559 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.763612  3671 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:27.838399  3761 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:27.848804  3583 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.867245  3562 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.852994  3656 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:27.902829 31029 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:27.853936 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:27.838723  3223 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:16:27.852504  3611 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:16:27.876058  3769 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:27.909507  3772 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:16:27.910406  3766 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:16:27.911664  3768 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:16:27.913033  3711 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:27.790081  3590 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:27.921489 30880 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:27.868068  3710 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:16:27.924301 30952 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:27.875922  3739 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:16:27.843230  3414 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:27.985560 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 100243us
I20260709 13:16:28.000659 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:27.925436  3648 raft_consensus.cc:2764] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:27.972740  3587 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.994004 31030 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:27.978066  3656 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.934911  3184 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:27.991027  3611 consensus_queue.cc:1243] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:27.929790  3714 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.003134 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 118623us
I20260709 13:16:27.990778  3671 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:27.987102  3223 consensus_queue.cc:1243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:16:27.986789  3769 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.008487  3773 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:28.008911  3721 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:28.009919  3770 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:16:28.010692  3776 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:28.014041  3184 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.025565 31602 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:28.017647 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:27.998260  3578 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:27.980875  3562 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.006850  3587 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.006631  3656 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:28.021081  3713 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.160s	user 0.000s	sys 0.004s
I20260709 13:16:28.033519  3562 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.020274  3611 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:28.019546  3505 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.044981  3505 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.047691 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.048753  3559 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:28.030154  3759 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.581s	user 0.003s	sys 0.000s
I20260709 13:16:28.021183  3769 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.001667  3590 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.026404  3776 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:28.089759  3777 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:28.063201  3414 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:28.104501 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.096818  3414 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.026014  3761 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.104221  3736 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:28.111591  3414 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.126531 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:28.127231 30882 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:28.128629 30880 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:28.099923  3777 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.144809  3712 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.519s	user 0.018s	sys 0.000s
I20260709 13:16:28.132974  3776 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:28.155984  3777 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.157593  3785 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.158506 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.193805 31029 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:28.133497  3736 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.161474 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:28.195986 31599 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:28.197117 31599 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:16:28.153559  3782 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:16:28.166102 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:28.172492 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:28.174628  3649 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:28.179119 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.212067 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.212881 30953 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:28.214249 30957 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:28.184260  3776 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.236430 31598 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:28.184679  3653 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:28.186299 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:28.244069 31596 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.245389  3736 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.187079  3622 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.247483 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 1085) took 1194 ms. Trace:
I20260709 13:16:28.247869 30958 rpcz_store.cc:276] 0709 13:16:27.052695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.060830 (+  8135us) service_pool.cc:224] Handling call
0709 13:16:28.247287 (+1186457us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540008c0d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:28.247427 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882768768}
I20260709 13:16:28.250027 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.203150 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:28.252372 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 49300us
I20260709 13:16:28.252771  3448 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.253403  3448 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:28.242628 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.255609 30956 raft_consensus.cc:2393] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 11: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:28.256079  3662 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:28.256484  3662 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.256572  3762 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.256871  3662 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.243340  3653 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:28.259097  3653 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.260411 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 281080us
I20260709 13:16:28.260270  3653 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.261998 30923 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:28.263230  3295 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:28.264670  3295 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:28.265168  3295 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:28.266147  3295 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.214941  3785 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:28.275424  3785 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.205811  3721 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.312536  3721 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.312722  3414 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.314608  3721 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.206382  3780 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:28.314909  3414 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.315521  3414 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:28.215941 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.347915  3414 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:28.348085 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 132262us
I20260709 13:16:28.348440  3662 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.350348  3721 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.350771  3721 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:28.351154  3721 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:28.217382  3708 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.504s	user 0.000s	sys 0.005s
I20260709 13:16:28.210759  3364 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 13:16:28.218762 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 46382.1us
I20260709 13:16:28.354300 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2342) took 1916 ms. Trace:
I20260709 13:16:28.219496  3724 raft_consensus.cc:2764] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:16:28.219849  3649 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:28.223358  3417 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:28.225812  3720 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.226584 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 372738us
I20260709 13:16:28.354651 31026 rpcz_store.cc:276] 0709 13:16:26.437770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.461435 (+ 23665us) service_pool.cc:224] Handling call
0709 13:16:26.487463 (+ 26028us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:26.519006 (+ 31543us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:26.534226 (+ 15220us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.832752 (+298526us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:26.838058 (+  5306us) log.cc:844] Serialized 78 byte log entry
0709 13:16:26.838200 (+   142us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:26.838419 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.021159 (+182740us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.022270 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.022379 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.216817 (+1194438us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:28.354099 (+137282us) raft_consensus.cc:1685] finished
0709 13:16:28.354119 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.354243 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151671,"prepare.queue_time_us":76379,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":103,"raft.queue_time_us":120389,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":27129,"spinlock_wait_cycles":14845824,"thread_start_us":377727,"threads_started":3,"wal-append.queue_time_us":167367}
I20260709 13:16:28.150321  3336 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.233248 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:28.367354 30876 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:28.241588 30880 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:16:28.242215 30953 raft_consensus.cc:1240] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:16:28.243475 30949 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:16:28.368824 30949 pending_rounds.cc:85] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 7
I20260709 13:16:28.369179 30949 pending_rounds.cc:107] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:16:28.369451 30949 raft_consensus.cc:2889] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.370800 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.276043  3151 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:28.277026  3394 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:28.279301  3726 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.280622  3505 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.281440  3774 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:28.282251  3409 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:28.284966 30875 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:16:28.288501 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 1976) took 1286 ms (client timeout 1644 ms). Trace:
I20260709 13:16:28.291566  3679 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:28.292310 30950 raft_consensus.cc:1275] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:16:28.415380 30950 pending_rounds.cc:85] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 11
I20260709 13:16:28.415720 30950 pending_rounds.cc:107] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:16:28.416026 30950 raft_consensus.cc:2889] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.181382  3712 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.226003  3750 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:28.419031  3750 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:28.421706  3750 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.422565 30883 raft_consensus.cc:2393] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:28.153677  3714 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:28.306417 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.308072 31023 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:28.308852  3769 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.310062  3757 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.007s
I20260709 13:16:28.310951  3590 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.311532  3656 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:28.210711 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.325946 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.429337 31024 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:28.331686 30957 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:28.430778 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:28.431357 30957 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.325243 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.243381 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:28.336833 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.337172 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:28.436255 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 192945us
I20260709 13:16:28.437155 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:28.437563  3583 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:28.437764 31602 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.438001  3583 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:28.438410  3583 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:28.320791  3587 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.338332 31599 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:28.332521 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:28.440227 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.339061 31596 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:28.440878 31025 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:28.340736 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:28.441469 31599 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:16:28.441810 31600 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:28.342353 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.442564 31599 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:28.344030 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:28.330864 30955 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:28.442992 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.340369 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:28.364498  3364 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:28.365129 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:28.444809 30881 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.364905  3417 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:28.365821  3720 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.373035 30949 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:28.332013  3681 consensus_meta.cc:287] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.502s	user 0.015s	sys 0.000s
I20260709 13:16:28.387714 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.426728 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:28.456612 30874 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
W20260709 13:16:28.414446 30951 rpcz_store.cc:269] 0709 13:16:27.002296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.002445 (+   149us) service_pool.cc:224] Handling call
0709 13:16:28.288320 (+1285875us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002904d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:28.288445 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533746944}
I20260709 13:16:28.429344 30952 raft_consensus.cc:2368] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
I20260709 13:16:28.315836 30781 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 10 to 11, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.436313 30958 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:28.349124  3414 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:28.443723 31597 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:28.464640 31026 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:16:28.379925  3394 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:28.445628 31024 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:28.466073 30953 raft_consensus.cc:2368] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16.
I20260709 13:16:28.446947 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.450675 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:28.451920 31598 raft_consensus.cc:2368] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16.
I20260709 13:16:28.442808 30954 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:28.467268 31570 leader_election.cc:400] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
W20260709 13:16:28.453313 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 120867us
I20260709 13:16:28.467574 31570 leader_election.cc:403] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:28.469835 31571 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:28.386608  3774 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:28.409838  3671 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.471915 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:28.472576 31032 raft_consensus.cc:1275] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:28.473357 31029 raft_consensus.cc:2368] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12.
I20260709 13:16:28.411475  3622 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.466645 31028 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:28.463534 30951 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:28.476665 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:28.480485 30880 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:28.482082 30957 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:28.484222 31031 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:28.427995  3679 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:28.478523 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:28.488438 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.466441  3590 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:28.502285 30878 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:28.501475 31602 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:28.472890  3448 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.477130  3648 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:28.476815  3611 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:28.476960  3471 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.515002 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.529517 31026 raft_consensus.cc:2393] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:28.503633 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:28.530567 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 175966us
W20260709 13:16:28.522203 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 43751.1us
I20260709 13:16:28.472637  3740 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:16:28.534030 30781 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 5 to 6, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 6 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.446283  3757 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.537179 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.506261  3617 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:28.472527  3505 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:16:28.474740  3154 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:16:28.523459  3774 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.490522  3671 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.519418 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:28.493481  3622 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.543686 30848 leader_election.cc:400] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16.
I20260709 13:16:28.528276  3762 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:28.488368  3650 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:16:28.551020 30848 leader_election.cc:403] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:28.521111  3648 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:28.548463 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:28.554083 30883 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.554193 30848 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.549573 31600 raft_consensus.cc:2393] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:28.550675 31601 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:28.453678  3649 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.543345  3617 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:28.559376 30881 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:28.545372  3736 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:28.566397 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.531819  3448 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.556663  3648 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.544246  3785 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:16:28.594062 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:28.622917 30955 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.553459  3762 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.604823  3622 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:28.608040  3448 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:28.609826  3790 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:28.563648  3336 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.614147 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.673098 30957 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
W20260709 13:16:28.616904  3789 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:28.618176  3471 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
W20260709 13:16:28.620447  3792 log.cc:927] Time spent T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:28.558545  3774 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:28.592298  3602 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:28.563934  3518 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.575404  3617 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:28.576375  3780 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:28.575274  3710 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16.
I20260709 13:16:28.574998  3509 consensus_queue.cc:1059] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:16:28.575968  3736 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:28.546972  3394 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.546592  3679 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.624468  3762 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:28.697280  3791 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:16:28.635555  3714 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.709004  3587 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:28.716337 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.715190  3736 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:28.714946  3780 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:28.748543  3780 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.714710  3509 consensus_queue.cc:1243] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:28.710187  3602 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:28.709702  3518 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.715554  3787 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:28.686434  3622 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.735533 30955 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:28.727139  3583 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.729758  3794 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:16:28.715847  3656 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:28.764011 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.740249  3720 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.756695  3679 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:28.774044 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 275268us
W20260709 13:16:28.796692 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 265189us
I20260709 13:16:28.799010 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:28.754344  3714 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.799657 30874 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:16:28.802364 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 339445us
I20260709 13:16:28.807555 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:28.809633 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:28.810258 30955 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:28.811491 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:28.812215 30953 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:28.801767  3645 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:16:28.768666  3622 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.776257  3802 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:28.834589 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 1992) took 1421 ms. Trace:
I20260709 13:16:28.804241  3757 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.835124 30950 rpcz_store.cc:276] 0709 13:16:27.413007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.413244 (+   237us) service_pool.cc:224] Handling call
0709 13:16:28.291942 (+878698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.416565 (+124623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.834316 (+417751us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54002904d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:28.834508 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998328192}
W20260709 13:16:28.846628  3795 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:16:28.821472  3364 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:28.863010  3662 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.867266  3617 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:28.886824 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.894441 30874 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:28.897554 30883 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:28.815788  3509 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:16:28.902595 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 95145.7us
I20260709 13:16:28.840713  3802 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:28.909485 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:28.856243  3364 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.921773 30924 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:28.922426 30953 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:28.922875 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 125425us
I20260709 13:16:28.926385  3712 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.929525 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:28.932029 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:28.833098  3602 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.946489 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:28.933995  3364 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:28.951516  3657 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:28.955753  3810 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:28.977413  3648 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:28.978703 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.979926  3774 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.980450  3774 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.981128  3471 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.981634  3471 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.982486  3774 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:28.956429 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.983199 30781 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.985085 30781 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:28.986745 30781 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 6 to 7, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 7 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.957410  3622 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:16:28.959470  3518 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.961373 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1334) took 1182 ms. Trace:
I20260709 13:16:28.948396  3409 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:28.948688  3808 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.933583  3617 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:28.974581  3802 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.975879 31597 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:28.982405 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:29.009449 31596 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:28.989099 31600 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:28.956322  3583 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:28.990207 31602 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:28.990768 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:28.926437  3736 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:28.983590  3471 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:29.001097 31601 rpcz_store.cc:276] 0709 13:16:27.779419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.779526 (+   107us) service_pool.cc:224] Handling call
0709 13:16:27.779806 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.557836 (+778030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.961121 (+403285us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400720e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:28.961306 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772408064}
I20260709 13:16:29.002063 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.003095 30781 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 4 to 12, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 12 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:28.969820 30779 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54998 (request call id 324) took 29281 ms (client timeout 15000 ms). Trace:
I20260709 13:16:29.015690 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.016475 31599 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:29.002832  3648 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:29.034649 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 60528.5us
I20260709 13:16:29.047115 30848 leader_election.cc:400] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12.
I20260709 13:16:29.047506 30848 leader_election.cc:403] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.043136 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:29.036877 30781 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 7 to 11, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.051589  3714 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:29.009667  3336 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:29.056861  3736 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:29.034164  3721 consensus_meta.cc:287] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.004s
I20260709 13:16:29.065235 30781 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 11 to 12, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 12 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.101297 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:29.043350 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 46905.9us
I20260709 13:16:28.998610  3657 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:29.113998  3814 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:29.114691  3814 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.040663  3518 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:29.049773  3785 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12.
I20260709 13:16:29.118574 30781 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.065433 30998 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:29.140358 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 75011.7us
I20260709 13:16:29.143842 30883 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:29.030085 31600 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:29.154137 30953 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:29.009135  3808 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.158694 30781 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 9 to 10, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.059176  3409 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:29.114867  3657 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.109541  3417 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:29.058717  3336 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.165223 30781 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 10 to 11, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 11 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:29.150804  3645 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:29.171801 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:29.172008 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:29.182479 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:29.183350 31600 raft_consensus.cc:2393] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:29.173183 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.184167 31571 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:29.147876  3648 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.177753 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:29.108932  3154 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:16:29.065817  3721 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.101102  3762 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.119714  3151 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:16:29.161549  3760 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.174902 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.199441 30781 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 7 to 11, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.201212  3602 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:29.205941 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:29.209070 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.191747 31597 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:29.210031 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:29.212766 30955 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:29.215165 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.216097 30949 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 13: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:29.201370 30781 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 6 to 9, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:29.208961 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.148543  3518 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.221844  3518 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.218166 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.223088 31032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 919) took 1662 ms. Trace:
I20260709 13:16:29.224378 30781 catalog_manager.cc:5697] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 3 to 4, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 4 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:29.218860  3769 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:29.219015 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.218341 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:29.192206 31599 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:29.223489 31032 rpcz_store.cc:276] 0709 13:16:27.560696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.562938 (+  2242us) service_pool.cc:224] Handling call
0709 13:16:27.563256 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.475938 (+912682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.222861 (+746923us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54001f3e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:29.223032 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090511744}
W20260709 13:16:29.193213  3653 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.003s
I20260709 13:16:29.259217 31598 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:29.193231  3471 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.273486  3471 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.195626  3622 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:29.275671  3788 log.cc:927] Time spent T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.715s	user 0.004s	sys 0.000s
I20260709 13:16:29.276005  3622 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.276427  3622 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:29.277771  3825 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.278102  3414 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.278290  3825 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.280066 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1479) took 1118 ms. Trace:
I20260709 13:16:29.281042  3808 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.193074  3714 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:29.284329  3409 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.280452 31605 rpcz_store.cc:276] 0709 13:16:28.162069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.162703 (+   634us) service_pool.cc:224] Handling call
0709 13:16:28.162983 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.164148 (+  1165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.164177 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.164605 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:16:28.173372 (+  8767us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b48000417d8. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
0709 13:16:28.380634 (+207262us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:28.380674 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.380743 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.159428 (+778685us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:29.279848 (+120420us) raft_consensus.cc:1685] finished
0709 13:16:29.279871 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.280005 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":795,"raft.queue_time_us":903,"raft.run_cpu_time_us":1949,"raft.run_wall_time_us":8437,"spinlock_wait_cycles":19203584,"thread_start_us":214447,"threads_started":1,"wal-append.queue_time_us":342304}
I20260709 13:16:29.234562 30950 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:29.269755 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.287340 31597 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:29.287468 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:29.271757  3509 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:29.259907  3761 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.287601 30879 raft_consensus.cc:2368] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:29.288710 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.294795 31605 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:29.288872 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.296137 30952 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
I20260709 13:16:29.261231 31024 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:29.185740  3810 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:29.297505 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:29.180539  3417 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.258111  3535 raft_consensus.cc:3055] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:29.197158  3645 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:29.336824 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 190646us
W20260709 13:16:29.035583 30779 rpcz_store.cc:269] 0709 13:15:59.687983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.688782 (+   799us) service_pool.cc:224] Handling call
0709 13:16:28.969614 (+29280832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:22.557622 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:22.562090 (+  4468us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:22.562152 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:16:22.562185 (+    33us) tablet.cc:662] Decoding operations
0709 13:16:22.601762 (+ 39577us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:22.622371 (+ 20609us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:22.625253 (+  2882us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:16:22.692974 (+ 67721us) tablet.cc:701] Row locks acquired
0709 13:16:22.693018 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:16:22.693195 (+   177us) write_op.cc:270] Start()
0709 13:16:22.693338 (+   143us) write_op.cc:276] Timestamp: P: 1783602982693123 usec, L: 0
0709 13:16:22.693379 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:16:22.694018 (+   639us) log.cc:844] Serialized 5347 byte log entry
0709 13:16:23.326241 (+632223us) op_driver.cc:464] REPLICATION: finished
0709 13:16:23.616002 (+289761us) write_op.cc:301] APPLY: starting
0709 13:16:23.628150 (+ 12148us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:23.910184 (+282034us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:23.910301 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:24.097400 (+187099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:24.097779 (+   379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:16:24.097854 (+    75us) write_op.cc:312] APPLY: finished
0709 13:16:24.098270 (+   416us) log.cc:844] Serialized 121 byte log entry
0709 13:16:24.098462 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:24.098615 (+   153us) write_op.cc:454] Released schema lock
0709 13:16:24.098684 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:24.099131 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:24.099160 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4006297,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":261522,"apply.run_cpu_time_us":21437,"apply.run_wall_time_us":500199,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58493,"num_ops":13,"prepare.queue_time_us":186927,"prepare.run_cpu_time_us":34741,"prepare.run_wall_time_us":335982,"raft.queue_time_us":415667,"raft.run_cpu_time_us":8492,"raft.run_wall_time_us":257887,"replication_time_us":632674,"thread_start_us":796149,"threads_started":4,"wal-append.queue_time_us":203961,"wal-append.run_cpu_time_us":54937,"wal-append.run_wall_time_us":2218534}]]}
W20260709 13:16:29.341933  3815 log.cc:927] Time spent T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:16:29.402899 30847 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:29.342891  3814 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.344329  3762 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.299045  3769 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:29.196434  3648 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.347201  3825 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.347611  3831 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:29.338869  3662 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:29.233237  3760 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.348618  3832 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:29.349474  3649 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:29.293018  3653 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.365432 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:29.365727 31029 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:29.366169 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:29.486526 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.366241 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:29.368690 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:29.371958  3364 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.374401  3336 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.374401 30996 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:29.496286 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 121972us
I20260709 13:16:29.390561 31601 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:29.392118 31599 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:16:29.497192 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 94408.2us
I20260709 13:16:29.275729  3471 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.296860  3809 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.403228 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 173598us
I20260709 13:16:29.410087 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:29.436000 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:29.508756 31024 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.508885 30953 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:29.340013  3535 raft_consensus.cc:740] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:29.492002  3679 consensus_meta.cc:287] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
I20260709 13:16:29.487624 30883 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:29.417920  3671 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.518962 30955 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:29.497723 30848 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:29.408979  3774 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.300184  3761 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.504237 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.526422 30881 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:16:29.411684  3769 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.529639 30781 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:29.487607 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 121430us
I20260709 13:16:29.524405  3587 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:16:29.533183 31023 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:29.533329  3721 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.534780 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:29.498975  3807 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:29.504027  3663 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:29.513196  3680 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:29.517076 30924 leader_election.cc:400] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:29.409287  3646 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.520329 30953 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:29.554049 30924 leader_election.cc:403] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.553092 30781 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 7 to 8, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 8 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:29.527472 30874 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:16:29.531656 30847 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:29.515945 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.550963 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:29.549456 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:29.554633 30874 pending_rounds.cc:85] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 6
I20260709 13:16:29.559602 30874 pending_rounds.cc:107] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:16:29.559918 30874 raft_consensus.cc:2889] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:29.525239  3336 consensus_queue.cc:1059] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:16:29.559158 30847 leader_election.cc:400] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 15. Current term is 16.
I20260709 13:16:29.561744 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.573662 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.564415 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.566618 31597 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:29.574216 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:29.535166  3769 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:29.504617  3653 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.591012 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:29.542858  3807 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.599501 31596 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:29.598039 30848 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:29.606539  3650 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:29.607162  3650 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:29.608300  3650 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.613929  3825 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:29.614488  3825 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:29.547937  3644 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:29.485728  3831 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.616771 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.553841  3680 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.632879 31024 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:29.582461  3587 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:29.571502  3647 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:29.526854  3622 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.641953 31030 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:16:29.642681 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.535290  3774 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.551970  3657 consensus_queue.cc:1048] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:16:29.615015  3825 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:29.544030  3662 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:16:29.599169  3762 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:29.571142  3646 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.499331  3832 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.517971  3809 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.556072  3671 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:16:29.714879  3809 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.616096  3807 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:29.720661  3364 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:29.722149  3820 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:29.655845  3587 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:29.653153 30952 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:29.656204 31026 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
W20260709 13:16:29.692092 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 117912us
W20260709 13:16:29.708334  3819 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:29.711896  3394 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:29.713002  3653 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:29.720937  3827 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:16:29.640749  3777 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.052s	sys 0.040s
I20260709 13:16:29.637687  3417 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.635138  3716 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.736622 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:29.548516  3810 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.751986 31605 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:16:29.688184  3816 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:16:29.706525  3806 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:29.704072  3762 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.527832  3645 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.646467  3830 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.786842 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:29.636981  3680 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:29.791455 30953 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:29.798136 31601 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:16:29.756724  3777 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.053s	sys 0.041s
I20260709 13:16:29.801961 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.803403 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.840139  3835 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:29.801273  3716 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:29.801437  3710 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:16:29.841287  3622 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.841858 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.846709  3807 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:29.849280  3831 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.857215  3646 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:29.861418  3819 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:16:29.797477  3336 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:16:29.755220  3587 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:29.995520 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2335) took 1219 ms. Trace:
I20260709 13:16:29.865759  3832 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:29.867220  3671 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:29.868738 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:29.876078  3841 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:29.880024  3761 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:29.777431  3712 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.880136 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.754916  3750 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:29.881570 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:29.882349  3760 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:29.786993  3471 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.884034 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.092042 31596 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
W20260709 13:16:29.934815 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 148050us
I20260709 13:16:29.939653 30883 raft_consensus.cc:2410] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260709 13:16:29.941218 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 409546us
I20260709 13:16:29.971487 30878 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:29.973410 31604 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:16:29.908403  3762 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:29.970737  3649 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:29.937561  3830 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:29.864303  3714 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 13:16:30.001020 30882 rpcz_store.cc:276] 0709 13:16:28.775981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.776937 (+   956us) service_pool.cc:224] Handling call
0709 13:16:28.777350 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.777738 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:28.799263 (+ 21525us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.959513 (+160250us) spinlock_profiling.cc:243] Waited 956 us on lock 0x7b1800486760. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:16:29.198119 (+238606us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.202045 (+  3926us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.202197 (+   152us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:29.202230 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.202311 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.995231 (+792920us) raft_consensus.cc:1685] finished
0709 13:16:29.995335 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.995465 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55631,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":2844,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":51717,"spinlock_wait_cycles":2198784,"thread_start_us":238328,"threads_started":1,"wal-append.queue_time_us":743636}
I20260709 13:16:30.044920 30881 raft_consensus.cc:2393] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 16: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:29.972978  3778 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:16:30.046921 31028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2383) took 1123 ms. Trace:
I20260709 13:16:30.095065 31604 pending_rounds.cc:85] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 8
W20260709 13:16:30.098201 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.138702 31604 pending_rounds.cc:107] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:16:30.138996 31604 raft_consensus.cc:2889] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.093816 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:30.137036 31028 rpcz_store.cc:276] 0709 13:16:28.923481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.923856 (+   375us) service_pool.cc:224] Handling call
0709 13:16:28.924211 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.925665 (+  1454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.925693 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.926158 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.148909 (+222751us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:29.148967 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.149069 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.046700 (+897631us) raft_consensus.cc:1685] finished
0709 13:16:30.046725 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.046866 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2991,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7142,"thread_start_us":222323,"threads_started":1,"wal-append.queue_time_us":599018}
I20260709 13:16:30.150292 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.150972 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.152050 31025 raft_consensus.cc:2368] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:30.153322 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.154300 31025 raft_consensus.cc:2410] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 13:16:30.114615 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 508908us
I20260709 13:16:30.010550  3622 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:30.157310 31028 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:29.645840  3644 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:30.157433 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.158372 31025 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:30.161162 31028 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:30.161005 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.173029 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.141333  3662 consensus_queue.cc:1243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:30.148738  3681 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.150833  3714 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:30.057253  3712 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.122424  3847 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:30.160120  3414 consensus_meta.cc:287] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.005s
I20260709 13:16:30.159736  3417 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.046404  3671 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.122534  3761 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.149044  3260 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.211158  3681 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.222484  3260 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.223865  3671 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.224323  3681 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.224592  3260 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:30.225693  3836 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.693s	user 0.008s	sys 0.010s
I20260709 13:16:30.225981 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.227815  3761 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:30.228539  3769 consensus_meta.cc:287] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:16:30.228953  3769 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.196866 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.153751  3653 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.092181  3750 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.149253  3151 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.248797  3151 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.251106  3151 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.212601 30923 leader_election.cc:400] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
W20260709 13:16:30.252202 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 43496.4us
I20260709 13:16:30.253624 30923 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:30.254132  3817 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.384s	user 0.025s	sys 0.013s
I20260709 13:16:30.254551 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:30.254724  3336 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:30.255345  3336 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:30.159521  3617 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:30.256116  3617 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.236838  3417 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:30.258404  3842 log.cc:927] Time spent T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:16:30.259141  3417 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.259912  3653 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.260403 31027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2854) took 1811 ms. Trace:
I20260709 13:16:30.260753 31027 rpcz_store.cc:276] 0709 13:16:28.449191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.449306 (+   115us) service_pool.cc:224] Handling call
0709 13:16:28.449563 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.476064 (+ 26501us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:28.504432 (+ 28368us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.484485 (+980053us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b18004d0fe0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:16:29.758027 (+273542us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.788491 (+ 30464us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.788636 (+   145us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:29.788667 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.788759 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.260111 (+471352us) raft_consensus.cc:1685] finished
0709 13:16:30.260207 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.260344 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284341,"prepare.queue_time_us":28373,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":3742,"raft.queue_time_us":46769,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":29515,"spinlock_wait_cycles":8361344,"thread_start_us":267370,"threads_started":1,"wal-append.queue_time_us":1477160}
I20260709 13:16:30.103363  3471 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.220214  3760 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.262883  3760 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.263981  3471 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.264717  3716 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.266660 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.235039  3851 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.057421  3841 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.267918 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.220939 31599 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.229687 31602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1343) took 1243 ms. Trace:
I20260709 13:16:30.229907  3761 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:30.230486  3829 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.695s	user 0.008s	sys 0.020s
I20260709 13:16:30.231840  3364 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:30.234524  3830 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.220486  3774 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.177153 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.236613 31598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54208 (request call id 1488) took 1266 ms. Trace:
I20260709 13:16:30.280236 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.244726  3644 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.247581  3750 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.262042  3653 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.267287 30882 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:30.267740  3851 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.268343  3853 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:30.271173  3807 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.271627  3414 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.272385 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.184676 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.311695 31028 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:30.273025 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.268730 31602 rpcz_store.cc:276] 0709 13:16:28.986502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.036279 (+ 49777us) service_pool.cc:224] Handling call
0709 13:16:29.036706 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.041909 (+  5203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.041936 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.085801 (+ 43865us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.292320 (+206519us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:29.292386 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.292479 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.225106 (+932627us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:30.229390 (+  4284us) raft_consensus.cc:1685] finished
0709 13:16:30.229415 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.229626 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4853,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6977,"spinlock_wait_cycles":21854464,"thread_start_us":118391,"threads_started":1,"wal-append.queue_time_us":383075}
I20260709 13:16:30.258400  3617 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.281677 31600 raft_consensus.cc:2368] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 18. Current term is 19.
I20260709 13:16:30.172950  3622 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.283856 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:30.284808  3394 consensus_meta.cc:287] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:16:30.167857  3810 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:30.284538 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.287626 30998 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.288223 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.314073 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.320501 31602 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:30.280400 31598 rpcz_store.cc:276] 0709 13:16:28.970508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.973556 (+  3048us) service_pool.cc:224] Handling call
0709 13:16:30.236451 (+1262895us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400303c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:30.236556 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514899328}
I20260709 13:16:30.278000  3364 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:30.319166 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 46224.9us
I20260709 13:16:30.282810  3809 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.329345 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.284894  3716 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.275934  3417 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:16:30.332484 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.335583 31028 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 10.
I20260709 13:16:30.310521  3853 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.305290  3845 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.317116 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 223404us
I20260709 13:16:30.333755 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.218204  3847 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.337255 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.337427  3656 consensus_queue.cc:1059] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:30.338238  3841 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.337302  3853 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.339411  3671 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:30.348006  3671 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:30.348428  3671 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.348901  3847 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.332903  3737 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:30.351922  3737 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.352288  3737 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.339594  3712 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.279247  3587 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:30.341110 31570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 2.197s (SENT) [suppressed 12 similar messages]
I20260709 13:16:30.341542 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.315730  3414 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.365382 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.366251  3414 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.316972  3649 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:30.325274  3617 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:30.345619 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2423) took 1281 ms. Trace:
I20260709 13:16:30.372219 30951 rpcz_store.cc:276] 0709 13:16:29.071385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.072143 (+   758us) service_pool.cc:224] Handling call
0709 13:16:29.072575 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.073016 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.073056 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.073626 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.291231 (+217605us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:29.291290 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.291381 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.227505 (+936124us) spinlock_profiling.cc:243] Waited 7.87 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:30.340963 (+113458us) raft_consensus.cc:1685] finished
0709 13:16:30.340982 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.345529 (+  4547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13681,"spinlock_wait_cycles":18108160,"thread_start_us":138404,"threads_started":1,"wal-append.queue_time_us":293216}
I20260709 13:16:30.339926  3845 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.381857  3845 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.371222  3417 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:30.384953 31027 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 9: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:30.386965  3864 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.384471  3417 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:30.333782  3336 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:16:30.397598 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.398243 30882 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 9.
I20260709 13:16:30.393956 30881 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:30.404485  3622 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.404650 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:30.387856  3864 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.395334  3417 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.340271  3716 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.335875  3809 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.330941  3810 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.409538 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.372144  3617 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.389183  3841 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.417728 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 76639.4us
W20260709 13:16:30.423501  3857 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:30.425117  3622 consensus_queue.cc:1048] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:30.427242 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:30.427958  3643 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.439287 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.444264  3653 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.445508  3864 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.422436  3617 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:30.421885  3807 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:30.465328  3825 consensus_meta.cc:287] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.002s
I20260709 13:16:30.465976  3825 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.450477  3622 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.477437  3855 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:30.478142  3855 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:30.459120  3851 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.456729  3769 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.458961  3716 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.462560  3807 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.434499  3643 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.433507  3841 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.456822  3726 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:16:30.500365  3841 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.500749  3760 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.508848 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2392) took 1104 ms. Trace:
I20260709 13:16:30.509261 31023 rpcz_store.cc:276] 0709 13:16:29.404640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.406518 (+  1878us) service_pool.cc:224] Handling call
0709 13:16:29.481759 (+ 75241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.533586 (+ 51827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.508617 (+975031us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54000c3fd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:30.508789 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117833984}
I20260709 13:16:30.501477  3845 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.512034  3845 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.502135 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54208 (request call id 1497) took 1137 ms. Trace:
I20260709 13:16:30.513564 31605 rpcz_store.cc:276] 0709 13:16:29.364416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.366095 (+  1679us) service_pool.cc:224] Handling call
0709 13:16:29.366380 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.799350 (+432970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.501826 (+702476us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400715054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:30.502070 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881264384}
I20260709 13:16:30.514096  3845 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.514693 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.514575  3737 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.515450 31605 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:30.516273 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.460418  3653 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.502718 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1108) took 1289 ms. Trace:
I20260709 13:16:30.483047  3761 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:30.518110 30955 rpcz_store.cc:276] 0709 13:16:29.213865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.214094 (+   229us) service_pool.cc:224] Handling call
0709 13:16:29.214342 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.519514 (+305172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.502515 (+983001us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001941d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:30.502662 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700159360}
I20260709 13:16:30.536144 31571 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.479101  3855 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.540634 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:30.542778 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.543133 31604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1314) took 2187 ms. Trace:
I20260709 13:16:30.544209 31604 rpcz_store.cc:276] 0709 13:16:28.333258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.334366 (+  1108us) service_pool.cc:224] Handling call
0709 13:16:28.340993 (+  6627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.139427 (+1798434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.520842 (+381415us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54006702d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:30.521037 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3748555520}
I20260709 13:16:30.494453  3807 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:30.552371 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.557639 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.557901 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:30.545835 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.564538 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.545768  3861 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:30.568619 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:30.569402 30874 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.571362  3809 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.560149  3664 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:30.572211  3664 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.572368 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:30.573107  3863 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:16:30.573287 30880 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:30.542846  3710 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.574209 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.575110 30883 raft_consensus.cc:2410] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:16:30.574482  3710 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.576726  3760 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.577287  3760 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.579243  3760 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.579319  3810 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.580504 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.475529  3649 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.543968  3841 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.572690  3664 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:30.597885 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 52164.3us
I20260709 13:16:30.541522  3769 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.565814 31604 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:30.601845 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.603116 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.604525 30874 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:30.604681 30883 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:30.605508  3448 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:30.606341  3769 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.607538 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:30.608349 31597 raft_consensus.cc:2393] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 16: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:30.608744  3769 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.609127 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.610014 31597 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:16:30.602531  3872 log.cc:927] Time spent T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: Append to log took a long time: real 0.050s	user 0.001s	sys 0.001s
I20260709 13:16:30.604255 31571 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.623271 31571 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.624778 31571 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.619302 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.507649  3417 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.552569  3622 consensus_queue.cc:1059] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:16:30.545922  3761 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.560628  3811 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.604660  3861 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:30.602746  3587 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.604388  3841 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.641227  3671 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.642306  3643 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.645105  3825 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.632604 31597 raft_consensus.cc:1240] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:30.646322 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:30.648733 30883 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:30.649415 31032 raft_consensus.cc:2368] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
I20260709 13:16:30.583067  3535 consensus_queue.cc:260] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.651790 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.668172  3535 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:30.640038  3680 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.005s
I20260709 13:16:30.660601 31605 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:30.639900  3774 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.646139 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.649169  3769 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.656003  3622 consensus_queue.cc:1243] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:30.644330  3617 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:30.689100  3833 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.926s	user 0.005s	sys 0.025s
I20260709 13:16:30.691119  3617 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.692085 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2421) took 1937 ms. Trace:
I20260709 13:16:30.692660 30957 rpcz_store.cc:276] 0709 13:16:28.754345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.754471 (+   126us) service_pool.cc:224] Handling call
0709 13:16:28.754787 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.755209 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:28.760858 (+  5649us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.221653 (+460795us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b18003aee80. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa23a 00007f273ac64a2a
0709 13:16:29.375125 (+153472us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.375828 (+   703us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.376962 (+  1134us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.377735 (+   773us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:29.377890 (+   155us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b18003aee80. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:29.377947 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.378323 (+   376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.622615 (+1244292us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:30.691804 (+ 69189us) raft_consensus.cc:1685] finished
0709 13:16:30.691835 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.692007 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37407,"prepare.queue_time_us":11195,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":39099,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":1422,"spinlock_wait_cycles":29202176,"thread_start_us":114571,"threads_started":1,"wal-append.queue_time_us":854477}
I20260709 13:16:30.695499  3645 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.696221  3417 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.696134  3645 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.699084 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.637406  3853 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.708787 31596 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:30.659045  3855 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:30.702219  3645 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.705687  3841 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.712489 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.712893  3853 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.698408  3680 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.713184 31604 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:30.680534  3653 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.707001  3761 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:30.699055  3762 consensus_meta.cc:287] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.001s
I20260709 13:16:30.714573 31604 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:30.719805 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.720986 30874 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:30.654551  3811 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.677841  3587 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:30.725065 30998 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.709695  3622 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.731869 30998 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.716972  3861 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:30.733567 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 108880us
I20260709 13:16:30.735736 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:30.730674  3656 raft_consensus.cc:2804] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:30.729691  3587 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.739081 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:30.728355  3645 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:16:30.748140  3853 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:30.750463 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.736949  3622 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.737977  3663 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:16:30.751130 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.742920  3643 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:30.741892  3761 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:30.764430 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:30.764302 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.743499  3587 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:30.730203  3762 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.760331 31600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1349) took 1196 ms. Trace:
I20260709 13:16:30.766366 31600 rpcz_store.cc:276] 0709 13:16:29.563925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.564096 (+   171us) service_pool.cc:224] Handling call
0709 13:16:30.760146 (+1196050us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54004deed4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:30.760272 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625057536}
I20260709 13:16:30.769342  3762 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.771617 30879 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 16. Current term is 17.
I20260709 13:16:30.752651  3853 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.749714  3656 raft_consensus.cc:697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:30.776664 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.777333 31604 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:30.774416  3853 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:30.744480  3409 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:16:30.739863  3861 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.746170  3809 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:16:30.789048 30922 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:30.760121  3643 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.811851  3831 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:30.812813 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.812330  3656 consensus_queue.cc:237] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.813478 31601 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:30.814460 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:30.816327  3584 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.816890  3584 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.818701  3643 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:30.822333  3671 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.859115 30922 leader_election.cc:400] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 18. Current term is 19.
I20260709 13:16:30.859547 30922 leader_election.cc:403] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:30.862759 30881 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:30.868464 31601 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:30.869519 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.874459 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:30.864625  3671 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:16:30.875144 31605 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.862015  3680 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.873617  3154 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:30.876559  3653 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:16:30.876858  3880 log.cc:927] Time spent T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:30.887055  3154 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:30.878314  3840 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 1.088s	user 0.000s	sys 0.011s
I20260709 13:16:30.881763 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.889599 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.890873  3760 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:30.891436  3760 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.891983  3657 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:30.892445  3657 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:30.893478  3760 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.893200  3657 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.893822  3505 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.894296 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.894454  3657 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:30.875337  3879 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:16:30.894768  3710 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.895182  3731 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.900396 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.882161 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.903261 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.905022 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:30.906421 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.906909 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:30.908687 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.909199 31030 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:30.915868 31030 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:30.918453  3826 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.919052  3826 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.924033  3584 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.924425  3364 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.904521  3680 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:30.925788  3364 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:30.925671  3680 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.930540  3664 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.949658 31571 leader_election.cc:400] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 16. Current term is 17.
I20260709 13:16:30.933523 31570 leader_election.cc:400] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
I20260709 13:16:30.936758  3737 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.937218  3587 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.950109 31571 leader_election.cc:403] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:30.909777  3645 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.955195 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:30.971144 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 59083.1us
I20260709 13:16:30.974921 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.976030 31597 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:30.977595 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:30.978888 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.980352  3691 raft_consensus.cc:3055] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:30.980741 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:30.894332  3505 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.981638 31597 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:16:30.982187  3154 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.958014 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.983085 31028 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:30.907577  3731 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:30.985067  3731 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:30.983088  3505 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:30.988760 31597 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:30.938346  3811 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:30.949152  3680 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:31.001380 31028 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
I20260709 13:16:31.006332 30923 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:30.991876 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:30.991690 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:30.980856  3691 raft_consensus.cc:740] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:30.990870 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:31.015228 31031 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:30.949060  3617 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:31.016727 31597 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:31.021590 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:31.021992 30847 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:31.022403 31597 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:30.993790  3721 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 16. Current term is 17.
I20260709 13:16:31.026070  3656 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:31.034443  3656 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:31.000123  3645 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.007992  3731 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:31.038254  3731 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.038733  3731 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.043929  3656 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:31.045194 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 1.48688e+06us
I20260709 13:16:31.045809  3853 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:30.963689  3807 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:31.063474 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:31.066365 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.023629  3864 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:31.081157 31597 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:31.081745 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.081794 30879 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:31.082459 30874 raft_consensus.cc:2368] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14.
I20260709 13:16:31.086978 31031 raft_consensus.cc:2468] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:31.090008 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.090097 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.138008 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:31.139308 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 117342us
I20260709 13:16:31.093303 31027 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 10: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:31.025648  3617 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.140211 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:31.144024 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.145684 30883 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 9.
I20260709 13:16:31.151053 31598 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:31.083463  3518 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.064741  3861 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:31.154697 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.091466  3295 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.080051  3848 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.091578  3825 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:31.166147 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.167253 30957 raft_consensus.cc:2368] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16.
I20260709 13:16:31.142071  3417 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:31.171480  3295 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:31.184108 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47311us
I20260709 13:16:31.185272 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.145609  3644 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:31.122125  3864 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:31.072438  3822 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:16:31.194712 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.216347 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.221047 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.225263  3295 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:31.186682  3884 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.264s	user 0.002s	sys 0.000s
I20260709 13:16:31.091853  3691 consensus_queue.cc:260] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.230013 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:31.231688 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.233986  3807 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:31.249639 30879 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 16: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:31.164079  3448 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:31.239245 31605 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:31.214417  3831 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:31.240903  3643 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:31.180850  3587 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.237149  3617 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.181224  3417 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:31.251047 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 110927us
I20260709 13:16:31.270840 31025 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:31.192420 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.256422 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.257532  3831 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.259634  3643 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:31.244202  3826 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:31.246315  3648 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:31.244513  3664 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.246498  3505 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:31.263621  3448 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:31.268656 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 107757us
I20260709 13:16:31.269059 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:31.280328 30875 raft_consensus.cc:2368] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14.
I20260709 13:16:31.269937 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.280681 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.281067 30951 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:31.281370 30954 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.272665 30955 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:31.173363  3825 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:31.272034 30949 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:31.245215  3853 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:31.275794 30879 raft_consensus.cc:1240] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:31.241885  3887 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:31.276837 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.271032 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:31.276914  3505 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.306137  3505 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.309990 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.311262 30954 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:31.290160  3882 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.534s	user 0.006s	sys 0.007s
I20260709 13:16:31.291433  3622 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:31.269675  3644 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:31.294696 30953 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:31.341063 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.341442 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.342077 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.342455 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.295874  3887 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.296751  3830 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:31.297137  3448 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.363855  3831 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.297204  3864 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.298475  3645 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.300552  3731 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.303406 31031 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:31.305015  3807 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.305131  3471 raft_consensus.cc:3055] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:31.312191 30956 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:16:31.371179 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.371943 30956 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 8.
I20260709 13:16:31.372913 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.373729 30956 raft_consensus.cc:2393] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:31.314680 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.315932  3780 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:31.320019 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1114) took 1932 ms. Trace:
I20260709 13:16:31.381090 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.323571 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:31.381942 30955 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 8.
W20260709 13:16:31.382367 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 58890.3us
I20260709 13:16:31.324542 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.325238 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.326735 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.384656 30879 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:31.385732 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.327600 30882 raft_consensus.cc:1240] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:31.386588 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.286233  3417 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:31.328258 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.337246 31026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 934) took 1971 ms (client timeout 1845 ms). Trace:
I20260709 13:16:31.338340 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.433748 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.339448 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.433677 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:31.343050 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.434913  3897 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:31.433534 31026 rpcz_store.cc:269] 0709 13:16:29.365521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.368452 (+  2931us) service_pool.cc:224] Handling call
0709 13:16:31.337083 (+1968631us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000c44d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:31.337179 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387576192}
I20260709 13:16:31.354029 30997 leader_election.cc:400] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16.
I20260709 13:16:31.355051 30923 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:31.433007  3831 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:31.436332 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:31.436769 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 81773.3us
I20260709 13:16:31.437091 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.436762  3831 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.437525 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.437749  3831 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.360110  3814 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.360716  3828 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:31.360530  3644 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:31.438771  3893 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:16:31.438588 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.439100  3417 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.362962  3887 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.366524 30953 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 17.
I20260709 13:16:31.440120 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.440636  3814 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.441298 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.442121 30954 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:16:31.438884 30997 leader_election.cc:403] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.442669  3814 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.442955 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:31.375244 30958 raft_consensus.cc:3060] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.438218 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:31.443368 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 89546.1us
I20260709 13:16:31.444147 30955 raft_consensus.cc:2393] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 16: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:31.444984 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.445456 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:31.446648  3828 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.424005 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.448678  3828 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.446009 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:31.450237  3889 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:16:31.450158 30955 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:31.451195  3409 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16.
I20260709 13:16:31.443509 30880 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.453408  3409 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:31.453851  3409 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.380061 30950 rpcz_store.cc:276] 0709 13:16:29.387501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.387677 (+   176us) service_pool.cc:224] Handling call
0709 13:16:29.388165 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.400694 (+ 12529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.400753 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.049859 (+1649106us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b2c00046bc8. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:16:31.050259 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.190759 (+140500us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:31.190826 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.190927 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.319690 (+128763us) raft_consensus.cc:1685] finished
0709 13:16:31.319711 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.319957 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16399,"raft.queue_time_us":23708,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":76751,"spinlock_wait_cycles":2811264,"thread_start_us":98122,"threads_started":1,"wal-append.queue_time_us":199632}
I20260709 13:16:31.454226  3409 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.454931 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.455933 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.400135 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:31.456851 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.457425 30950 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:31.344061 30924 leader_election.cc:400] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14.
I20260709 13:16:31.458153 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.354029 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:31.438201  3850 raft_consensus.cc:2804] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:31.389403 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:31.424639  3780 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.439649  3417 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.451663 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.458724 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:31.465626 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 122025us
W20260709 13:16:31.459327 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 70197.2us
I20260709 13:16:31.460099 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:31.374543 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.472836 30956 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:31.438652 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.472836 30954 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:31.474321 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.475149 30950 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.477236 30958 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:31.478245 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.478675 30924 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.478902 30958 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.480346 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.482357 30924 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.459514  3720 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:31.483470  3720 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.483860  3720 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.484148  3825 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:31.460119  3850 raft_consensus.cc:697] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:31.487232  3847 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:31.488008  3622 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:31.487955  3850 consensus_queue.cc:237] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.488623  3622 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.489318  3847 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:31.489969  3847 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.490720  3622 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:31.491326 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:31.492619 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:31.394104  3505 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.493798 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:31.494328  3853 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:31.494727  3853 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:31.494869  3505 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.495138  3853 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.495388  3509 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.496266  3154 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:31.496706  3154 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:31.497112  3154 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.500407 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:31.501735 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.492825  3716 consensus_queue.cc:1059] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:31.502590 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.502987  3716 consensus_queue.cc:1243] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:16:31.503446  3716 raft_consensus.cc:3055] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:31.503752  3716 raft_consensus.cc:740] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:31.504608  3716 consensus_queue.cc:260] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.506033 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.506335 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.369975  3471 raft_consensus.cc:740] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:31.507084 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.507251 30924 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:16:31.509665 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 83547.2us
I20260709 13:16:31.517383 30880 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:31.522716 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.527261 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:31.529865 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:31.530712 31030 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:16:31.532074 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 148928us
I20260709 13:16:31.533028 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:31.537209 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:31.537540 30958 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:31.537942 31603 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:31.539592 31600 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:31.543083 30953 raft_consensus.cc:2410] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:31.555339 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:31.546422 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:31.553587 30922 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.556154 31603 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:31.556551 30954 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:31.565063 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:31.565762 31601 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.565127  3417 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.563174  3154 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:31.567924 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.565788 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.570641 31023 raft_consensus.cc:2368] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 16. Current term is 17.
I20260709 13:16:31.565243  3679 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:31.593502  3417 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.594444  3810 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:31.594781  3417 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:31.595147  3810 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:31.595245 30955 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:31.595290  3417 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.596129  3810 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.395678  3807 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.597694  3853 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.594096 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.600869 31023 raft_consensus.cc:2368] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
I20260709 13:16:31.601122  3409 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.601649 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.602397  3731 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.603053 31026 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:16:31.603119 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 95958.1us
I20260709 13:16:31.600157  3679 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:31.603917 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50450us
I20260709 13:16:31.604096 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.604804 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:31.610945 30954 raft_consensus.cc:2393] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:31.611738 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:31.627040 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 48772.6us
I20260709 13:16:31.630999 30877 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:31.526154  3716 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.653623 30924 leader_election.cc:400] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14.
I20260709 13:16:31.655009 30924 leader_election.cc:403] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.525789  3814 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.657424 31601 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:31.594429  3154 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:31.680377 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.604720  3828 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:31.681771 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:31.646137  3825 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:31.682971 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:31.690860 31604 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:31.685775 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.609179  3853 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:31.692003 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.692070 31030 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 19.
I20260709 13:16:31.694180 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.694676 30877 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:16:31.659685  3559 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:31.695039 30950 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:31.685389 31601 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:31.699378 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.567476  3471 consensus_queue.cc:260] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.672889  3848 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14.
I20260709 13:16:31.712092 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:31.714608 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.653775  3643 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:16:31.690035  3731 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:31.660121  3834 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:16:31.683808  3828 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:31.692919  3448 raft_consensus.cc:2764] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:16:31.731242 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.730016 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:31.739514 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:31.741048  3740 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.741122 30847 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:31.742040  3740 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:31.742535  3740 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:31.742969  3740 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.743270  3802 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:31.743942  3802 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:31.744998  3802 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.721259 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.748849 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.749635 31027 raft_consensus.cc:2376] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 19. Re-sending same reply.
I20260709 13:16:31.750705 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.731622 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:31.659129  3832 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:16:31.732751 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:31.752511 31604 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:31.754635  3740 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:31.757296 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:31.758356  3710 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:31.758797 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:31.767185 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.768263  3505 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:31.770426  3664 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:31.770730  3762 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:31.772109  3887 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:31.772491  3887 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:31.775331 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.776849 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.778102 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:31.683557  3851 consensus_queue.cc:1059] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:16:31.732154  3691 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:31.790020 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:31.783233 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.787592 31604 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:31.928977 31599 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:31.793466 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.932476 31028 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:31.783092  3664 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:16:31.915808 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 111833us
I20260709 13:16:31.920328 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.793809 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.945343 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:31.946329 30956 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:31.936242 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.736922  3671 consensus_meta.cc:287] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.855s	user 0.009s	sys 0.004s
I20260709 13:16:31.937822 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:31.938964 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 155838us
W20260709 13:16:31.787657  3890 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:16:31.733964  3471 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:31.949126 30878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.065s
W20260709 13:16:32.001183 30878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.065s
I20260709 13:16:31.953604 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.967404 31599 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:31.738242  3828 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:32.000512 30847 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:31.786392  3587 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:31.939476 30949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.018s	sys 0.021s
I20260709 13:16:31.786540  3830 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:32.054457 30949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.018s	sys 0.021s
I20260709 13:16:31.790302  3848 consensus_queue.cc:1059] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 13:16:31.957685  3646 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:31.970036 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:31.950735  3886 log.cc:927] Time spent T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.711s	user 0.002s	sys 0.002s
I20260709 13:16:31.927469 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:32.054498 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:31.924067  3807 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:32.062559 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 109054us
I20260709 13:16:31.962356  3622 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:32.068408 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:31.948792  3826 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:32.081799  3826 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.083950 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:32.085551 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:32.086289 31028 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 17.
I20260709 13:16:32.087215 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:32.052251  3671 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 18. Current term is 19.
W20260709 13:16:32.081054 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 153663us
I20260709 13:16:32.094079 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:31.829406  3679 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:32.004770  3710 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:32.106892 30956 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:32.053462  3645 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:32.065254  3830 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:32.112968 31028 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:32.146319 31605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.013s	sys 0.046s
W20260709 13:16:32.146664 31605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.013s	sys 0.046s
I20260709 13:16:32.063830  3409 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:32.114928 30957 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 19.
I20260709 13:16:32.064965  3853 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:32.120831  3864 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.033s	sys 0.024s
I20260709 13:16:32.108346  3807 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:32.121202  3644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.041s	sys 0.045s
W20260709 13:16:32.120260  3720 consensus_meta.cc:287] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.005s
I20260709 13:16:32.116231  3622 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:32.122848  3657 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:32.121347  3664 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:16:32.140811 30996 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.012s	sys 0.049s
I20260709 13:16:32.148600 31028 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:16:32.152873  3864 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.033s	sys 0.024s
W20260709 13:16:32.180634 30996 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.012s	sys 0.049s
W20260709 13:16:32.181059 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 642137us
I20260709 13:16:32.149289 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:32.163645  3887 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.169210 31025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36654 (request call id 2403) took 1267 ms. Trace:
I20260709 13:16:32.142324  3643 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:16:32.183809 31025 rpcz_store.cc:276] 0709 13:16:30.902152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.903078 (+   926us) service_pool.cc:224] Handling call
0709 13:16:32.168986 (+1265908us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001bfb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:32.169132 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773252864}
W20260709 13:16:32.156538  3644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.042s	sys 0.046s
I20260709 13:16:32.185752 31028 raft_consensus.cc:1240] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.184856 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:32.188275 30996 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:32.189234 30875 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:32.190932 31597 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.024s	sys 0.066s
I20260709 13:16:32.190961 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:32.192623  3622 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.193116 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2699) took 1047 ms. Trace:
W20260709 13:16:32.190843  3850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.033s	sys 0.059s
W20260709 13:16:32.194017  3850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.033s	sys 0.059s
W20260709 13:16:32.192404 31597 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.024s	sys 0.066s
I20260709 13:16:32.193128  3622 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.193523 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:32.191730 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.198107  3622 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:32.144944  3645 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.198904 31597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1353) took 1452 ms. Trace:
I20260709 13:16:32.203910 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:32.193512 30881 rpcz_store.cc:276] 0709 13:16:31.145302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.145495 (+   193us) service_pool.cc:224] Handling call
0709 13:16:31.169564 (+ 24069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.188643 (+ 19079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.188674 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.219158 (+ 30484us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.605357 (+386199us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:31.605395 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.605456 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.192921 (+587465us) raft_consensus.cc:1685] finished
0709 13:16:32.192941 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.193063 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23992,"raft.queue_time_us":49900,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":13591,"thread_start_us":334471,"threads_started":1,"wal-append.queue_time_us":810809}
I20260709 13:16:32.199250 31597 rpcz_store.cc:276] 0709 13:16:30.746556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.081951 (+335395us) service_pool.cc:224] Handling call
0709 13:16:31.082214 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.115199 (+ 32985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.115247 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.115906 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.254615 (+138709us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:32.195595 (+940980us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.198607 (+  3012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.198675 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.198715 (+    40us) raft_consensus.cc:1685] finished
0709 13:16:32.198727 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.198850 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21940,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":33835,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":19778,"spinlock_wait_cycles":855808,"thread_start_us":1053305,"threads_started":2,"wal-append.queue_time_us":310330}
I20260709 13:16:32.222345 30956 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:32.223614 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:32.178506  3807 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:32.188997  3611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.015s	sys 0.049s
W20260709 13:16:32.229702  3417 consensus_meta.cc:287] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.634s	user 0.004s	sys 0.006s
I20260709 13:16:32.236088  3417 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:32.236689  3364 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:32.188210  3664 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:32.237141  3364 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:32.230260  3645 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:32.234035  3780 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:32.235096  3831 consensus_meta.cc:287] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.782s	user 0.008s	sys 0.000s
I20260709 13:16:32.237998  3664 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.239135  3559 raft_consensus.cc:3055] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:32.238198  3417 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:32.240134  3611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.015s	sys 0.049s
I20260709 13:16:32.238874  3831 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:32.240394  3904 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:32.241539 30955 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:32.227644  3151 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:32.239578  3559 raft_consensus.cc:740] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:32.243706  3831 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:32.244284  3559 consensus_queue.cc:260] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.245676  3559 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:32.238062  3364 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.252156 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:32.252746 30956 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:32.258345 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.179215  3720 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.236394  3807 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.260775 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.272099 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:32.272696 31602 raft_consensus.cc:1240] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:32.273782 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:32.276980 31031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.013s	sys 0.049s
I20260709 13:16:32.285745 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:32.288064 31031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.013s	sys 0.050s
I20260709 13:16:32.288264 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:32.288874 30958 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.014s	sys 0.037s
I20260709 13:16:32.289525 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:32.290933 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:32.291126 31571 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:32.292855 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:32.294201 31602 raft_consensus.cc:3060] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:32.295526 31600 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:32.296608 30958 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.014s	sys 0.037s
I20260709 13:16:32.298647 30922 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.299731  3825 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:32.301623  3825 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:32.302964  3417 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:32.303445  3417 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:32.304510  3417 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.306471  3417 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:32.320273 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.324182 31599 raft_consensus.cc:1217] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[10.10-12.11]   Dedup: 10.10->[12.11-12.11]
I20260709 13:16:32.324934 31599 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:16:32.325138 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:32.258072  3887 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:32.292383  3716 consensus_meta.cc:287] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 13:16:32.324391 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:32.329960 31596 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:32.291623 30956 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:32.340628 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:32.292156  3154 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:32.321593  3611 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:32.319061  3409 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:32.349411  3830 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.286854  3622 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:32.351094  3622 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.352679 31598 raft_consensus.cc:2410] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:16:32.328913  3850 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:32.361549 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.362077 31602 raft_consensus.cc:1275] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:16:32.386437 31023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.003s	sys 0.035s
W20260709 13:16:32.386931 31023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.003s	sys 0.035s
W20260709 13:16:32.388417  3750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.017s	sys 0.017s
W20260709 13:16:32.397092  3750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.018s	sys 0.017s
I20260709 13:16:32.386626  3826 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:32.445029 31027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.013s	sys 0.005s
W20260709 13:16:32.445663 31027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.013s	sys 0.005s
I20260709 13:16:32.446450  3151 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:32.458191 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 389880us
W20260709 13:16:32.562672 30847 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.004s
W20260709 13:16:32.557305 30768 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.024s	sys 0.006s
W20260709 13:16:32.571261 30849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.008s
W20260709 13:16:32.576092 30924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.021s
W20260709 13:16:32.572381 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.016s
W20260709 13:16:32.572100 30921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.020s
W20260709 13:16:32.611100 30847 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.004s
W20260709 13:16:32.577600 30995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.028s
W20260709 13:16:32.583181 30998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.007s	sys 0.003s
W20260709 13:16:32.616259 30768 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.025s	sys 0.006s
I20260709 13:16:32.581391 31031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 941) took 1060 ms. Trace:
I20260709 13:16:32.577596 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 2023) took 1283 ms. Trace:
W20260709 13:16:32.618371 30924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.021s
W20260709 13:16:32.618600 30921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.021s
W20260709 13:16:32.618908 30849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.008s	sys 0.009s
W20260709 13:16:32.582930 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 322065us
W20260709 13:16:32.618749 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.005s	sys 0.016s
W20260709 13:16:32.512737  3913 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:16:32.621063 30995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.028s
W20260709 13:16:32.622877 30998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.008s	sys 0.004s
I20260709 13:16:32.576866 30951 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:32.632268  3935 consensus_queue.cc:1048] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:32.635506 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.628697  3928 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:32.664587  3928 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:32.629289  3785 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.546s	user 0.003s	sys 0.032s
W20260709 13:16:32.668089  3785 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.605s	user 0.003s	sys 0.033s
I20260709 13:16:32.667714  3927 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:32.629484  3810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.006s	sys 0.014s
W20260709 13:16:32.670534  3810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.007s	sys 0.015s
I20260709 13:16:32.666834 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.631309  3720 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:32.640205 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 639737us
I20260709 13:16:32.641384  3471 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:32.642089 30848 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.028s
I20260709 13:16:32.647233  3611 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.648922 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.013s	sys 0.008s
I20260709 13:16:32.650950 30881 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:16:32.651294 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.651988 31605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1354) took 1721 ms. Trace:
W20260709 13:16:32.676043 30848 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.011s	sys 0.028s
I20260709 13:16:32.675990 31605 rpcz_store.cc:276] 0709 13:16:30.930314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.252310 (+321996us) service_pool.cc:224] Handling call
0709 13:16:31.252636 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.252973 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.253003 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.253444 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.147001 (+893557us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:32.147042 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.147115 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.624704 (+477589us) raft_consensus.cc:1685] finished
0709 13:16:32.626586 (+  1882us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.651729 (+ 25143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7704,"raft.queue_time_us":113,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12154,"spinlock_wait_cycles":1684736,"thread_start_us":863144,"threads_started":1,"wal-append.queue_time_us":1172625}
I20260709 13:16:32.652807 31570 leader_election.cc:400] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 16. Current term is 17.
I20260709 13:16:32.677991  3471 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:32.679478 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.013s	sys 0.009s
W20260709 13:16:32.679987 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 581155us
W20260709 13:16:32.681600 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 65844.2us
I20260709 13:16:32.683166 31570 leader_election.cc:400] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13.
I20260709 13:16:32.654115 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:32.683260  3611 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:32.684456 30957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 2014) took 1490 ms (client timeout 1677 ms). Trace:
W20260709 13:16:32.684952 30957 rpcz_store.cc:269] 0709 13:16:31.193788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.194394 (+   606us) service_pool.cc:224] Handling call
0709 13:16:32.684048 (+1489654us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540008bbd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:32.684237 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058421632}
I20260709 13:16:32.656591 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:32.627338 31031 rpcz_store.cc:276] 0709 13:16:31.520314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.520482 (+   168us) service_pool.cc:224] Handling call
0709 13:16:31.566813 (+ 46331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.598875 (+ 32062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.598912 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.599362 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.288637 (+689275us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:32.289658 (+  1021us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.297318 (+  7660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.297419 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.580596 (+283177us) raft_consensus.cc:1685] finished
0709 13:16:32.580649 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.581032 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31690,"prepare.queue_time_us":517,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":39918,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":176,"thread_start_us":688955,"threads_started":1,"wal-append.queue_time_us":878547}
I20260709 13:16:32.627496 30949 rpcz_store.cc:276] 0709 13:16:31.295239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.295385 (+   146us) service_pool.cc:224] Handling call
0709 13:16:31.295669 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.341844 (+ 46175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.341872 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.342294 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.054919 (+712625us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:32.575905 (+520986us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.576658 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.576843 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.576951 (+   108us) raft_consensus.cc:1685] finished
0709 13:16:32.576969 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.577309 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":90534,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":45973,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":8790,"thread_start_us":1208903,"threads_started":2,"wal-append.queue_time_us":913750}
I20260709 13:16:32.690270  3810 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:32.692368  3810 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:32.698447 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2442) took 1369 ms. Trace:
I20260709 13:16:32.699208  3364 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:32.699056 30949 rpcz_store.cc:276] 0709 13:16:31.329312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.697113 (+1367801us) service_pool.cc:224] Handling call
0709 13:16:32.697635 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.698022 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.698048 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.698116 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:32.698154 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.698236 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.698353 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.701377  3710 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:32.706962 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:32.708143  3611 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:32.681663  3471 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:32.709261  3928 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:32.731431 31604 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:32.710187  3832 raft_consensus.cc:3055] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:32.733125  3832 raft_consensus.cc:740] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:32.710541 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2438) took 1382 ms. Trace:
I20260709 13:16:32.711228  3584 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:32.734867 30957 rpcz_store.cc:276] 0709 13:16:31.327661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.686301 (+1358640us) service_pool.cc:224] Handling call
0709 13:16:32.690667 (+  4366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.710124 (+ 19457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.710154 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.710232 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:32.710288 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.710359 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.710468 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.695567  3810 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:32.711541 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:32.713590  3830 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:32.714531 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:32.715031 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.713707 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:32.718205 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:32.719915 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:32.720979 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:32.723202 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:32.724365 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:32.707047  3740 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:32.758847  3927 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:32.760315 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45449.2us
I20260709 13:16:32.761714  3584 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.762799 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2432) took 1436 ms. Trace:
I20260709 13:16:32.764669 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2430) took 1439 ms. Trace:
I20260709 13:16:32.766490 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2435) took 1439 ms. Trace:
I20260709 13:16:32.768112 30874 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
W20260709 13:16:32.768522 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 102035us
W20260709 13:16:32.770174 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 63474.7us
I20260709 13:16:32.770920  3928 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:32.774458 31599 raft_consensus.cc:1240] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:16:32.776014 31029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 2882) took 1047 ms. Trace:
I20260709 13:16:32.776827 30957 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:16:32.779837 30952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.008s	sys 0.003s
I20260709 13:16:32.755971  3710 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:32.788596 30956 rpcz_store.cc:276] 0709 13:16:31.326869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.341813 (+1014944us) service_pool.cc:224] Handling call
0709 13:16:32.342165 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.372317 (+ 30152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.372364 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.372419 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:16:32.372471 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.765987 (+393516us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54000cfdd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:32.766049 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.766291 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68738816}
I20260709 13:16:32.791945 31029 rpcz_store.cc:276] 0709 13:16:31.728840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.157610 (+428770us) service_pool.cc:224] Handling call
0709 13:16:32.158036 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.199563 (+ 41527us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:32.199594 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.199634 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:32.199670 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.775540 (+575870us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400146c54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:32.775615 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.775853 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95000960}
I20260709 13:16:32.805985 31024 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:32.803275 30952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.009s	sys 0.003s
I20260709 13:16:32.801847 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2451) took 1465 ms. Trace:
I20260709 13:16:32.808611 30957 rpcz_store.cc:276] 0709 13:16:31.331549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.775846 (+1444297us) service_pool.cc:224] Handling call
0709 13:16:32.776373 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.792435 (+ 16062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.796895 (+  4460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.786264  3927 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:32.787968 30955 rpcz_store.cc:276] 0709 13:16:31.326117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.596071 (+269954us) service_pool.cc:224] Handling call
0709 13:16:31.596354 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.241906 (+645552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.762340 (+520434us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540002fb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:32.762630 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483319552}
I20260709 13:16:32.788102 30958 rpcz_store.cc:276] 0709 13:16:31.325371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.570792 (+245421us) service_pool.cc:224] Handling call
0709 13:16:31.605200 (+ 34408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.605376 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:32.297712 (+692336us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.764029 (+466317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.764137 (+   108us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:32.764221 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.764315 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.764488 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":519593,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":488,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"thread_start_us":1073968,"threads_started":2,"wal-append.queue_time_us":422071}
W20260709 13:16:32.821278 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 97185.9us
I20260709 13:16:32.823566  3785 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:32.827754 30880 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:16:32.827971  3584 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:32.828238 30880 pending_rounds.cc:85] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 11
I20260709 13:16:32.828629 30880 pending_rounds.cc:107] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:16:32.829103 30880 raft_consensus.cc:2889] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.830691 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:32.830981 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.807276  3471 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:32.831743  3785 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:32.832549  3471 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.833300  3785 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.834491 30996 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:32.835929  3643 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:32.831745 30883 raft_consensus.cc:2368] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10.
W20260709 13:16:32.837641  3911 log.cc:927] Time spent T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.385s	user 0.003s	sys 0.000s
I20260709 13:16:32.815127  3927 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.828490 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2436) took 1429 ms. Trace:
I20260709 13:16:32.842700 30950 rpcz_store.cc:276] 0709 13:16:31.327131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.680819 (+1353688us) service_pool.cc:224] Handling call
0709 13:16:32.681707 (+   888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.690303 (+  8596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.690340 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.748550 (+ 58210us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:32.754613 (+  6063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.754709 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.756682 (+  1973us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6400}
W20260709 13:16:32.856447 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.840898  3471 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:32.840997  3643 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:32.857653 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:32.871946 30949 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:32.896783 30958 raft_consensus.cc:1217] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[12.10-14.11]   Dedup: 12.10->[14.11-14.11]
I20260709 13:16:32.897513 30958 raft_consensus.cc:1240] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 13:16:32.898241 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1128) took 1464 ms. Trace:
I20260709 13:16:32.898597 30958 rpcz_store.cc:276] 0709 13:16:31.433762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.855218 (+1421456us) service_pool.cc:224] Handling call
0709 13:16:32.896424 (+ 41206us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:32.897889 (+  1465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.898163 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.902489 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 84394.3us
W20260709 13:16:32.904121 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.904281  3679 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:32.904969  3679 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:32.906715  3720 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.907526 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:32.909173 31599 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:32.909621 31599 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:32.910801 31599 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.907407  3720 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.920684 30950 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:32.921985 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 103739us
I20260709 13:16:32.922181  3832 consensus_queue.cc:260] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.871121  3845 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:32.923758 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 113689us
W20260709 13:16:32.924311 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50600.5us
I20260709 13:16:32.924954  3471 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:16:32.926623 30924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.927131  3671 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:32.854113  3611 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:32.929658 30955 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:32.869727  3643 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:32.941812 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:32.944132 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2447) took 1570 ms. Trace:
I20260709 13:16:32.955490 30949 rpcz_store.cc:276] 0709 13:16:31.330590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.751280 (+1420690us) service_pool.cc:224] Handling call
0709 13:16:32.814536 (+ 63256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.872463 (+ 57927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.901207 (+ 28744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.906327  3679 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.922891 30952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 2020) took 1645 ms. Trace:
I20260709 13:16:32.958006 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1129) took 1523 ms. Trace:
I20260709 13:16:32.962466 30950 rpcz_store.cc:276] 0709 13:16:31.434088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.855500 (+1421412us) service_pool.cc:224] Handling call
0709 13:16:32.920389 (+ 64889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.950548 (+ 30159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.957929 (+  7381us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.945379 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 122394us
I20260709 13:16:32.959681 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:32.969612 30996 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:32.961637 30955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1125) took 1591 ms. Trace:
I20260709 13:16:32.971081 30955 rpcz_store.cc:276] 0709 13:16:31.370147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.819825 (+1449678us) service_pool.cc:224] Handling call
0709 13:16:32.899970 (+ 80145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.961294 (+ 61324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.961569 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.976643 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2452) took 1644 ms. Trace:
I20260709 13:16:32.960261  3834 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.960361  3832 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:32.959895  3810 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:32.952447  3611 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:32.997841  3417 consensus_meta.cc:287] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.014s
I20260709 13:16:32.998709 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:33.000864  3848 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.001448  3848 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.004155 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.004552  3928 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.005172  3928 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.980018 30956 rpcz_store.cc:276] 0709 13:16:31.331829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.814387 (+1482558us) service_pool.cc:224] Handling call
0709 13:16:32.821189 (+  6802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.821723 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:32.822210 (+   487us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.975817 (+153607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.975950 (+   133us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:32.976038 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.976232 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.976512 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1994,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":6987,"thread_start_us":138040,"threads_started":1}
I20260709 13:16:32.973742  3471 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:32.973202  3671 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:32.993846 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1122) took 1641 ms. Trace:
I20260709 13:16:33.017318 30882 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.036505 30957 rpcz_store.cc:276] 0709 13:16:31.352705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.820033 (+1467328us) service_pool.cc:224] Handling call
0709 13:16:32.855542 (+ 35509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.987284 (+131742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.987334 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.987405 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:32.993500 (+  6095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.993590 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.993768 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:33.013742 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 111519us
I20260709 13:16:33.010792 31597 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:33.007910 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:33.012188 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.038878 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.038951  3935 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:33.040795 30949 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:33.041654 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1132) took 1534 ms. Trace:
I20260709 13:16:33.042003 30949 rpcz_store.cc:276] 0709 13:16:31.507129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.973865 (+1466736us) service_pool.cc:224] Handling call
0709 13:16:33.040244 (+ 66379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.041316 (+  1072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.041596 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:33.010879 30951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 2024) took 1702 ms (client timeout 1932 ms). Trace:
W20260709 13:16:33.044088 30951 rpcz_store.cc:269] 0709 13:16:31.308900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.309722 (+   822us) service_pool.cc:224] Handling call
0709 13:16:33.010601 (+1700879us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540008b6d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:33.010806 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910576896}
I20260709 13:16:32.962751 30952 rpcz_store.cc:276] 0709 13:16:31.277841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.277963 (+   122us) service_pool.cc:224] Handling call
0709 13:16:31.292151 (+ 14188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.292371 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:31.646481 (+354110us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.869532 (+1223051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.922467 (+ 52935us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:32.922556 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.922644 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.922831 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18745,"prepare.queue_time_us":796356,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6124,"raft.queue_time_us":15967,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":31386,"thread_start_us":1478093,"threads_started":2,"wal-append.queue_time_us":1025448}
I20260709 13:16:33.049904 31599 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:33.052821  3716 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:33.052623  3471 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.053237  3716 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:33.009830  3946 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:33.059206 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 75951.9us
I20260709 13:16:33.014063  3845 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:33.009398  3720 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.070454  3611 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
I20260709 13:16:33.007716  3928 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:33.060453  3935 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.059315  3716 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:33.082171 30883 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.086377 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 954) took 1389 ms. Trace:
I20260709 13:16:33.095585  3896 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:33.098609  3622 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:33.099956  3848 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.092662 31024 rpcz_store.cc:276] 0709 13:16:31.697084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.131096 (+434012us) service_pool.cc:224] Handling call
0709 13:16:32.131506 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.806644 (+675138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.085944 (+279300us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54003773d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:33.086289 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549714688}
I20260709 13:16:33.113392  3825 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:33.129679  3828 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 1.068s	user 0.012s	sys 0.013s
I20260709 13:16:33.129709 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.130601 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.130996 31597 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:33.131903 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 172390us
I20260709 13:16:33.132138  3828 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.134367 30954 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:33.135978 30876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2710) took 1783 ms. Trace:
I20260709 13:16:33.136592 30876 rpcz_store.cc:276] 0709 13:16:31.336985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.451249 (+114264us) service_pool.cc:224] Handling call
0709 13:16:31.451533 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.470347 (+ 18814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.470379 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.476646 (+  6267us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.765167 (+1288521us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b1800423760. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b4fe07 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273a7f420b 00007f273a7f9d23 00007f273a7fa0d1 00007f273ac15a0f
0709 13:16:32.912037 (+146870us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:33.063200 (+151163us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.078269 (+ 15069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.080358 (+  2089us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.080409 (+    51us) raft_consensus.cc:1685] finished
0709 13:16:33.117780 (+ 37371us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.120089 (+  2309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4532,"prepare.queue_time_us":165646,"raft.queue_time_us":35061,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":13319,"spinlock_wait_cycles":113928704,"thread_start_us":234460,"threads_started":2,"wal-append.queue_time_us":1520094}
I20260709 13:16:33.134542 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:33.151794 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2454) took 1421 ms. Trace:
I20260709 13:16:33.152341 30950 rpcz_store.cc:276] 0709 13:16:31.729881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.991209 (+1261328us) service_pool.cc:224] Handling call
0709 13:16:33.068255 (+ 77046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.145129 (+ 76874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.145161 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.151427 (+  6266us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:33.151483 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.151566 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.151704 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:33.080557  3810 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.066416  3834 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:33.187999 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 213942us
I20260709 13:16:33.169199  3848 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:33.192747  3671 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.194782  3828 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:33.199900 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 65483.6us
I20260709 13:16:33.201449 30954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 1133) took 1601 ms. Trace:
I20260709 13:16:33.204079 30953 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:33.122555  3935 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.206044 30997 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:33.210481 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.128595  3927 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.216190 31601 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.213356 30954 rpcz_store.cc:276] 0709 13:16:31.600495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.611524 (+ 11029us) service_pool.cc:224] Handling call
0709 13:16:33.201204 (+1589680us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400256f54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:33.201385 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3499167616}
I20260709 13:16:32.556957 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:33.230370 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 130231us
I20260709 13:16:33.236517 30883 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:33.240410 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.231734 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 216524us
I20260709 13:16:33.238158 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1131) took 1731 ms. Trace:
I20260709 13:16:33.244273 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.233294 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.246467 30958 rpcz_store.cc:276] 0709 13:16:31.506878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.899476 (+1392598us) service_pool.cc:224] Handling call
0709 13:16:32.950425 (+ 50949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.998477 (+ 48052us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:16:32.998821 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.231529 (+232708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.231589 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:33.237884 (+  6295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.237974 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.238103 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":747,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":5871,"thread_start_us":227934,"threads_started":1}
I20260709 13:16:33.249073 30924 leader_election.cc:400] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10.
I20260709 13:16:33.249414 30924 leader_election.cc:403] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:16:33.245242  3471 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:33.250797  3643 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.251132  3471 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.253036  3643 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.253929  3643 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:33.254488  3643 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:33.255558  3922 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:16:33.257073  3927 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:33.253099  3471 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.264014 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.238709  3834 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.236065  3896 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:33.272750 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.273231  3946 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.268302  3887 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.912s	user 0.007s	sys 0.015s
I20260709 13:16:33.292295 31604 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 16: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:33.292259 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 43664.7us
I20260709 13:16:33.273234  3845 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:33.297194 31605 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:33.274665 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 287063us
I20260709 13:16:33.298552 31605 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:33.299027 31570 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.302066 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.303474  3611 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:33.304107  3960 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.230106  3671 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:16:33.285326 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.309134  3810 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.309506 30998 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:33.309969 30874 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:33.310341  3409 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:33.311254  3409 raft_consensus.cc:2804] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:33.286533 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.309669 30876 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:33.311184 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.313190 30848 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:33.316709 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:33.317863 30883 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:33.318634  3935 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.319824  3720 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.320389  3720 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.248829  3710 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:33.321293 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 87252us
I20260709 13:16:33.322903  3710 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.323998  3830 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:33.324587  3830 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:33.325055  3671 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:33.325526  3671 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:33.325860  3946 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.326443  3671 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.323488  3828 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 9. Current term is 10.
I20260709 13:16:33.327853 31604 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:33.328269  3946 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.323998  3896 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.328799 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.329187 30877 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:33.329977  3925 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.330091 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.330821 31599 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:33.330585  3925 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.332067  3409 raft_consensus.cc:697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:33.332271 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.332708  3925 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.330608  3896 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.337579 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:33.339092 30848 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.333117  3409 consensus_queue.cc:237] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.341586  3720 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.342288  3740 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:33.350265  3644 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:33.351938  3679 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:33.353036 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.339143 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.353734 31605 raft_consensus.cc:3060] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:33.354542 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 46861.8us
I20260709 13:16:33.356240  3671 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.325758  3830 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.255597  3643 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.303689 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.331617 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.356166 30996 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:33.369028 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:33.370313 31601 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:33.370568 30881 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
W20260709 13:16:33.416786 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.422745 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.428535 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:33.426429 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.447054 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.445842 30953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2433) took 2119 ms. Trace:
I20260709 13:16:33.322943  3716 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.454449 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.390486  3946 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:33.433259 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:33.448774 30847 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:33.459025 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.462405 31599 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:33.453780 30953 rpcz_store.cc:276] 0709 13:16:31.326371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.735075 (+408704us) service_pool.cc:224] Handling call
0709 13:16:33.203784 (+1468709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.223412 (+ 19628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.431310 (+207898us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400256f50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:33.445749 (+ 14439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3376620800}
I20260709 13:16:33.466655 31596 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:33.474436 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.483392 31598 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:16:33.484493 30955 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:16:33.424436  3810 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.482640 30950 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:33.484927 30955 pending_rounds.cc:85] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 11
I20260709 13:16:33.490145 30955 pending_rounds.cc:107] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 16.12
W20260709 13:16:33.490384 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 134330us
I20260709 13:16:33.459285  3848 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:33.491281 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 64942.6us
I20260709 13:16:33.463873  3925 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.494112 30955 raft_consensus.cc:2889] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.495931 31031 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:33.496654 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 290679us
I20260709 13:16:33.463047  3785 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:33.509369 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 205793us
I20260709 13:16:33.517637 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:33.526424 31571 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:33.533806 30954 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:16:33.537230 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:33.538609 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 43483.8us
I20260709 13:16:33.539278 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:33.551841  3969 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:16:33.552953  3968 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:33.556339  3961 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:33.558115 31024 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.539575  3622 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:33.559659  3969 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:33.559975  3622 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:33.560395  3969 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:33.562305  3969 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.564146  3969 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.569376 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:33.571206 30997 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:33.574333  3961 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:33.574819  3961 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:33.575241  3961 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:33.575459  3720 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.575932  3960 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:33.576432  3960 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.576987  3960 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:33.576349  3720 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.560530  3622 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.579360  3720 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.517297  3925 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.580838 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:33.581512  3968 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:33.582264 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:33.584264 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:33.538040  3810 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.587409  3785 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.524940  3471 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:33.592511 31024 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:33.637650 31598 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:33.654156 31598 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:33.653983 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.668491 31598 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.669797 31598 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.677841  3720 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:33.678478  3720 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.687381 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.690267 31032 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:16:33.692242 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 152806us
I20260709 13:16:33.695538 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:33.698025 30996 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:33.693312  3611 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.705816 31598 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:16:33.706358 31598 pending_rounds.cc:85] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 9
I20260709 13:16:33.706681 31598 pending_rounds.cc:107] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:33.707033 31598 raft_consensus.cc:2889] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:33.708217  3611 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.710626  3611 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.715152 31605 raft_consensus.cc:2468] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:33.694245  3720 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.717504 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.718442 31605 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:33.702518  3970 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:33.702178  3968 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:33.641162  3848 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:33.718762 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 75750.7us
I20260709 13:16:33.758121 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:33.814821 30876 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:33.814973 31598 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
W20260709 13:16:33.818951 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 238192us
I20260709 13:16:33.823035  3832 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.824702  3975 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:16:33.825258  3643 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:33.825918  3643 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.826588  3810 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.828171  3785 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.828980  3716 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:33.829888 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:33.819296  3925 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:33.806500  3970 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.831897  3970 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:33.834197 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:33.839087 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:33.850735 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.852013 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:33.854429  3622 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.837955  3716 raft_consensus.cc:2764] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:16:33.856199 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.856724  3716 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:33.857184  3716 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:33.857594  3716 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:33.823680  3832 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.852207  3643 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.859555  3832 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:33.868688 31605 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:33.871558 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.873623 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.872565 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2456) took 2137 ms. Trace:
I20260709 13:16:33.874959 30956 rpcz_store.cc:276] 0709 13:16:31.730387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.006619 (+1276232us) service_pool.cc:224] Handling call
0709 13:16:33.007160 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.231749 (+224589us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:33.260978 (+ 29229us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.448285 (+187307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.448338 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:33.458125 (+  9787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.867747 (+409622us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400112954. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:33.867835 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.868002 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3779,"prepare.queue_time_us":27221,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3893,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":22170,"spinlock_wait_cycles":483138304,"thread_start_us":136285,"threads_started":1,"wal-append.queue_time_us":291033}
I20260709 13:16:33.876852 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:33.876372 31570 connection.cc:256] RPC call timeout handler was delayed by -1.1435819890000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 13:16:33.880719 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.869827  3611 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.881345 30950 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:33.879083 30923 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.882750 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.887053 30957 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
I20260709 13:16:33.892880 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.867254  3961 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:33.905349 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.904503 30922 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:33.909720 30952 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:33.911684 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:33.912487 31605 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:33.915755 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:33.919227 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:33.888688  3611 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.919121  3922 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:33.913756  3832 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:33.913939  3921 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:33.936230 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:33.937796  3984 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:33.914955  3927 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:33.914626  3720 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:33.944106 30957 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:33.930591  3922 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.946346 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 457495us
I20260709 13:16:33.932192  3810 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:33.926717  3960 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:33.987471  3979 log.cc:927] Time spent T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:16:34.025460 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:33.935371  3935 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.988528  3987 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.946410  3802 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:34.027945 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 82935.8us
I20260709 13:16:33.989437  3988 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:34.023255 30956 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:33.945514  3971 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:33.938221  3961 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:33.948452  3622 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351)
W20260709 13:16:34.031080 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 537848us
I20260709 13:16:34.014338  3922 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.034826 31597 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:16:33.939922  3921 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.028267  3848 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.030042  3611 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.041457  3832 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:34.034144  3671 consensus_meta.cc:287] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.002s
I20260709 13:16:34.042111  3832 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.044978  3832 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.048146  3931 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:34.049039  3931 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.050165  3970 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.050679 30949 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:34.051054  3931 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.037042  3989 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:34.041013  3802 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:34.032626  3927 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.052639  3802 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.032487  3987 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.037537  3935 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.040602  3830 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:16:34.057551 30954 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:34.069975 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:34.070343 30952 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:16:34.070696 30952 pending_rounds.cc:85] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 12
I20260709 13:16:34.070953 30952 pending_rounds.cc:107] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:16:34.071218 30952 raft_consensus.cc:2889] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.058589  3720 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:34.062132 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.072976 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.032429  3971 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:34.063755 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.938437  3984 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.073297 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.077987 30953 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.060971  3921 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.086256 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:34.084213 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.091655 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.092585 30877 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:34.080925  3671 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:34.088263 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.089027 31604 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:34.097919 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:34.036772  3810 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.106287 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:34.107148 30876 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.108045 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.075548  3971 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:34.125414 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 114549us
I20260709 13:16:34.090636  3927 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.132337 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.133422 31032 raft_consensus.cc:2393] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 16: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:34.137761 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.135728  3671 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.123883  3622 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:34.139576  3671 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.140138  3622 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:34.140559  3622 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.141619  3671 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.104561  3848 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:34.160475 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.104600  3961 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:34.089448  3716 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.131021  3970 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.160596 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:34.165124 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 65010.9us
I20260709 13:16:34.169369 30953 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:34.172250  3924 consensus_queue.cc:1059] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:16:34.173362  3987 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.171545 30876 raft_consensus.cc:2468] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:34.180768 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.181635 31032 raft_consensus.cc:2410] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:16:34.175815  3448 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:34.161429  3988 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:34.193351 30874 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:34.181984 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:34.195637 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.195887 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.199174 31024 raft_consensus.cc:1240] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:16:34.213472 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.211776 30881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39074 (request call id 1101) took 1498 ms. Trace:
I20260709 13:16:34.186826 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.214125 31605 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:16:34.199421 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.208086 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:34.245710 30881 rpcz_store.cc:276] 0709 13:16:32.713171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.713340 (+   169us) service_pool.cc:224] Handling call
0709 13:16:34.211564 (+1498224us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54000f9e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:34.211672 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287439232}
I20260709 13:16:34.195001 31570 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:34.207612 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.130306  3921 consensus_queue.cc:1059] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:16:34.198279 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:34.277719 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.195276 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:34.230430  3981 log.cc:927] Time spent T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:16:34.192180 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.206257 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.275203 30952 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:16:34.275853 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.133226  3740 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:16:34.274346 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.291402 30880 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:34.205856 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.283806 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:34.284953 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 90014.8us
W20260709 13:16:34.232677  3973 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.546s	user 0.000s	sys 0.002s
W20260709 13:16:34.202466  3978 log.cc:927] Time spent T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:16:34.237905  3720 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:34.296247  3720 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.182622  3924 raft_consensus.cc:3055] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:34.291749 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:34.306643 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.294342 31570 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.197460  3807 raft_consensus.cc:3055] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:34.289618 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:34.302691 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 104498us
I20260709 13:16:34.312420 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:34.304453 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:34.307729 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 71245.9us
I20260709 13:16:34.308849 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.309345 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.309955 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.186102  3984 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.273548  3996 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.317313 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:34.254148  3987 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:34.319058 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.324795 30956 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.189301  3971 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.321365 30954 raft_consensus.cc:1275] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:34.180929  3961 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.354907 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.327113 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.356622 31024 raft_consensus.cc:2468] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 11.
W20260709 13:16:34.332322  3982 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.417s	user 0.000s	sys 0.002s
W20260709 13:16:34.335608 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 108542us
I20260709 13:16:34.345819  3671 raft_consensus.cc:3055] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:34.347908 31601 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:34.364190 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.226766  3666 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:16:34.368891 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.368891 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.358410 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.370195 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.361127 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.224532  3802 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:16:34.215108  3922 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.316107 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34340
I20260709 13:16:34.363471  3938 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:34.223914  3622 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.219091  3644 consensus_queue.cc:1059] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:16:34.358162 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.361272 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:34.304939  3679 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:34.311450  3807 raft_consensus.cc:740] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:34.396528 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.306203  3924 raft_consensus.cc:740] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:34.325094  3960 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.377086 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.376256 31023 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:34.194402  3989 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 13:16:34.286566  3927 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:16:34.380488 30957 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:34.364370  3671 raft_consensus.cc:740] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:34.377779 30875 raft_consensus.cc:606] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Received request to transfer leadership
I20260709 13:16:34.375598 30922 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:34.208932  3988 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.364125  3946 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.392810 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.376587 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:34.418304 31597 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:34.399230 31029 raft_consensus.cc:2393] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 18: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:34.395684 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.358518  3832 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:34.403484 30880 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:34.428838 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.365841  3921 consensus_queue.cc:1059] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:34.392648 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.381121  3970 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.413493 31604 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:34.381171  3938 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:34.375088  3666 consensus_queue.cc:1243] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer f535fccbafb14e3f92bd45065da403db log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:16:34.430372 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.397264  3720 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.378960  3643 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:16:34.438068 31031 raft_consensus.cc:2410] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:34.434183 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.443979 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.431172 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.380573  3987 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.452389 30882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2728) took 1083 ms. Trace:
I20260709 13:16:34.452432 30958 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:34.410254  3935 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.358165  3996 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.442342  3938 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.471231  3951 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:34.471709  3951 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.472059  3951 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:34.473547 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.474203 30954 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 10.
I20260709 13:16:34.474818  3994 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:34.475067 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.475302  3994 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:34.475677  3994 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.476559  3671 consensus_queue.cc:260] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.440361 30951 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:34.465508 30955 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.461265 30882 rpcz_store.cc:276] 0709 13:16:33.369125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.375317 (+  6192us) service_pool.cc:224] Handling call
0709 13:16:33.433093 (+ 57776us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:33.460073 (+ 26980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.460120 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:33.476896 (+ 16776us) log.cc:844] Serialized 52 byte log entry
0709 13:16:33.719013 (+242117us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:16:33.816511 (+ 97498us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.024916 (+208405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.025021 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.205325 (+180304us) spinlock_profiling.cc:243] Waited 982 us on lock 0x7b4800080358. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273fb83aa1 00007f273fb7ab37 00007f273fb7a9ca 00007f273fc7226f 00007f273fc71f37 00007f273fc8655c 00007f273fc86508 00007f273fc86488 00007f273fc86443 00007f273fc856ec 00007f273ebafa96
0709 13:16:34.229741 (+ 24416us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:34.448434 (+218693us) raft_consensus.cc:1685] finished
0709 13:16:34.448464 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.452302 (+  3838us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208103,"prepare.queue_time_us":97320,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":15188,"raft.queue_time_us":226270,"raft.run_cpu_time_us":1714,"raft.run_wall_time_us":177345,"spinlock_wait_cycles":25295360,"thread_start_us":193549,"threads_started":1,"wal-append.queue_time_us":402417}
I20260709 13:16:34.401044  3679 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.441933  3887 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:34.498911 30954 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:34.436475  3832 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.478169  3671 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:34.504386 30949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51648 (request call id 2458) took 1138 ms. Trace:
I20260709 13:16:34.516937 30949 rpcz_store.cc:276] 0709 13:16:33.365838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.371427 (+  5589us) service_pool.cc:224] Handling call
0709 13:16:34.504244 (+1132817us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400112e54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:34.504336 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407583488}
I20260709 13:16:34.504596 30954 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:34.507392 30950 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:34.508316  3924 consensus_queue.cc:260] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.509169  4001 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:34.519034 30958 raft_consensus.cc:2468] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 18.
I20260709 13:16:34.510635  3922 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.511559  3961 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.512804  3622 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.448706  3970 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.478552  3960 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.509907 31603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1404) took 1048 ms. Trace:
I20260709 13:16:34.513547  3996 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.525800 31597 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 17.
I20260709 13:16:34.492537  3716 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.536986 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c9907b959044453b57011278bbecdff"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:34.531104 30951 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:34.525871  3935 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:34.560372  3998 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:16:34.560521  3997 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:16:34.561965  3995 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:34.566236  3970 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.568152  3924 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.569154  3832 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.534636 31603 rpcz_store.cc:276] 0709 13:16:33.398430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.525930 (+127500us) service_pool.cc:224] Handling call
0709 13:16:33.588117 (+ 62187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.588663 (+   546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.588708 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.589297 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.726018 (+136721us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:33.726075 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.726160 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.331369 (+605209us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:34.438771 (+107402us) raft_consensus.cc:1685] finished
0709 13:16:34.438800 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.447103 (+  8303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":127,"spinlock_wait_cycles":3819264,"thread_start_us":136260,"threads_started":1,"wal-append.queue_time_us":293039}
I20260709 13:16:34.553263  3922 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.572732  3922 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.573693  3679 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.537743 30881 raft_consensus.cc:606] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.575229  3922 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.555568  3935 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:34.576275  3935 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.580330 30879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2402) took 1204 ms. Trace:
I20260709 13:16:34.580781  3987 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.580693 30879 rpcz_store.cc:276] 0709 13:16:33.376099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.463449 (+ 87350us) service_pool.cc:224] Handling call
0709 13:16:33.495588 (+ 32139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.018282 (+522694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.018332 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.038602 (+ 20270us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.305584 (+266982us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:34.305622 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.499988 (+194366us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002ab054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:34.500032 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.579937 (+ 79905us) raft_consensus.cc:1685] finished
0709 13:16:34.579957 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.580167 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":333992,"raft.queue_time_us":365910,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2071,"spinlock_wait_cycles":374513024,"thread_start_us":200802,"threads_started":1,"wal-append.queue_time_us":372806}
W20260709 13:16:34.583907  3993 log.cc:927] Time spent T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:16:34.553597  3960 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.526765  3887 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:34.530561  4001 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.593135  3887 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:34.593977  4001 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.597210 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:34.600188  3960 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.601899  3946 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:34.609877 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.610419 30955 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:34.612673 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:34.616093 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.633837 30956 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:34.634636 31597 raft_consensus.cc:1275] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:34.640178 31596 raft_consensus.cc:2393] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:34.638830 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.645848 31603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:34.646469 31603 raft_consensus.cc:606] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.646826 31603 raft_consensus.cc:614] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:34.648298 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 188627us
W20260709 13:16:34.649662 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 254069us
I20260709 13:16:34.650611 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.636535  3716 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.651221 30996 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:34.656123 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.657135 31571 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:34.660823 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:34.665586 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 371308us
I20260709 13:16:34.666889 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.636802  3961 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:16:34.670516 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 294986us
I20260709 13:16:34.621341  3951 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:34.666782 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 305576us
W20260709 13:16:34.680030 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 361962us
I20260709 13:16:34.687325 30956 raft_consensus.cc:1240] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:34.693538 30956 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:34.718160 31605 raft_consensus.cc:1275] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:34.674026  3643 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:34.676085  3921 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.721952 31597 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:16:34.732810 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:34.737401 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 418157us
I20260709 13:16:34.674700  3961 consensus_queue.cc:1243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 74f5a5b7556240508983221981af4ab4 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:34.716965  4001 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:34.739359 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 72557.4us
I20260709 13:16:34.720786  3960 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:34.668588  3994 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.742022 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.743467 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.746115 31603 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:34.688653  3644 consensus_queue.cc:1059] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:16:34.685909  3848 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:16:34.746235 31600 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
W20260709 13:16:34.751585 31571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.752116 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.734565  3643 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:34.739636  3946 raft_consensus.cc:2804] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:34.686064  3720 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:16:34.748642 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:34.757292 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.762696 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.763188  4007 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:34.763944 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.758628 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:34.690033  3938 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.720995  3716 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.730553  3921 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:34.764478  4006 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:34.772715 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.765599 30998 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:34.762367 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:34.780748  3960 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:34.781144  3960 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.781486  3960 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:34.745126  4004 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:16:34.787020 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.787174  3409 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:34.787634  3927 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:34.787863  3991 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:34.788072  3409 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:34.788365  3991 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:34.788434  3927 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:34.788781  3643 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.789235  3927 consensus_queue.cc:1048] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:34.789434  3991 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.791020 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:34.771736  3946 raft_consensus.cc:697] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:34.795845 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.756265  3988 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:16:34.790693  3671 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:34.798049  4014 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.798416  3991 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.803982 30952 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:16:34.809176 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.824029 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.824229 30956 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:34.787236  4003 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:34.826021  4003 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:34.826414 30950 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [11.9-12.10]
I20260709 13:16:34.826474  4003 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:34.818243 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.827947 30949 raft_consensus.cc:2393] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:34.827409  3946 consensus_queue.cc:237] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.814379 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.823161  3935 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.828981  3921 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.830572 30958 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:34.795416  3990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.011s
W20260709 13:16:34.835258 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 56083.3us
W20260709 13:16:34.820266 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 61090.8us
I20260709 13:16:34.821266  4016 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:34.821780  4014 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.823310  3994 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:34.825520  4004 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:16:34.836455 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 120529us
I20260709 13:16:34.838640 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:34.842253  4016 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:34.852202 31605 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:34.843286 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:34.814296  3671 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:34.833959  3990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.003s	sys 0.012s
W20260709 13:16:34.850021 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.849748 30997 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:34.855055 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:34.855214 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:34.830369  3935 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.854215 30922 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:34.851274  4004 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:34.869014 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.876639 30875 raft_consensus.cc:1240] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:34.878633 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.879567  3716 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.880147  3716 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:34.880918  3960 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.883140  3960 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:34.867302  3825 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:34.883917  4014 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.884445  4018 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:16:34.848152  4011 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:34.860904  3671 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:34.852945  4016 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.920547  3938 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.921722  4004 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.923180  4021 consensus_queue.cc:1048] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:16:34.876366  3921 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:34.924340  3921 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.924786  3921 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:34.924939  4008 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:16:34.926414  4003 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:34.885838  3983 consensus_queue.cc:1059] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.171s
I20260709 13:16:34.876596  3924 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:34.924796  4020 consensus_queue.cc:1175] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95b998a6735f4180986a8b8f7d84b8fc" responder_term: 16 status { last_received { term: 16 index: 13 } last_committed_idx: 12 last_received_current_leader { term: 16 index: 13 } }
I20260709 13:16:34.930186 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:34.930943  4019 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:16:34.912115 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.912914 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:34.913528 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45169.9us
I20260709 13:16:34.912065 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.920680  4016 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:34.936215 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 58900us
W20260709 13:16:34.940322 30923 leader_election.cc:336] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.632s (SENT)
I20260709 13:16:34.944710 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:34.946302 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:34.948345 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:34.948593 30876 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:34.927878  3924 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:34.937754  3471 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.951180 30923 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.952123 30957 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:34.952708 31604 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:34.947531  3990 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.958168 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.962983 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.964355 31031 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:34.968494 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.939018  3644 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:34.943373  3938 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:16:34.952597  3924 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:34.977074 30998 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:34.978495 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.979833 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:34.980633 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:34.984875 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:34.990237 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:35.001281 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.001040  3720 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:35.002023 30949 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.001040 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.003293 30955 raft_consensus.cc:2368] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
W20260709 13:16:35.003506 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 69354us
I20260709 13:16:35.001302 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.000872 30998 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:34.944342  3409 consensus_queue.cc:1059] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:16:35.004722 31031 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:34.995348 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.005407 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:34.970043  3946 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:34.969897  3935 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:35.013986  3825 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:34.982419  4018 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:35.047397  3951 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:34.999321  3994 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:34.958992  3666 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:16:35.020505  3989 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.023556 30949 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:35.024806 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:35.025087  3810 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.025990  3448 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:35.027969  3622 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:34.996227  3990 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:35.032486  4032 log.cc:927] Time spent T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:34.964326  3471 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.034619 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:35.080014 30951 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.080597 30951 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:35.035943 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.082136 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:35.083467 31026 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:35.040531  3971 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.042466 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.085719 30956 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:35.085903 30881 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:35.044844 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.046342 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.010601  4021 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:35.007668  3845 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.059162 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.061437 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.064518 31598 raft_consensus.cc:1217] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[10.10-13.12]   Dedup: 10.10->[12.11-13.12]
W20260709 13:16:35.066205 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.066592 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.007359  4012 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:35.068336 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.147460 31603 raft_consensus.cc:3060] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:35.074007 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 49310.6us
I20260709 13:16:35.079504  4003 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:35.080919  3990 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.087209 31024 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:35.098130 31601 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
W20260709 13:16:35.149904 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 144552us
I20260709 13:16:34.986436  3644 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:35.137770 30922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.157662 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.146027 31023 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:35.098256 31598 pending_rounds.cc:85] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 10
I20260709 13:16:35.158680 31598 pending_rounds.cc:107] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:16:35.159010 31598 raft_consensus.cc:2889] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:35.159647 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 71681.3us
I20260709 13:16:35.149864 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.151683 30923 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.075354  4018 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:16:35.075592  3622 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.076102  3448 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:35.156170 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 71044us
I20260709 13:16:35.164932 31570 leader_election.cc:400] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:35.171859 31570 leader_election.cc:403] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:35.166307 31601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:35.172650 31601 raft_consensus.cc:606] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:35.173137 31601 raft_consensus.cc:614] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:35.092476  4021 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:35.184269 31026 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:35.172307 30996 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.220423 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:35.222263 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 50056.4us
I20260709 13:16:35.075125  3989 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.219890 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:35.171155  3622 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.176421  3938 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:35.181257  4021 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.256106 30883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34340
I20260709 13:16:35.267545 30883 raft_consensus.cc:606] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Received request to transfer leadership
I20260709 13:16:35.084143  3807 consensus_queue.cc:260] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.219396  3990 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:35.225044  3810 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:35.277843 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51215us
I20260709 13:16:35.180577  3409 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.228338  4031 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:35.166719  3994 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:16:35.271273 31596 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.232931  3710 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:35.256008  3740 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:35.283923  3740 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.286430  3740 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:35.287911 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.227969  3845 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.288512  3671 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.290571  3845 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.290822  3671 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.291288 30954 raft_consensus.cc:2393] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:35.292658  3807 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.168853  4012 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.239459  3971 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:35.299361 31596 raft_consensus.cc:2410] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:16:35.306842 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 132347us
I20260709 13:16:35.307910 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.309247 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:35.312309 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 88757.2us
I20260709 13:16:35.313410 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.313997 31599 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.319568 31605 raft_consensus.cc:1240] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:16:35.278246  3810 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.321892 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:35.333302 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.323989  3622 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.238667  4023 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
W20260709 13:16:35.328260  4037 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:35.306654  3971 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:35.335176 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 2060) took 1015 ms. Trace:
I20260709 13:16:35.346371 30958 rpcz_store.cc:276] 0709 13:16:34.319630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.519670 (+200040us) service_pool.cc:224] Handling call
0709 13:16:34.520018 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.830942 (+310924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.334943 (+504001us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540027f454. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:35.335114 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713815936}
I20260709 13:16:35.342206 30881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:35.347754 30881 raft_consensus.cc:606] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
W20260709 13:16:35.344523 30848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.130:46199 timed out after 1.891s (SENT) [suppressed 10 similar messages]
I20260709 13:16:35.350186 30996 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.332814  3810 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.296190  3409 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:35.352342 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 44545.5us
I20260709 13:16:35.367983 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.308741  3938 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.370271 30879 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:16:35.370625 30879 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:35.371191  3409 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.371409  3938 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.313056  3710 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.372043 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.372632 30958 raft_consensus.cc:2376] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14. Re-sending same reply.
I20260709 13:16:35.373320  3710 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.374815 31603 raft_consensus.cc:2468] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:35.353783  3921 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.376036  4002 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:35.356350  4012 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:35.357694  4011 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.360545  3644 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:35.332351  3666 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:16:35.332476  3935 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:35.364315 31599 raft_consensus.cc:2468] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:35.335597  3896 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:35.414886  3896 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.417627  3896 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.376816 30952 raft_consensus.cc:2368] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14.
I20260709 13:16:35.418896  3666 raft_consensus.cc:3055] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:35.419350  3666 raft_consensus.cc:740] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
W20260709 13:16:35.296160  3961 consensus_queue.cc:1175] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "95b998a6735f4180986a8b8f7d84b8fc" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:35.378023  3921 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.355082  3622 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:35.380280 31597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:35.420917 31597 raft_consensus.cc:606] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:35.421278 31597 raft_consensus.cc:614] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:35.380743 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:35.422801 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.422981  4004 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.383898  4041 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:35.384968  3924 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.427057  3924 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.376058 30922 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.427950 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:35.386466  3996 raft_consensus.cc:3055] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:35.429993  3996 raft_consensus.cc:740] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:35.430920  3996 consensus_queue.cc:260] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.432022  3996 raft_consensus.cc:3060] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.436137 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.436859 31599 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:35.436957 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.437403 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.349112  3971 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.437881 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.436538  4021 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.438748 31599 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 16: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:35.434553  3810 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:35.440800  4035 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.358s	user 0.000s	sys 0.003s
I20260709 13:16:35.441992  3810 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.444207 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.444792  4021 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:35.399556  3989 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:35.401227 30923 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:35.446291 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45184.7us
I20260709 13:16:35.447028 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.447751  4016 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:35.404220 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.448091 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.448401  4016 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:35.408033 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 57921.9us
I20260709 13:16:35.371312 30879 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.425026 31028 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:35.449574 30879 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:35.449836 31025 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:16:35.453575 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77601.8us
I20260709 13:16:35.455251 30922 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.445443 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.456796 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.457351 31604 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 17: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:35.457381 31599 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.459955 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.460579 31603 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.461982 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.462069 31570 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.462646 30953 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.463315  4041 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:35.463817 30957 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [11.9-12.10]
I20260709 13:16:35.462678 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:35.445441  4034 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:16:35.448143 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.425076 31024 raft_consensus.cc:1240] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:35.472539 31597 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:35.472692 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.465591 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:35.471611 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:35.477339 31024 raft_consensus.cc:3060] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:35.484558 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:35.411150  4031 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:35.413394  4011 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.486980 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.504684 31599 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:35.505349 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.506062 31601 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:35.507682 31605 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:35.471294  3921 raft_consensus.cc:2804] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:35.512065 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:35.510569 30922 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.489049 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:35.491894 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 43808.3us
I20260709 13:16:35.495147 31604 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:35.513979 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.495937 31597 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:35.514243 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.499408 30879 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:16:35.499995 31600 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:35.509116 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.507704 31028 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:35.487537 30997 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:35.476784  4020 raft_consensus.cc:2804] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:35.488116 30949 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:35.516716 30879 pending_rounds.cc:85] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 11
I20260709 13:16:35.512887 30950 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:35.511525 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:35.508596 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.524940 30877 raft_consensus.cc:2393] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:35.525022 30879 pending_rounds.cc:107] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:16:35.487140  4002 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:35.525820 30879 raft_consensus.cc:2889] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.532567 31603 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:35.537082 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.541936 30922 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.543030  4014 raft_consensus.cc:2804] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:35.543701  4014 raft_consensus.cc:697] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:35.544937  4014 consensus_queue.cc:237] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.540740 30923 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.480125  3896 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:16:35.520332  3887 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:35.481267  4041 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:16:35.560833 30953 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:35.526721  3810 raft_consensus.cc:2804] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:35.527294  3969 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:35.500341  3938 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:16:35.540277  3925 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:16:35.536743  3921 raft_consensus.cc:697] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:35.528919  3983 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:16:35.589670 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 80636.8us
I20260709 13:16:35.574127 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.538506  3935 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:35.577453 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 84511us
I20260709 13:16:35.566701  3990 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.577688 30997 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.559526 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.534602  4020 raft_consensus.cc:697] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:35.604894  4020 consensus_queue.cc:237] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.577756  4002 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:35.537317  4021 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:35.563942  3887 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:35.608839  3887 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:35.537673  3970 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:16:35.598259  4042 log.cc:927] Time spent T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:35.600296  3938 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:35.600941 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.601536  4041 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:35.603413  3971 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.576983  3810 raft_consensus.cc:697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
W20260709 13:16:35.565603 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 44720.2us
I20260709 13:16:35.589457  4005 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:35.572880  4030 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:35.661144 30997 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:35.654888 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 114207us
I20260709 13:16:35.655507 30877 raft_consensus.cc:1240] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:35.664309 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.565781  4046 consensus_queue.cc:1059] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:16:35.584722  3931 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:16:35.672808 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 112119us
I20260709 13:16:35.678750 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:35.629645  3938 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:35.681393 30997 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.647625  3989 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:35.684604 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:35.609081  3448 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.659153  4021 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:35.658923  3969 raft_consensus.cc:2804] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:35.713613 31570 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.713891 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:35.691334 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 149473us
I20260709 13:16:35.692827 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.613109  3710 consensus_queue.cc:1059] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:16:35.596272  4057 consensus_queue.cc:1048] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.087s
I20260709 13:16:35.655848  4005 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:35.720909 30924 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:35.689860  4023 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.703289  3671 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:35.705324  3151 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:35.712024 31026 pending_rounds.cc:85] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 11
W20260709 13:16:35.717285 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 65896.2us
I20260709 13:16:35.693761  3934 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:35.680588  3970 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:16:35.648315  3990 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.677538  4031 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:16:35.725306 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.720332 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:35.731388 31026 pending_rounds.cc:107] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:16:35.737362 31026 raft_consensus.cc:2889] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.719642  3448 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:35.702250  4021 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:35.742529 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.698484  3921 consensus_queue.cc:237] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.723114  4005 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:35.730687  3622 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:35.731549  3969 raft_consensus.cc:697] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:35.747153  3983 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:35.731993  4014 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:35.773126 31024 raft_consensus.cc:2468] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:35.723309  4010 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:35.750666 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.746073 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.754556  3994 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:16:35.736282  3934 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:35.745332  3810 consensus_queue.cc:237] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.762156  4016 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.750618  3825 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:35.749255 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 93010.6us
I20260709 13:16:35.775933 31570 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:35.760125  4059 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:35.752467  3622 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:35.745414  3988 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:35.746223  3931 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:35.731345  4023 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.751366  3151 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:35.830416 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.770247  3671 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.830211 30848 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:35.851676  3671 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:35.853735 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.854240  3671 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:35.848455 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:35.851018  4048 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.852188  3896 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:35.755277  4041 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:16:35.840435 30953 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:16:35.833362  4045 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:16:35.859805 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.833225  4030 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.842558  4059 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.877065 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.845028  4016 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:35.884078 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 108218us
I20260709 13:16:35.846081  3994 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.885805  4078 raft_consensus.cc:2804] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:35.886363  4030 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.881726  4050 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:35.888326  3785 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:35.849992  3931 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.916216  3151 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.873899  4045 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.903915 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:35.882484  3988 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:35.907694 30778 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 12, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 12 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.912348 30949 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:35.882395  4059 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.875547  3896 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:35.907684 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:35.912750  3740 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:35.872319  4048 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:35.933799  4067 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:16:35.934453  4048 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:35.928784 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:35.935315 31032 raft_consensus.cc:3060] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:35.838195  4021 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.930616 31024 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 19.
I20260709 13:16:35.916250  3931 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:35.940512  4070 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:35.944360  3896 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.950278 31032 raft_consensus.cc:2468] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:35.956490  3471 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:35.958163  3644 raft_consensus.cc:993] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:35.958735 30957 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:35.970584  3644 raft_consensus.cc:1081] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:35.971297 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:35.973017 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:35.973660 30957 raft_consensus.cc:2468] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:35.965636  3666 consensus_queue.cc:260] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:35.921008  4045 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:35.969604 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:35.966005  3990 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:35.976390 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:35.906862  3994 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:35.975667 31032 raft_consensus.cc:2393] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 11: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:16:36.014691 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 131892us
I20260709 13:16:36.015959 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:35.892392  3969 consensus_queue.cc:237] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.037693 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:36.081585 31603 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:36.078394 30875 raft_consensus.cc:2376] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12. Re-sending same reply.
I20260709 13:16:36.085971 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.089740 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:35.931183  3988 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.095633 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:36.096973 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.081713  3448 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.080713  4046 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:36.094945  3968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.025s
I20260709 13:16:36.146930 30879 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:36.080880  3924 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:35.926570  3934 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.135529 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:36.153224 30877 raft_consensus.cc:2368] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:36.087637  3927 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:36.154356  3927 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.136920 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.158703 30953 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:36.160044 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.161357 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.162030 30953 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:35.978552  3887 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.166421  3887 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.167587 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.168291 31032 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
W20260709 13:16:36.141214  4004 consensus_meta.cc:287] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.000s
W20260709 13:16:36.171156 30768 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 211118us
I20260709 13:16:35.974828  3622 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.178907 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.183555 31603 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:16:36.186321 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.146353  3968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.001s	sys 0.025s
I20260709 13:16:36.189379 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.193476 30882 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:36.147450  4078 raft_consensus.cc:697] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:36.101228  3720 consensus_queue.cc:1059] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:16:36.170710  3927 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.202548 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.203799 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.206111 31571 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:36.208683  3946 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:36.210827 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.184067 31597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54194
I20260709 13:16:36.217618 31597 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.218116 31597 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:36.220436 30848 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:36.226261 31032 raft_consensus.cc:1240] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:36.229907 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.230870 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:36.233155 31028 raft_consensus.cc:2393] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 12: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:36.234483 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:36.188316  3924 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.169670  4046 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:36.257477 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.203121  3887 consensus_queue.cc:1059] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:16:36.212586  4077 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.261909 31571 leader_election.cc:400] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:36.271728 31571 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:36.222728  4076 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.222237  4016 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.234074  3925 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:36.233536  3968 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.233019  4018 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:36.278223 31597 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.315409 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.324476 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:36.347540 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.266252  4041 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.350663  4080 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.354697  4080 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.357517  4082 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.363965 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.311825  4016 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.360037 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.300379  4030 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.323186  3946 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.364645 30877 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:36.273422  3935 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.313031  3887 raft_consensus.cc:3055] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:16:36.372790 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 47719.7us
I20260709 13:16:36.320245  4076 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.392679 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:36.393613 30881 raft_consensus.cc:3055] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:36.394009 30881 raft_consensus.cc:740] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:36.400826  4046 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.402653 30922 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:36.416693 30957 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:36.418013 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.376358  4016 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.377182  3887 raft_consensus.cc:740] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:36.379959  3994 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.330440  3968 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.437068  3825 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.280790  4077 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.428159 30881 consensus_queue.cc:260] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 6, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.449898 30881 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:36.419098  3946 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:36.380040  3935 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.454185 30877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34340
I20260709 13:16:36.437278  3921 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:36.426183  3988 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.322750  4078 consensus_queue.cc:237] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.460126 30957 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 17. Current term is 18. Ops: []
W20260709 13:16:36.471403 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 119185us
I20260709 13:16:36.470554  3935 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.481213 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:36.489777 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:36.395993  4082 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.490566 31571 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:36.493954  3924 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.454599  3825 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.467453  4075 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.536110 31027 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:36.459201  4018 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:36.501447  4095 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:36.507324  4084 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.546401 30953 raft_consensus.cc:1240] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: []
W20260709 13:16:36.510969  4053 log.cc:927] Time spent T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.798s	user 0.001s	sys 0.001s
I20260709 13:16:36.512398  3921 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:36.513895  4099 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:16:36.514104  4055 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.846s	user 0.001s	sys 0.001s
I20260709 13:16:36.461220  3946 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.516808 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.517292  4016 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:36.519052  4011 consensus_meta.cc:287] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.993s	user 0.012s	sys 0.001s
I20260709 13:16:36.520219 31597 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.520843  4077 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.522751  3968 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:36.523823  4052 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.822s	user 0.001s	sys 0.001s
I20260709 13:16:36.525360  3825 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.525072  3938 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.459627  3887 consensus_queue.cc:260] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:36.519045 30954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44258 (request call id 1152) took 1705 ms (client timeout 1834 ms). Trace:
I20260709 13:16:36.528802 31601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54194 (request call id 1419) took 1093 ms. Trace:
I20260709 13:16:36.532063  4074 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:36.544064 30881 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
I20260709 13:16:36.497077  4092 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:36.537309  3622 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:36.567837  3622 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.568265  3622 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.544866  4041 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:36.544754  3671 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:36.572165  3671 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.573238 30951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2476) took 1270 ms. Trace:
I20260709 13:16:36.574110 31596 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:36.562357 31601 rpcz_store.cc:276] 0709 13:16:35.435114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.473840 (+ 38726us) service_pool.cc:224] Handling call
0709 13:16:35.505815 (+ 31975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.506569 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.528610 (+1022041us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54005c4750. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:36.528743 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72805248}
I20260709 13:16:36.564635 30877 raft_consensus.cc:606] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Received request to transfer leadership
I20260709 13:16:36.578002 30877 raft_consensus.cc:614] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:36.579133 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:36.561652 30954 rpcz_store.cc:269] 0709 13:16:34.813256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.814147 (+   891us) service_pool.cc:224] Handling call
0709 13:16:36.518840 (+1704693us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540024bb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:36.518987 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062996224}
I20260709 13:16:36.580322 31023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2444) took 1406 ms. Trace:
I20260709 13:16:36.581022 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:36.581820 30954 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:36.581444  4018 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.584705  3938 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.549456  4084 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.544638  4075 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.589308  4084 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.589941  4076 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:36.593364 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.594254 31028 raft_consensus.cc:2393] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:36.553881  3921 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.602977 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:36.605136  4092 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:36.607240 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.607280  4047 raft_consensus.cc:3055] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:36.608736  3960 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:36.609010  4047 raft_consensus.cc:740] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:36.609139  3960 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:36.609977  3960 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.611138  3960 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:36.609977  4047 consensus_queue.cc:260] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.613268  4057 raft_consensus.cc:993] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:36.573621 30951 rpcz_store.cc:276] 0709 13:16:35.303171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.303406 (+   235us) service_pool.cc:224] Handling call
0709 13:16:35.318248 (+ 14842us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:35.336045 (+ 17797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.336077 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:35.352135 (+ 16058us) log.cc:844] Serialized 52 byte log entry
0709 13:16:35.555864 (+203729us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:35.555905 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.555974 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.523068 (+967094us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:36.572932 (+ 49864us) raft_consensus.cc:1685] finished
0709 13:16:36.572952 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.573181 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12184,"raft.queue_time_us":19042,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":7039,"spinlock_wait_cycles":10052992,"thread_start_us":201347,"threads_started":1,"wal-append.queue_time_us":259571}
I20260709 13:16:36.614050  3951 raft_consensus.cc:1081] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:36.615041 30951 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:16:36.615418 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:36.616283  4061 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:36.616667  4061 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.617019  4061 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.563796  4074 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:36.618356  4074 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.620074  4074 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.621824 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.574353  3671 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.633358 30955 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [11.9-12.10]
I20260709 13:16:36.634503 31596 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:16:36.634410 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:36.595110 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.643198 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.580754 31023 rpcz_store.cc:276] 0709 13:16:35.173644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.233477 (+ 59833us) service_pool.cc:224] Handling call
0709 13:16:35.262736 (+ 29259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.269557 (+  6821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.269597 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.316577 (+ 46980us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.535895 (+219318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:35.535970 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.536031 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.513406 (+977375us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:36.580008 (+ 66602us) raft_consensus.cc:1685] finished
0709 13:16:36.580032 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.580258 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101413120,"thread_start_us":206245,"threads_started":1,"wal-append.queue_time_us":262824}
I20260709 13:16:36.647933 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.648257  3845 raft_consensus.cc:3055] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:36.650910 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.651283 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:36.652060 31025 raft_consensus.cc:3060] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:16:36.652765 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.648676  3845 raft_consensus.cc:740] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:36.660099 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.662928 30881 raft_consensus.cc:1275] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:16:36.664393  4020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.000s	sys 0.018s
W20260709 13:16:36.666409  4020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.001s	sys 0.019s
I20260709 13:16:36.667673  4075 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:36.672969 30958 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:16:36.674413 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.680248 30951 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:36.651225  4044 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:36.561717  4011 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.684088 31031 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:36.684979 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.685484 31028 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:36.686317 31023 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:36.687480 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2475) took 1447 ms. Trace:
I20260709 13:16:36.687995 30956 rpcz_store.cc:276] 0709 13:16:35.239961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.263133 (+ 23172us) service_pool.cc:224] Handling call
0709 13:16:35.263493 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.263941 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.263983 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.264556 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.532043 (+267487us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:35.532078 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.532147 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.510316 (+978169us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:36.682279 (+171963us) raft_consensus.cc:1685] finished
0709 13:16:36.682309 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.687402 (+  5093us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15665,"raft.queue_time_us":3257,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7518,"spinlock_wait_cycles":10379008,"thread_start_us":225864,"threads_started":1,"wal-append.queue_time_us":371328}
I20260709 13:16:36.691579 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.645097  4012 consensus_queue.cc:1059] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:16:36.662324  3921 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:36.702744 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 86033.7us
I20260709 13:16:36.708961 31028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:16:36.709517 31028 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.709846 31028 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.658126  4048 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:16:36.673811  3925 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:16:36.724195  3505 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.724846  3505 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.714131  3951 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:16:36.727192  3505 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:36.730904  4005 consensus_meta.cc:287] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Time spent flushing consensus metadata: real 0.952s	user 0.009s	sys 0.002s
I20260709 13:16:36.714387  3845 consensus_queue.cc:260] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.733165  3845 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:36.734771  3971 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:36.735752 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.727205 30983 heartbeater.cc:646] Failed to heartbeat to 127.29.5.190:37151 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.29.5.190:37151 timed out after 15.000s (SENT)
I20260709 13:16:36.724350 31029 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:36.740664 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.740288 30778 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:36.742365  3946 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:36.741981 30778 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 13, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:36.742915  3946 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.743391  3946 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.744482  4082 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:36.745992  3946 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:36.747618 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.748245  4075 consensus_queue.cc:1048] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:36.748807 31023 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 11.
I20260709 13:16:36.750530 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:36.751595  4090 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:36.752161  4090 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.752596  4090 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:36.754323 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.754609  4059 consensus_meta.cc:287] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.790s	user 0.000s	sys 0.010s
I20260709 13:16:36.754992  4059 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.755725 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.761943 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.762693 30951 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:36.761245  3971 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:36.764261 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.764529 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.764835 31604 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:36.764880 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.764066  3971 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.767333  3971 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.761267  4011 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:36.769901  3931 consensus_meta.cc:287] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.800s	user 0.004s	sys 0.005s
I20260709 13:16:36.775635 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.776341 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.776434 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.777405 30956 raft_consensus.cc:1240] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:16:36.778268 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:36.780992 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.781243 30954 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
I20260709 13:16:36.782568 30957 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:36.795787 31601 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:36.780220 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:36.788784 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.731539  4005 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.743476 30778 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:36.813954 30881 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:36.814350 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:36.817447 31604 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:36.821678 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:36.822888 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:36.827045 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.829933 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.831071 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.831670 30878 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:36.832458 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.832989  4059 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.833774 30878 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:16:36.836337  4045 consensus_meta.cc:287] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
I20260709 13:16:36.836797  4045 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.818750  4011 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:36.849282 30998 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:36.838990  4045 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:36.853330 30882 raft_consensus.cc:1240] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:36.852818 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.855131 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:36.858366 31025 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
W20260709 13:16:36.846628  4115 log.cc:927] Time spent T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:16:36.812114  3409 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:36.864758 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:36.862527 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:36.872169 30880 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:36.798660  3622 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.886562  3151 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:36.887416  3151 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:36.887807  3151 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:36.888799  3938 raft_consensus.cc:3055] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:36.888629  3151 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.889153  3938 raft_consensus.cc:740] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:36.889791  3151 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.890043  3938 consensus_queue.cc:260] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.891206  3938 raft_consensus.cc:3060] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.895269  4023 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:36.881400 30998 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:36.853879  3983 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:36.898869 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:36.860816  4075 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.799325  3931 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:36.874054  3924 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.835602  4061 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.871675  3409 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:36.914695 31597 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:36.880017  4021 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.914108 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:36.864292  4011 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:16:36.866534  3716 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:16:36.922456 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:36.928310 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.912191  4076 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:36.917601  3924 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.933544  3924 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.934661 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 2918) took 1183 ms. Trace:
I20260709 13:16:36.934962 31030 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:36.935048 31024 rpcz_store.cc:276] 0709 13:16:35.751076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.790465 (+ 39389us) service_pool.cc:224] Handling call
0709 13:16:36.934470 (+1144005us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b54000c44d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:36.934582 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186024832}
I20260709 13:16:36.936627 31030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 966) took 1975 ms. Trace:
I20260709 13:16:36.939724 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:36.940580 30998 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:36.940171 31028 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.937002 31030 rpcz_store.cc:276] 0709 13:16:34.961008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.961136 (+   128us) service_pool.cc:224] Handling call
0709 13:16:36.517828 (+1556692us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b5800173d98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc720ab 00007f273fc72131 00007f273fc33fc0 00007f273fc1e929 00007f273fc1e3d2 00007f2739195bd4
0709 13:16:36.934605 (+416777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.935451 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.936449 (+   998us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000c44d0. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:36.936573 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965919744}
I20260709 13:16:36.943440 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.944278 30954 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:36.917750  3409 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:36.948102 30954 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:36.953480 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.954111 30956 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:36.950460 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:36.950623 30998 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:36.930130  3983 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:16:36.989825 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.990396 31028 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:36.991251 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:36.992133 30876 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:36.992486 30876 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:36.994272 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:36.994846 31601 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.918629  4075 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.996953 30956 raft_consensus.cc:1240] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:36.929863  3970 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:16:36.956894  3968 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:36.956719  4060 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:16:37.003533 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:36.998112 30876 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:36.988994  4070 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:36.965605  3983 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.009050 30922 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.015460 31601 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:37.016922 30996 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:37.017220 30955 raft_consensus.cc:1240] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:16:37.020720 30922 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.024582 30955 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:16:37.009270  4070 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.007515  4060 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:37.027801 30922 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.011683  3983 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.028028  3971 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.036828 31601 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:37.031788 30958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51648 (request call id 2479) took 1618 ms. Trace:
I20260709 13:16:37.037765 30958 rpcz_store.cc:276] 0709 13:16:35.413939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.414112 (+   173us) service_pool.cc:224] Handling call
0709 13:16:36.520586 (+1106474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.673363 (+152777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.030858 (+357495us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540024bb54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:37.031539 (+   681us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540024bb50. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac598ad 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:37.031692 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878673024}
W20260709 13:16:37.033629 30952 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51636 (request call id 2061) took 2157 ms (client timeout 1741 ms). Trace:
W20260709 13:16:37.040174 30952 rpcz_store.cc:269] 0709 13:16:34.876584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.876817 (+   233us) service_pool.cc:224] Handling call
0709 13:16:37.033416 (+2156599us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b540008b6d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:37.033540 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960971136}
I20260709 13:16:37.020819  3968 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:37.038421 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.008515  3922 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:37.027248  4011 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.036850  4020 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.035686  4070 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.035526  4060 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:37.053658 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:37.041018  4005 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:37.065773  4023 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:37.072185  4023 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.072961  4080 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:37.065768  4076 consensus_queue.cc:1059] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:16:37.074150  3931 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:37.074235  3716 raft_consensus.cc:3055] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:37.074766  3716 raft_consensus.cc:740] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:37.075664  3716 consensus_queue.cc:260] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.076984  3716 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.078053  4061 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.080178 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:37.080807 31604 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.047829  3810 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:16:37.088433  3622 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:37.091666 30950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51636 (request call id 2069) took 1342 ms. Trace:
I20260709 13:16:37.037333  4090 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.092133 30950 rpcz_store.cc:276] 0709 13:16:35.748997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.749153 (+   156us) service_pool.cc:224] Handling call
0709 13:16:35.749638 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.776362 (+ 26724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.776392 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.622001 (+845609us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b2c00046bc8. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:16:36.622366 (+   365us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.922027 (+299661us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:37.056550 (+134523us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.057027 (+   477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.057099 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.091368 (+ 34269us) raft_consensus.cc:1685] finished
0709 13:16:37.091467 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.091607 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6501,"raft.queue_time_us":12080,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":185,"spinlock_wait_cycles":33791360,"thread_start_us":411835,"threads_started":2,"wal-append.queue_time_us":389523}
I20260709 13:16:37.094000  4090 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:37.095306  4075 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:37.100432 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.103390 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:37.103778 30952 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:37.104058 30954 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.105924 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.106552 30956 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:37.065894  3968 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:37.115885 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:37.132040 30996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.134366 31604 raft_consensus.cc:2468] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:37.142417 30954 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:37.135908 30922 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:37.154531 31569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.160310 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:37.164547 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:37.114719  3960 consensus_meta.cc:287] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.008s
I20260709 13:16:37.186484 31596 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:16:37.187047 31596 pending_rounds.cc:85] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Aborting all ops after (but not including) 9
I20260709 13:16:37.187325 31596 pending_rounds.cc:107] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:16:37.187609 31596 raft_consensus.cc:2889] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:37.192129  4128 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:16:37.185483  3990 raft_consensus.cc:2804] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:37.194793  3990 raft_consensus.cc:697] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:37.195662  3990 consensus_queue.cc:237] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:37.209802 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.244150 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:37.248088 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:37.248555 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.248766 30952 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:37.249152 30955 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:37.250027 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.250789 30955 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:16:37.204057  3968 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.253389 30951 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:37.248093 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:37.254496 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.263437 30950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.271162 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:37.272126 30955 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:37.271270 30952 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
I20260709 13:16:37.276160  4060 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.276420  3409 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.280514 30954 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 20 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:16:37.281383 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:37.282016 31028 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:37.282512 31570 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:37.283663 31023 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:37.287109 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.287832 31570 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:37.291138  4060 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 20 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.291394  3960 raft_consensus.cc:2804] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:37.281710  4005 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.298043 30921 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.287151  3622 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:37.300383 31570 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:37.295861  3960 raft_consensus.cc:697] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:37.309818  3960 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.308729  4080 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:16:37.316372  4080 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:37.317498  4080 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:37.318125  4129 log.cc:927] Time spent T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.261s	user 0.004s	sys 0.006s
I20260709 13:16:37.318166  4080 consensus_queue.cc:1243] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer bda0856a7efd4d0e96615b66bef383c6 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:37.320691 31028 raft_consensus.cc:2468] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 20.
I20260709 13:16:37.322211 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:37.325697 31570 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.337001 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.341638 31570 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.292111  4070 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.301087  4075 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:37.323027  3622 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:37.349030  4047 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.343935  4018 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:37.352682  3983 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.345124  3471 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:37.347389  4048 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:37.340351  4080 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:37.373673  4080 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:37.374439  4127 log.cc:927] Time spent T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.319s	user 0.003s	sys 0.000s
I20260709 13:16:37.374629  4080 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.364630  3990 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.346735  4075 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.376199  3990 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.378337  3990 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.379106 31029 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:37.380249  4070 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:37.381842 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:37.382688 31023 raft_consensus.cc:2410] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:16:37.301379  4005 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:37.370401 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.371327 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44258 (request call id 1165) took 1176 ms. Trace:
I20260709 13:16:37.386943 30957 rpcz_store.cc:276] 0709 13:16:36.195203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.471172 (+275969us) service_pool.cc:224] Handling call
0709 13:16:36.492508 (+ 21336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.796949 (+304441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.371014 (+574065us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002b7d54. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:37.371237 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666411392}
I20260709 13:16:37.343204  3409 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:37.409512 31027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34930 (request call id 967) took 2448 ms (client timeout 1688 ms). Trace:
W20260709 13:16:37.410100 31027 rpcz_store.cc:269] 0709 13:16:34.961312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.961445 (+   133us) service_pool.cc:224] Handling call
0709 13:16:37.409316 (+2447871us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001b1cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5e2fa 00007f273fc1fb17 00007f273919a6d4 00007f273919a662 00007f273919a591 00007f273919a50c 00007f27391997c2 00007f2738f9548c 00007f2738f948c6 00007f2738f9426f
0709 13:16:37.409415 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738607360}
I20260709 13:16:37.417984  4023 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.422050 30923 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:37.422735  4119 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:37.423918  4119 raft_consensus.cc:2804] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:16:37.424373  4119 raft_consensus.cc:697] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 20 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:37.425268  4119 consensus_queue.cc:237] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:37.372650 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.363999  3622 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.433140 31029 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:37.369593  3921 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:37.435810  3921 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:37.436627  3921 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.437831  3921 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.438973 31030 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:37.388880 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.439343  4056 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:37.439854 30879 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.440441 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:37.389145  3983 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.392882  4005 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.392944 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.376226  4075 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.399502  3887 raft_consensus.cc:3060] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.440999 31023 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:37.449645 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.452116 30880 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.452951 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:37.450592  4070 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:37.469126 30879 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
W20260709 13:16:37.463290 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 184637us
I20260709 13:16:37.487154 31027 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:37.486831 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:37.490772 31028 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:37.468912  4056 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.994688 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.503715 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:37.503532 30778 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 11, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 11 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.480907  4070 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.549657 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:37.490417  3991 consensus_queue.cc:1059] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:16:37.568120 31026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36654 (request call id 2445) took 2358 ms. Trace:
I20260709 13:16:37.573266 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.575356 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:37.548204  4023 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:37.548863  3968 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:16:37.548043  4021 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.581573 31597 raft_consensus.cc:1240] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:37.580354 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:37.583140 30957 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:37.496605  4056 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.557636  3409 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.585407 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:37.583912  3960 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:37.586092 30953 raft_consensus.cc:3060] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:37.548339  3845 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:37.568744 31026 rpcz_store.cc:276] 0709 13:16:35.202603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.231783 (+ 29180us) service_pool.cc:224] Handling call
0709 13:16:35.258134 (+ 26351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:35.769400 (+511266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.769435 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:35.777963 (+  8528us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.091180 (+313217us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:16:36.091216 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.526354 (+1435138us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400378cd4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:37.547464 (+ 21110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.555474 (+  8010us) raft_consensus.cc:1685] finished
0709 13:16:37.555493 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.560850 (+  5357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":338,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":1043200256,"thread_start_us":245258,"threads_started":1,"wal-append.queue_time_us":786825}
I20260709 13:16:37.595496 31596 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:16:37.598933 30876 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:37.576637  4002 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.588404  4031 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:16:37.610954 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.616371 31597 raft_consensus.cc:1240] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:16:37.569011  4004 consensus_queue.cc:1059] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:16:37.582072  4023 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:37.627090 30876 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
W20260709 13:16:37.609268 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 242102us
I20260709 13:16:37.620800 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.621953 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.627947 30879 raft_consensus.cc:2368] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:16:37.628049 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.629281 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.586757  3960 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.582476  3720 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:16:37.630522 30882 raft_consensus.cc:2410] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:37.631597 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.636195 31570 leader_election.cc:400] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:37.636503 31570 leader_election.cc:403] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:37.636529 30879 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:37.637660 30879 raft_consensus.cc:1275] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:37.634085 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.590669  4021 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.645071 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.630107  4023 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.653831 30953 raft_consensus.cc:2468] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:37.641870  4045 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.655828 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.657227  3710 raft_consensus.cc:3055] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:37.657606  3710 raft_consensus.cc:740] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:37.658418  3710 consensus_queue.cc:260] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.659569 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.642204  4080 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:37.667724 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.668531 31024 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:16:37.669987 31024 pending_rounds.cc:85] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 10
I20260709 13:16:37.643831  3679 raft_consensus.cc:3055] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:37.669121 30880 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:37.670047 31026 raft_consensus.cc:1275] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:37.631736  4031 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:37.670249 31024 pending_rounds.cc:107] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 11.11
W20260709 13:16:37.670956 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 212557us
I20260709 13:16:37.677080 31024 raft_consensus.cc:2889] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:37.671602 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.619457  4002 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.639650  3471 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:37.676299 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:37.679204 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.681175 30949 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:37.671145  4139 log.cc:927] Time spent T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:16:37.685020 30847 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.647261  4004 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:37.693106 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:37.694281 30957 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:37.696363 30880 raft_consensus.cc:1275] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:37.675207  4008 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:37.700176 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:37.705331 31604 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.673034  3679 raft_consensus.cc:740] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:37.680814  4070 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.711653 31023 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:37.714834  4031 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.715807  3679 consensus_queue.cc:260] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.716639  4056 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.717257  3679 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:37.719024 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.719465  3960 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:37.719632 31605 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:37.721889  3927 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:37.725423  4144 log.cc:927] Time spent T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:37.737658 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:37.738504 31026 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:37.744114 31023 raft_consensus.cc:1240] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:16:37.746615 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.725943  3810 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.751016 31604 raft_consensus.cc:2468] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:37.753520 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:37.698065  4012 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:16:37.700608  4004 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.761570 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.726401  4008 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.781653 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.782086 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:37.793776 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 90805.5us
I20260709 13:16:37.795382 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:37.796124  4148 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:37.796275 30875 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:37.768126  4145 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:37.830543 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.806064  4150 raft_consensus.cc:3055] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:37.831723 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.832041 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.832929 30880 raft_consensus.cc:2410] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:16:37.833032 31599 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:37.808740  4002 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.810549 30778 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 13, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 13 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:37.788028  4143 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:16:37.814810  4146 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:37.837044 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:37.814954  4048 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:37.838191 30880 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:37.764768  3810 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.815734  4045 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:37.822075  4075 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.823526  3644 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:37.824226  4008 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:37.824678  3471 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:16:37.827067 30998 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:37.823529  4023 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.859706 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:37.862586  4075 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:37.830564 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.877694 30875 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:37.840579  3960 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:16:37.878173  4023 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:37.808897 31023 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:37.836582 30882 raft_consensus.cc:2368] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:37.839802 31026 raft_consensus.cc:2410] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:16:37.765323  3622 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:37.840849 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.882702 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.886287 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.849380 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.898243 30778 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:37.866375  3716 raft_consensus.cc:2804] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:37.900380 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:37.868237 31597 raft_consensus.cc:2393] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:37.852680  3644 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:37.839210  4018 consensus_queue.cc:1048] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:16:37.904197 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.873015  4021 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.875483  4059 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
W20260709 13:16:37.798744 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 110824us
W20260709 13:16:37.880560 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 121337us
I20260709 13:16:37.835561  4150 raft_consensus.cc:740] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:37.903455 30778 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 9, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 9 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:37.872910  3921 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.908950 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 95026us
W20260709 13:16:37.912153 30923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.916543 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:37.891150  3679 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:37.928469  3951 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:37.929790  3679 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:37.930778  3679 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:37.933954 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.927953 30880 raft_consensus.cc:2468] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:37.937951  4002 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:37.916345  3716 raft_consensus.cc:697] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:37.941039  3716 consensus_queue.cc:237] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:37.942335 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.943480 31601 raft_consensus.cc:2410] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:16:37.944613 30781 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 360) took 38187 ms (client timeout 15000 ms). Trace:
I20260709 13:16:37.949463  3810 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:37.902627  3409 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:16:37.950809 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:37.951577 31023 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:37.952140 31603 raft_consensus.cc:1275] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:16:37.957849 30922 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.926486 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:37.905545  3471 raft_consensus.cc:3055] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:16:37.964603 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.964562 30881 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:16:37.960719 31598 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:37.966979 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:37.968432  3951 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:37.968832  3951 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:37.969203  3951 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:37.969560 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.970502  3991 raft_consensus.cc:2764] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:16:37.971231 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:37.971828 31599 raft_consensus.cc:1240] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:37.960815 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:37.998257 30881 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:37.973014 30875 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
I20260709 13:16:37.999699 30778 catalog_manager.cc:5697] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 13, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:38.001958 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:38.002689 30875 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:37.962002  3990 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:37.960417  4075 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.008736 30778 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 10, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.013885 30875 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:37.998081  4048 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:38.017304  4048 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:38.017693  4048 raft_consensus.cc:3060] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.017935 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:38.018677  3622 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:38.018738  4154 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:38.021971 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:37.998793  4157 consensus_queue.cc:1048] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:16:38.022753  4154 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:37.974092  3471 raft_consensus.cc:740] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:38.025916  4159 consensus_queue.cc:1059] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:16:37.997133  4031 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:16:38.026402  4154 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:16:38.027623 30829 auto_rebalancer.cc:893] Removing replace marker failed: Replica 95b998a6735f4180986a8b8f7d84b8fc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:38.071765 30829 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:16:37.927292  4059 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:38.072081 30829 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:38.028587 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:38.014375  3644 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.023531  3810 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.002337  3991 raft_consensus.cc:2764] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:16:38.031499  4045 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:37.957459  3921 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.037499  4075 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.041252  4004 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:38.044603 31603 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:16:38.045142  4008 consensus_queue.cc:1059] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:38.052248 30778 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 15, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:38.055315 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.082818  4154 raft_consensus.cc:2764] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:16:38.090528  4075 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.086163  4076 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.091107 31601 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:38.091588  4076 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.093677  4076 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:38.094213  3921 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.095326 30778 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 15, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.097376 30778 catalog_manager.cc:5697] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 16 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:38.098868 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 43666.4us
I20260709 13:16:38.100232 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.059463 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:38.100950 30954 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:38.101442 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:38.101962 30955 raft_consensus.cc:3060] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:38.043678  4048 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.064960  3951 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:37.945169 30781 rpcz_store.cc:269] 0709 13:15:59.756637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.756819 (+   182us) service_pool.cc:224] Handling call
0709 13:16:37.944325 (+38187506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:30.343754 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:30.361369 (+ 17615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:30.361402 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:16:30.361418 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:30.384552 (+ 23134us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:30.384647 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:30.386158 (+  1511us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:16:30.455386 (+ 69228us) tablet.cc:701] Row locks acquired
0709 13:16:30.455409 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:16:30.455574 (+   165us) write_op.cc:270] Start()
0709 13:16:30.455694 (+   120us) write_op.cc:276] Timestamp: P: 1783602990455527 usec, L: 0
0709 13:16:30.455719 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:30.458108 (+  2389us) log.cc:844] Serialized 6701 byte log entry
0709 13:16:30.722861 (+264753us) op_driver.cc:464] REPLICATION: finished
0709 13:16:30.904631 (+181770us) write_op.cc:301] APPLY: starting
0709 13:16:30.909971 (+  5340us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:31.046401 (+136430us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:31.046527 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:31.330651 (+284124us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:31.330941 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:16:31.330987 (+    46us) write_op.cc:312] APPLY: finished
0709 13:16:31.331342 (+   355us) log.cc:844] Serialized 156 byte log entry
0709 13:16:31.332188 (+   846us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.340181 (+  7993us) write_op.cc:454] Released schema lock
0709 13:16:31.365653 (+ 25472us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:31.367090 (+  1437us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.367118 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2547375,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":158463,"apply.run_cpu_time_us":26646,"apply.run_wall_time_us":480571,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":346510,"prepare.run_cpu_time_us":19382,"prepare.run_wall_time_us":199721,"raft.queue_time_us":108925,"raft.run_cpu_time_us":30666,"raft.run_wall_time_us":100272,"replication_time_us":266953,"thread_start_us":528136,"threads_started":4,"wal-append.queue_time_us":93958,"wal-append.run_cpu_time_us":12118,"wal-append.run_wall_time_us":1801880}]]}
I20260709 13:16:38.070152 30924 leader_election.cc:400] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:16:38.105476 30924 leader_election.cc:403] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:38.099555 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:38.106529 30924 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:38.076347 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47834.3us
I20260709 13:16:38.082278  3471 consensus_queue.cc:260] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.085157  3644 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:38.117815 30952 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:38.102185 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:38.104931 30953 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:38.104403 30778 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 9, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 9 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:38.108055 30996 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:38.108091  4070 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:38.082381  3810 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.110337 30924 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:38.114533 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.108386 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.130759 30876 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 11.
I20260709 13:16:38.126957 30778 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 14, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.121779 30958 raft_consensus.cc:1217] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[12.10-16.12]   Dedup: 12.10->[14.11-16.12]
I20260709 13:16:38.109401  4157 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:38.134629 30924 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:38.116868  4119 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:38.114329  4076 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:38.132470 30958 pending_rounds.cc:85] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 10
I20260709 13:16:38.135500  3471 raft_consensus.cc:3060] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:16:38.139961 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:38.140412 30958 pending_rounds.cc:107] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:16:38.140741 30958 raft_consensus.cc:2889] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.137300 30778 catalog_manager.cc:5697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:38.143546 30955 raft_consensus.cc:2468] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:38.118636  3990 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:38.141702 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:38.144425  3996 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:38.148355  4048 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.150148 30778 catalog_manager.cc:5697] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.145419 30848 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.153019 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.130448  4070 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:38.168161  4070 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:38.138590  4157 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.172660  4157 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.173096  4004 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:38.173679  4004 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.174120  4004 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:38.136021  4047 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:16:38.177059  3951 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.132875  4154 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:38.161890  4169 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:38.162323  3896 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:38.135602  3679 raft_consensus.cc:2804] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:38.164707  4068 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:38.202250 31027 raft_consensus.cc:1240] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:38.163081 30778 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 12, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 12 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.160056 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:38.204514 31023 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:38.183295 31031 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:38.184490 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:38.185743 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:38.206270 31596 raft_consensus.cc:2393] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 17: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:38.205600 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:38.179580  4168 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.200552 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:38.215214 31029 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
W20260709 13:16:38.212530 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72685.5us
W20260709 13:16:38.194341 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.216250 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:38.222532  4119 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12.
I20260709 13:16:38.137948  4002 consensus_queue.cc:1048] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:16:38.224614 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:38.225198 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.230532 31570 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:38.209110  3679 raft_consensus.cc:697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:38.256582 30778 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.269028 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.247313 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:38.213033  3896 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:38.238639 31025 raft_consensus.cc:2468] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:38.273924  4173 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:38.277897  3810 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.279119 30778 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:38.229863  4119 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:38.212033  4159 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:16:38.227506  4068 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:38.225863  3622 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:38.286089 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 56517.9us
I20260709 13:16:38.214877  4162 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:16:38.283047 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:38.304417 30949 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:38.304885 30954 raft_consensus.cc:2393] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:38.278713  4045 raft_consensus.cc:2804] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:38.259747  4023 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:38.292713 30778 catalog_manager.cc:5697] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 5 to 12, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 12 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:38.322099 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 95128.9us
I20260709 13:16:38.259145  4158 consensus_queue.cc:1048] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:16:38.325344  4056 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.330152  4056 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.298589  4059 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.225087  4168 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.339366 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.341209 30954 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
W20260709 13:16:38.342602 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.300998  3622 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.348137 30953 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:16:38.282018  4157 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.303344  3951 consensus_queue.cc:1059] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:16:38.354302  3887 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.359748  3887 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.361531  4157 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.362766 30952 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:38.364135  3710 raft_consensus.cc:3060] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:38.364521  4172 log.cc:927] Time spent T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:38.369807  4068 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.340931  3810 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.334645  4045 raft_consensus.cc:697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:38.322068  3471 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:16:38.380661 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.376245  3679 consensus_queue.cc:237] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.386791  4168 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.355676  3622 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.335544 30778 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 10, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:38.338402  4023 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.405177 30876 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:38.399550  4060 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:38.419430 30778 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.428773 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:38.429381 30955 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.434024  3666 raft_consensus.cc:3060] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:38.388578  3810 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.402626  3471 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:38.455081 30955 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:38.446987 30778 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 11, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 11 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.462754 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:38.463634 31027 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:38.388309  3896 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.475458 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.476200 30951 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 10.
I20260709 13:16:38.478129  4181 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:38.478615  4181 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.480406 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.421880  3409 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:16:38.482651 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.483637 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.491537 30848 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:38.494004  4181 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.499087  4004 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.480715  4045 consensus_queue.cc:237] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.503701 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.507427  4023 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.513419  3810 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.481951  4174 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:38.515952  4005 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:38.521296 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.480582  3961 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.533600 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:38.533771 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.534579 30881 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 17.
I20260709 13:16:38.537045 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.537374 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.538427 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.543334 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.546428 30955 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:38.547453 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.549196 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:38.549134 30848 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.554513 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:38.533200  4005 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.561771 30951 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:16:38.537482  4174 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.569124  4184 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:38.569710 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:38.569998  4174 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.571076  4031 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.571225 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:38.571885  4057 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:38.571686  4031 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.572220  4090 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:38.574080  4056 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.574805  4157 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:38.578392  4005 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:38.560671  4012 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:38.536284  4070 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.606784 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.611910 30883 raft_consensus.cc:1275] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:38.540532  3961 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.572322  4057 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:38.624300 30957 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 17.
I20260709 13:16:38.632125 30848 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:38.602414  4012 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.615444  3938 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.631471  4057 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:38.656452  4012 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:38.665620  4164 log.cc:927] Time spent T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.557s	user 0.003s	sys 0.000s
I20260709 13:16:38.666154  4012 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.667958  4150 consensus_queue.cc:260] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.669204  4150 raft_consensus.cc:3060] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:38.636071  4184 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:38.671597 30951 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:16:38.680214 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 137180us
I20260709 13:16:38.616487  3644 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:16:38.688954 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:38.689894 30882 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:38.698674 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:38.670964  3938 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.711989 30880 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:38.685672  4184 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:38.698472  3666 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:38.725039 30954 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:38.733496  4075 consensus_queue.cc:1059] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:38.722708  4004 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:38.722867  3666 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:38.744549  3666 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.745442  3622 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.745946  3666 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:38.748431 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:38.749992 30924 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:38.730039  4188 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:16:38.775527  4184 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.748297  4057 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:38.781019  4057 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.784294  3961 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.785135  4070 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.757318  4158 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:38.728551  3679 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:16:38.793283 30882 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:38.787729  4158 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:38.808241  4200 log.cc:927] Time spent T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:16:38.814998 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:38.822392 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:38.824460 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:38.825084 31599 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:38.805867  4158 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:38.826107 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:38.826588  4189 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:16:38.827459 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:38.828264 31600 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:38.828850 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:38.829905 31597 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:38.831008 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:38.831611 31602 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:38.833700 31571 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:38.823077 31601 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 17.
I20260709 13:16:38.837699 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
W20260709 13:16:38.825990  4191 log.cc:927] Time spent T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:16:38.848368 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:38.824072  4174 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.848003 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:38.858081 31571 leader_election.cc:400] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Vote denied by peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351) with higher term. Message: Invalid argument: T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for earlier term 14. Current term is 15.
I20260709 13:16:38.858502 31601 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:38.838917  3622 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.847529  4048 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:38.847373  3960 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:38.890270 30996 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:38.907058 30876 raft_consensus.cc:1275] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:16:38.907454 30876 pending_rounds.cc:85] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 12
I20260709 13:16:38.907720 30876 pending_rounds.cc:107] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:16:38.908109 30876 raft_consensus.cc:2889] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.861161  4194 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:38.910391  3983 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:38.861073  4174 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.892140  4005 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.917918  4194 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.893884  3622 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:16:38.905668  4168 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:38.923653  3983 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:38.957178  4174 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:38.962522 30883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48714 (request call id 2454) took 1761 ms. Trace:
W20260709 13:16:38.967566 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 119563us
I20260709 13:16:38.917819  3471 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:16:38.906971  3960 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.966558 30883 rpcz_store.cc:276] 0709 13:16:37.201535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.202718 (+  1183us) service_pool.cc:224] Handling call
0709 13:16:37.202997 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.612474 (+1409477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.962218 (+349744us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540039b7d4. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc3571 00007f273ac5ae01 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2 00007f2738f9548c 00007f2738f948c6
0709 13:16:38.962443 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3239077888}
I20260709 13:16:38.941278  4194 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:38.983738  3960 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:38.984028  4057 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.984685  4057 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:38.967005  4168 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.001129  4057 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.008975 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:39.009788 30958 raft_consensus.cc:2393] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
W20260709 13:16:39.010601  4206 log.cc:927] Time spent T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.094s	user 0.000s	sys 0.004s
W20260709 13:16:39.019649 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 160133us
I20260709 13:16:39.022985 30922 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:39.025760 31605 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:39.028689 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.029999 31602 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:39.032848  4060 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:39.041929  4005 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.042219  4060 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.046233  4174 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:39.047477  4203 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:16:39.048250  4174 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:39.050835  4023 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:39.036819 30883 pending_rounds.cc:85] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 12
I20260709 13:16:39.061331 30883 pending_rounds.cc:107] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:16:39.061654 30883 raft_consensus.cc:2889] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.062862 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.063169 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:39.064025 31031 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:39.067489 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:39.016803  3983 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.080096 30922 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:39.087042 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.089692 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:39.087551 30956 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:39.092589 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:39.094058 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:39.098762 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:39.097833  4217 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:39.106213  3644 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:39.105903  4217 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.106778  3644 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:39.107678  3644 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.108475  4217 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.113489  3938 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.116775  4194 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.118116 31031 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:39.118907 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.122023  4194 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.124600  3887 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:39.124956  4209 log.cc:927] Time spent T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:16:39.127111  4173 consensus_queue.cc:1048] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:39.127988 30953 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:39.102118  4157 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:16:39.139053 30953 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:39.114382  4158 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.115793  4031 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:39.093649  4145 raft_consensus.cc:3055] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:39.150368 30998 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:39.148687 30848 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:39.097167  3921 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:39.099102  4219 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:39.162328  4012 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:39.152156  4145 raft_consensus.cc:740] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:39.168144 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:39.128054  4216 log.cc:927] Time spent T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
W20260709 13:16:39.173154  4175 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.721s	user 0.002s	sys 0.002s
I20260709 13:16:39.190711 31602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:39.196911 31602 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:39.187860  3925 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:16:39.202345 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.202262 30958 raft_consensus.cc:1240] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:16:39.219640  4168 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.220963  4048 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:39.221529  4048 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.222498  4018 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:39.223011  4018 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.189582  4219 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.223934 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:39.224189  4219 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.225003  4018 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.230772  4158 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.232234 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:39.235071  3720 consensus_queue.cc:1048] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:39.237154 31570 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:39.237407 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:39.242553 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:39.241403 30952 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:39.243353 30956 raft_consensus.cc:2393] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 13: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:39.246909 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:39.246981 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:39.247669 30952 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:16:39.247829 30949 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:39.255146 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.260807 30956 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:39.196257  4149 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.196010  4023 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:39.223591  4048 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.272099 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:39.279888 31600 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:39.270228 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:39.303289 31031 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.304591 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:39.244484  4174 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.309607  4174 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.310511  3887 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:39.312485 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:39.313305 30876 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:39.250705  4217 raft_consensus.cc:2804] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:39.318629  4217 raft_consensus.cc:697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:39.319586  4217 consensus_queue.cc:237] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.323582  4174 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.323951  4145 consensus_queue.cc:260] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.325060  4145 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:39.332032  4023 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:39.333019  4023 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.336491 30922 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:39.346581 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.347258 31027 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:39.357309 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.250916  4079 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:39.361982 31602 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:39.373767 30996 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:39.377528  3679 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:39.378302  3679 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:39.379464  3679 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.367777 30952 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:39.385838 31024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34930 (request call id 995) took 1226 ms. Trace:
I20260709 13:16:39.386292 31024 rpcz_store.cc:276] 0709 13:16:38.159178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.159745 (+   567us) service_pool.cc:224] Handling call
0709 13:16:38.160234 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.176156 (+ 15922us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:38.176204 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.176782 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.342023 (+165241us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:38.342081 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.342170 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.172718 (+830548us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b24003f5738. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f27379f39c4 00007f27379f1acb 00007f2737bacdc9 00007f2737baca55 00007f2737bac09d 00007f273a7de10e 00007f273a7f588c 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221
0709 13:16:39.334736 (+162018us) raft_consensus.cc:1685] finished
0709 13:16:39.334765 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.385763 (+ 50998us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15367,"raft.queue_time_us":16281,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":24529536,"thread_start_us":164824,"threads_started":1,"wal-append.queue_time_us":239245}
I20260709 13:16:39.389911 31031 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:39.398924 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:39.402860 30881 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:39.411695 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.345630  4002 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:39.425834 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.359403  3960 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:39.333972  4149 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.434355 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.451597 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:39.489770 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:39.491019 31024 raft_consensus.cc:2393] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:39.492486 31027 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:39.494102 31029 raft_consensus.cc:1275] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:16:39.484018  3983 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:39.508517  3983 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.510883  3983 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.501173 30881 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:39.544938 30876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ab89a799c64088901472d6633cfb83"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:39.545732 30876 raft_consensus.cc:606] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:39.546154 30876 raft_consensus.cc:614] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.455394  3960 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:39.547060  4060 consensus_meta.cc:287] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.006s
I20260709 13:16:39.518204  4219 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.556459  4002 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.620384 30957 raft_consensus.cc:2368] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16.
I20260709 13:16:39.621378  4219 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.603900  4060 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.624179 30952 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:16:39.625516  4226 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:16:39.625911 30955 raft_consensus.cc:1240] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:39.624351  4060 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.635111  4057 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:39.644652 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 45018.7us
I20260709 13:16:39.603775  4031 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:39.692993 30876 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:16:39.701385 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.706912 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.706079 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.708568 31599 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:39.653151  3720 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:39.645172  4145 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:39.710911 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:39.657877  4075 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:39.690866  4162 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:39.696866  4194 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:16:39.659776  4082 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:39.765102  4082 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.727527 31600 raft_consensus.cc:2468] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 18.
I20260709 13:16:39.768697 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:39.769670 31600 raft_consensus.cc:2393] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:39.714622 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:39.759567 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.774273  4082 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.655130  4002 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.704531  4215 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:39.783932 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:39.786164 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:39.789646 31597 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:39.799681 30952 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 17. Current term is 18. Ops: []
W20260709 13:16:39.804203 30848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.704051  4031 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.820652 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:39.724179  3720 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.726636  4145 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.780252  4075 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.830358 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:39.804205  3983 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:39.809271  4149 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.836501 31604 raft_consensus.cc:2410] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:39.776593  4162 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.837230 30883 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:39.838104 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:39.838281  4231 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:39.840234 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:39.853645 31597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.859479 31597 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:39.793620  4215 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.842397  4066 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:16:39.858134  4232 log.cc:927] Time spent T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:39.853116  4149 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:39.863252  3960 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:39.877385 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:39.882779 31597 raft_consensus.cc:1240] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:39.844755  3983 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:39.882705  4227 log.cc:927] Time spent T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:16:39.883710  4219 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:39.872768  4079 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:16:39.878769  4066 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.885558  3505 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:39.911285 31600 raft_consensus.cc:1240] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:16:39.891099  4234 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 13:16:39.916342  4079 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:39.916870  4079 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:39.917906  4079 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:39.919215  3983 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.917850  4060 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:39.920416  4060 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.921030  4002 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:39.897142  4219 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.922417  4060 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.923458  4219 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.924430  4219 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:39.924921  4219 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.912333  4066 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:39.928532  4066 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.928617  4075 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:39.929605  4219 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.930007  3720 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:39.911986  4233 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:16:39.919513  4079 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:39.949070  4215 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:39.951000  4162 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:39.933328  4149 consensus_queue.cc:1059] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
W20260709 13:16:39.958516 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.912693  3505 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:39.961553 31601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:39.963850 31601 raft_consensus.cc:606] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:16:39.964202 31601 raft_consensus.cc:614] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:39.962399 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:39.983373 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:39.986042 31601 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:39.969502  3505 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:39.991509  4250 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:39.985152  4179 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:39.992141  4251 raft_consensus.cc:3055] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:39.997924 31601 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:40.017764 31601 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:40.021454 30876 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:40.023022 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.024564 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.023977 31601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.007714  3968 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.016023  4057 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.996500  4251 raft_consensus.cc:740] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:40.017408  4002 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.036696 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.036589 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.034861  4002 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.039065  3983 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:40.030753  3409 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:16:40.040410  4002 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.041491 31604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:40.042086 31604 raft_consensus.cc:606] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.030652  3968 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.042448 31604 raft_consensus.cc:614] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.039665 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.031920  4057 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.044194  3968 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:40.044771 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.045630  4057 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.046329 30874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:40.046937 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.000824  4179 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.063087  4179 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.063905  4251 consensus_queue.cc:260] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.065174  4251 raft_consensus.cc:3060] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:40.088639  3679 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.089227  3679 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.090688  4145 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:40.091343  3679 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.103492 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
W20260709 13:16:40.124378 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 89387.9us
I20260709 13:16:40.133846  4179 raft_consensus.cc:493] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:40.134461  4179 raft_consensus.cc:515] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.138161 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.127952  4242 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:16:40.144588  4179 leader_election.cc:290] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.149289  3505 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.194113  3505 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.195505 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.198654 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:40.199443 31596 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:40.206723 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 63255us
W20260709 13:16:40.205008  4229 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.515s	user 0.004s	sys 0.004s
W20260709 13:16:40.205291  4237 log.cc:927] Time spent T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.292s	user 0.002s	sys 0.006s
I20260709 13:16:40.203282  4219 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:40.209321  3810 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.213605  4219 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.228077 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.230352 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.230454 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.230536 30922 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.231719 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.232332 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.233032 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.235935  4060 raft_consensus.cc:2804] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:40.236447  4060 raft_consensus.cc:697] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 18 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:40.237252  4060 consensus_queue.cc:237] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.239810 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.241685  4162 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:40.242902  4162 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:40.250506 30955 raft_consensus.cc:1275] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:40.249426 31601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:49066
I20260709 13:16:40.252179 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:40.252472 31601 raft_consensus.cc:606] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.252843 31601 raft_consensus.cc:614] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.254361  3996 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.254729  4018 consensus_queue.cc:1059] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:40.254884  3996 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.255548  4018 raft_consensus.cc:3055] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:40.243639  4162 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:16:40.255956  4018 raft_consensus.cc:740] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:40.257010  3996 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.256778  4018 consensus_queue.cc:260] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.258097  4018 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:40.263178 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:40.266970 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:40.267318  4228 log.cc:927] Time spent T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.609s	user 0.000s	sys 0.003s
I20260709 13:16:40.267800 31605 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:40.268664 30875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48716 (request call id 2768) took 1789 ms. Trace:
I20260709 13:16:40.269026 30875 rpcz_store.cc:276] 0709 13:16:38.479452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.485064 (+  5612us) service_pool.cc:224] Handling call
0709 13:16:38.485454 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.485931 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.485975 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.225712 (+739737us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b2c00000f48. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2739553a11 00007f2739563372 00007f273ac95a01 00007f273ac5a43a 00007f273ac5983e 00007f273fc1e419 00007f2739195bd4 00007f2739195b62 00007f2739195a91 00007f2739195a0c 00007f2739194cc2
0709 13:16:39.226154 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.420939 (+194785us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:16:39.789181 (+368242us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.789426 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.790227 (+   801us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.151148 (+360921us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b1800423520. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:40.266627 (+115479us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f273a7f586e 00007f273a7f4bb6 00007f273a7f47d8 00007f273a7fe221 00007f273a7fe1d9 00007f273a7fe169
0709 13:16:40.268472 (+  1845us) raft_consensus.cc:1685] finished
0709 13:16:40.268492 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.268609 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21984,"prepare.queue_time_us":390877,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":45,"raft.queue_time_us":17172,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":9393,"spinlock_wait_cycles":167787520,"thread_start_us":499183,"threads_started":2,"wal-append.queue_time_us":378759}
I20260709 13:16:40.274236 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.217965  3810 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.282155 31600 raft_consensus.cc:2468] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:40.284102  4158 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.284659  4158 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.286657  4158 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.287372  4031 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:40.288383  4266 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:40.290017 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.293653 31596 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 16.
I20260709 13:16:40.295753 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.329798 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:40.330315 30949 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:40.296994 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.331422 31031 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:40.300401 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.303870 30957 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:40.304230  4145 consensus_queue.cc:1048] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:40.312397 30849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.332955 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.314009 30998 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.333657 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.315069  4031 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:40.319492  3810 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.321084  4219 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.322628 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.323819 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:40.327196 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.352074  3666 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.352713  3666 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.355273 30877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:40.355554  4251 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:40.355942 30877 raft_consensus.cc:606] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.356302 30877 raft_consensus.cc:614] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.356071  4251 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.357827  3924 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:40.358204  4251 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.358716  4251 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.297731 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.332983 31604 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:16:40.359958  4162 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:40.328940 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.361817  4251 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.362300 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.335889 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.364673 31032 raft_consensus.cc:2410] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:40.365545  4251 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.335469 31023 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:40.358363  3924 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.366886 30877 raft_consensus.cc:1275] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:40.368146  3924 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.339288 30847 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:40.368919 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.369266 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:40.370224 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.370466 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.371004 31031 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 15: Already voted for candidate 95b998a6735f4180986a8b8f7d84b8fc in this term.
I20260709 13:16:40.371883 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:40.371999  3991 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:40.373826 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:40.376976 30881 raft_consensus.cc:1240] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:40.375376 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.379419 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.374908 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.395257 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.396947 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.397460 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.398077 31027 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:40.399112 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3909ef5ede2e43f1872fec585566b998" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.400249 31032 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:40.400537 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:40.399709 31028 raft_consensus.cc:2468] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 18.
I20260709 13:16:40.393767  3960 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:40.406551 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 67346.3us
I20260709 13:16:40.368944  3666 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.386680  4162 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.407372  3666 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:40.374111  4018 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.374310  4047 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:40.349241  4215 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:16:40.408946 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 175772us
I20260709 13:16:40.415670 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.416245 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.417516 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.422740 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.424556  4215 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.425122 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.427052  3666 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:40.427279  4215 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.413754  4018 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:40.428309  4018 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.428063  3666 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.407472  4162 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.431622  4162 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.412539 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.436491 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:40.437208 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.437317 30957 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:40.441711 31599 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:40.439023 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:40.447108 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.448189 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.450168 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.457440 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.460584 30957 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:16:40.472119 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 60521.9us
I20260709 13:16:40.474733 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:40.474975 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.475500 30877 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 17.
W20260709 13:16:40.476651 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64226.9us
I20260709 13:16:40.434368  3409 consensus_queue.cc:1059] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:16:40.411502  4258 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:40.489806 31571 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.480295 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:40.514285 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.517586 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.474025  4215 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.518363 30955 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:40.496150  4258 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:40.497514  4045 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.484411  4242 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:40.548184 31571 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.514735  3960 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:40.548676 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.473909  4251 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:16:40.573413 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 196332us
I20260709 13:16:40.525134  4079 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:40.522533  4215 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.575191 30997 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.525560  3968 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:40.587664  4076 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.560086  4258 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:40.573035  4162 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:40.606448 30923 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.29.5.131:37487 timed out after 1.528s (SENT) [suppressed 9 similar messages]
I20260709 13:16:40.575240  4194 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:16:40.610288 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 207079us
I20260709 13:16:40.582070  3924 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:16:40.624308  4215 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.627830  4076 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.621366  4079 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.573474  4045 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.630417  3720 raft_consensus.cc:3055] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:40.702176  3720 raft_consensus.cc:740] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:40.705987  3720 consensus_queue.cc:260] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.707299  3720 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:40.716162  4045 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.717649 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.728824  4276 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:16:40.744612  4273 log.cc:927] Time spent T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:16:40.699996  4076 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.700248  4079 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:40.760191  4257 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.760897  4257 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.768610  4243 consensus_queue.cc:1048] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:40.801182  4018 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:40.832494 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.835757 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 349167us
I20260709 13:16:40.888698  3996 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:40.889434  3996 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.892058 31596 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:40.892036  3996 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:40.763492  4257 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.844539 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.898315 30953 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:40.898439 30922 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.899701  4219 raft_consensus.cc:2804] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:40.899813 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:40.900471  4219 raft_consensus.cc:697] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:40.900985  4159 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.901510  4159 raft_consensus.cc:493] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.901980  4159 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.901654  4219 consensus_queue.cc:237] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.904258  4243 raft_consensus.cc:493] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:40.904915  4243 raft_consensus.cc:515] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.907047 30922 leader_election.cc:304] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:40.907881  4158 raft_consensus.cc:2749] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:40.907488  4243 leader_election.cc:290] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:40.857038 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 137685us
I20260709 13:16:40.913082 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:40.915601  4276 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:40.864003 30924 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:40.923122  4158 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:40.923655  4158 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:40.924190  4158 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:40.929699 30922 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:40.931011  4268 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:40.931492  4268 raft_consensus.cc:493] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.931932  4268 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:40.933682  4243 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.934427  4243 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.937119  4243 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:40.944486 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 80590.5us
I20260709 13:16:40.948215 30883 raft_consensus.cc:1275] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:16:40.948251  4257 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:40.948633 30883 pending_rounds.cc:85] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting all ops after (but not including) 13
I20260709 13:16:40.948923 30883 pending_rounds.cc:107] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:16:40.949203 30883 raft_consensus.cc:2889] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.948923  4257 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:40.949851  3996 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:40.951105  4257 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:40.960423  4215 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.963788 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:40.973423 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:40.973800  4159 raft_consensus.cc:515] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:40.975345 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:40.976390  3960 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:40.977586  4018 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:40.977977 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:40.979050 30883 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:40.991958 30883 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:40.997906 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:40.998332  3810 consensus_queue.cc:1048] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:41.002739 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:41.009521  3960 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:41.010262  3960 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.015815  4145 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:41.016435  4145 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.020684  4145 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.022744  3960 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.029340 30878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:41.035471 31596 raft_consensus.cc:1240] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:41.036176 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:41.038427 31596 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:41.060690  4245 consensus_queue.cc:1059] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:41.062477  3991 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:41.062970  3991 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:41.064044  3991 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:41.068063 31025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.042s	sys 0.050s
W20260709 13:16:41.068408 31025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.042s	sys 0.050s
I20260709 13:16:41.068658  4159 leader_election.cc:290] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:41.071321 30957 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.060s	sys 0.122s
W20260709 13:16:41.080561 30957 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.061s	sys 0.123s
W20260709 13:16:41.071569 30952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.027s	sys 0.075s
I20260709 13:16:41.074178  3810 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:16:41.081389 30952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.028s	sys 0.075s
I20260709 13:16:41.081468  3810 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:41.082011  3810 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.090807 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.093528 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.094259 31605 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
W20260709 13:16:41.074651 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72008.2us
I20260709 13:16:41.075619  4242 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.095700  4242 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.099973  4179 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:41.100761  4179 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.103606  4290 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:41.109470  4194 raft_consensus.cc:493] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:41.110186  4194 raft_consensus.cc:515] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:41.117807 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 542668us
I20260709 13:16:41.120949 30997 leader_election.cc:400] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16.
W20260709 13:16:41.127863  4267 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.008s	sys 0.005s
W20260709 13:16:41.145793  4267 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.008s	sys 0.005s
I20260709 13:16:41.147644  4194 leader_election.cc:290] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.149860 30923 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.150957  4060 raft_consensus.cc:2749] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:41.135129 30996 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:41.156085  4242 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:41.156639  4242 raft_consensus.cc:493] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.157105  4242 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:41.140888 30848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.002s	sys 0.005s
W20260709 13:16:41.142031 30949 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.008s	sys 0.038s
W20260709 13:16:41.160061 30848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.002s	sys 0.005s
W20260709 13:16:41.160245 30949 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.008s	sys 0.038s
W20260709 13:16:41.160920 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 537895us
I20260709 13:16:41.161885 30848 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.163091  3505 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:41.163026 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.164710 30848 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.166055  3924 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:41.166500  3924 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:41.166626 30848 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.166965  3924 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.167867  3666 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:41.170955 30957 raft_consensus.cc:1275] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:16:41.175460  3810 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.176815 30848 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.180364 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.185799  3666 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:41.187355 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.189226 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.190797 30957 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:41.193642  3810 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:41.197655  4258 consensus_meta.cc:287] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:16:41.199003  4258 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.201228  4258 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:41.201682  4244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.049s	sys 0.069s
I20260709 13:16:41.203725 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:41.205732 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.210947 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.211575 30957 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 12.
I20260709 13:16:41.212872 30875 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
W20260709 13:16:41.213351  4244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.049s	sys 0.070s
I20260709 13:16:41.215348  4179 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.216701 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:41.218534 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:41.220101  4179 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:41.220643  4179 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:41.221505  4179 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.233610 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.234596  3666 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:41.235023  3666 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:41.235457  3666 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.236789  4076 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.238142 31025 raft_consensus.cc:1240] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer 95b998a6735f4180986a8b8f7d84b8fc for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:16:41.047096  4158 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.250995  3666 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.260416 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.256822  4268 raft_consensus.cc:515] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.262110 30953 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:41.262351 30957 raft_consensus.cc:1240] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 15. Current term is 16. Ops: []
I20260709 13:16:41.264346  3810 consensus_queue.cc:1048] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:41.268496  3666 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.252936 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
W20260709 13:16:41.269145  3720 consensus_meta.cc:287] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.001s
I20260709 13:16:41.254356  4079 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.256822 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.274683 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:41.276155 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:41.276563  4244 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:41.276978 30949 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.278262  3505 consensus_queue.cc:1059] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:41.277048  4244 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:41.279888  4251 raft_consensus.cc:3055] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:41.280359  4251 raft_consensus.cc:740] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:41.280102  4244 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.251827  4158 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.282341 31028 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:41.281211  4251 consensus_queue.cc:260] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.288362  3505 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:41.288705  4251 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.297313  3991 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.302151 30949 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:16:41.304164 30846 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.305507  4079 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:41.306924 30847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 246449us
I20260709 13:16:41.309909  4268 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.311255 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:41.328792 30848 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.311255 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:41.331111  4079 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:41.331231  4244 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.331805  4079 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:41.332891  4079 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.335561 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.335843 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.312189 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:41.337759 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.337751 30953 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.333964 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.334463 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:41.342183 30951 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.321398 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.335124 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:41.325889 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:41.343704 31600 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:41.338624  3666 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:41.346004 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 338963us
I20260709 13:16:41.333468  4244 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.348308 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:41.360033 30958 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.350432 30956 raft_consensus.cc:1240] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:16:41.355854  3720 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.359153 30951 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
W20260709 13:16:41.360925 31568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.366055 30923 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.368393 30951 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:41.372124 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.372270 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd89ff847a344f8a8ef89d9556b85846" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.373382 30955 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:41.376945 30953 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:41.379846 30955 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:41.381743 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.372732 30954 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:41.386543 30958 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:41.386781 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:41.356870  3925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.021s	sys 0.025s
W20260709 13:16:41.388597  3925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.022s	sys 0.026s
I20260709 13:16:41.389681  4002 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:41.391716 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.394845 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:41.390334 30775 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 8 to 11, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 11 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:41.396266 30775 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 11 to 15, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 15 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:41.398249 30778 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 353) took 15095 ms (client timeout 15000 ms). Trace:
W20260709 13:16:41.398643 30778 rpcz_store.cc:269] 0709 13:16:26.302812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.303119 (+   307us) service_pool.cc:224] Handling call
0709 13:16:41.398157 (+15095038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:38.918104 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:38.933468 (+ 15364us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:38.933529 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:16:38.933552 (+    23us) tablet.cc:662] Decoding operations
0709 13:16:38.977339 (+ 43787us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:38.984361 (+  7022us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:38.984399 (+    38us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:16:39.104439 (+120040us) tablet.cc:701] Row locks acquired
0709 13:16:39.181239 (+ 76800us) write_op.cc:260] PREPARE: finished
0709 13:16:39.235607 (+ 54368us) write_op.cc:270] Start()
0709 13:16:39.235810 (+   203us) write_op.cc:276] Timestamp: P: 1783602999197539 usec, L: 0
0709 13:16:39.235849 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:16:39.308813 (+ 72964us) log.cc:844] Serialized 9386 byte log entry
0709 13:16:40.223596 (+914783us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18002cfe00. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f2740a35de1 00007f2740a425b1 00007f2737b6d3f3 00007f2737b6f7c1 00007f2737b6f779 00007f2737b6f709 00007f2737b6f6d1 00007f2737b6e9cd 000000000038f354 000000000038f199 00007f2737b5083a
0709 13:16:40.405430 (+181834us) op_driver.cc:464] REPLICATION: finished
0709 13:16:41.016135 (+610705us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b4400022b4c. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737a93c85 00007f2737a946a2 00007f273a8061db 00007f273a801aaf 00007f2737b500ac 00007f27409aaab9 00007f2737b6c69b 00007f2737b6a93f 00007f2737b6cc02 00007f273e690ef0
0709 13:16:41.123943 (+107808us) write_op.cc:301] APPLY: starting
0709 13:16:41.124062 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:41.172714 (+ 48652us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:41.172768 (+    54us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:41.267472 (+ 94704us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:41.305955 (+ 38483us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:16:41.306019 (+    64us) write_op.cc:312] APPLY: finished
0709 13:16:41.306500 (+   481us) log.cc:844] Serialized 212 byte log entry
0709 13:16:41.308201 (+  1701us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:41.308402 (+   201us) write_op.cc:454] Released schema lock
0709 13:16:41.308477 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:41.308900 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:41.308927 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3380226,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":718116,"apply.run_cpu_time_us":30076,"apply.run_wall_time_us":184984,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104495,"num_ops":24,"prepare.queue_time_us":84915,"prepare.run_cpu_time_us":119708,"prepare.run_wall_time_us":731549,"raft.queue_time_us":178809,"raft.run_cpu_time_us":13158,"raft.run_wall_time_us":741086,"replication_time_us":1169419,"spinlock_wait_cycles":16953984,"thread_start_us":1124432,"threads_started":4,"wal-append.queue_time_us":294657}]]}
I20260709 13:16:41.395129 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:41.405843 31604 raft_consensus.cc:2393] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:41.408473 30848 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.417325 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.393985  3505 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:41.449213  3505 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.451357  3505 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.456786  4076 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:41.429916 30848 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
W20260709 13:16:41.433147  4299 log.cc:927] Time spent T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:16:41.434307  4214 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.441509 30883 raft_consensus.cc:1240] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:41.459698 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:41.460568 30880 raft_consensus.cc:2410] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:16:41.461529  4290 consensus_queue.cc:1059] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:41.462232  4290 consensus_queue.cc:1243] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:41.395074 30923 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.433326  3644 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:41.475076  3644 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:41.476022  3644 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.444218  3924 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.487504 31026 raft_consensus.cc:1275] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:41.485281 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:41.488523 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.489259 31026 raft_consensus.cc:2410] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:16:41.490058 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.491019 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:41.418630  4289 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:41.431797  4242 raft_consensus.cc:515] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.463837 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.494251 31598 raft_consensus.cc:2393] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 13: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:41.495349  4242 leader_election.cc:290] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.464553  4056 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:41.496704  4056 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:41.497566  4056 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.381676  3720 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.431082  4215 leader_election.cc:290] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.463586  4290 raft_consensus.cc:3055] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:41.499923  4290 raft_consensus.cc:740] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.501219  3720 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.500921  4290 consensus_queue.cc:260] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.469246 31600 raft_consensus.cc:1240] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:41.489277  3924 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.473100 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.503611 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.503906 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:41.504216 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 109215us
I20260709 13:16:41.506923 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:41.507485 31598 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.507899 30923 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.477699 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.477804 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.432209 31570 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.479048 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecebd472a2fc4b768869e3daa594c692" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.479660 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.480115 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.480273 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.512317 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.480921 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.480978 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:41.481694 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a26907cc3847ef873d80998378ce0a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:41.442011 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 66895.4us
I20260709 13:16:41.483665 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a98a12e85a64722a1c7f956eb64734e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.512404 31032 raft_consensus.cc:2468] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:41.517169 30923 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.519021 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:41.519366 30923 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.522698 31598 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:41.524358 30996 leader_election.cc:304] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:41.524709 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:41.526820 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 94706.1us
I20260709 13:16:41.528446 30997 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.398896 30775 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 12 to 15, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 15 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.529871 31600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.530534 31600 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:41.533095 30996 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:41.534996 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.502193  4290 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.539362 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.540851 30997 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.547439 30848 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.547636 31027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:41.514986  4219 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:16:41.548833 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.525784  4158 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.536311  4159 raft_consensus.cc:2764] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:16:41.538381  3983 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:41.537644  4275 raft_consensus.cc:2804] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:41.536036  4258 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:16:41.566584 30998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.568040 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.538514  3810 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.538446  4145 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:41.542198  3996 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:41.546150  4194 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:41.550518  4257 raft_consensus.cc:3060] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.536587  4242 consensus_queue.cc:1059] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:16:41.537328  4288 consensus_queue.cc:1048] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:41.542531  4031 consensus_queue.cc:1059] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:16:41.569860  3983 raft_consensus.cc:493] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.579653  4276 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.581513  4060 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.583963  4275 raft_consensus.cc:697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.608716  3983 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.654119  3679 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:41.663457  3983 raft_consensus.cc:515] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.671133  3720 raft_consensus.cc:3055] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:41.671625  3720 raft_consensus.cc:740] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.672441  3720 consensus_queue.cc:260] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.673624  3720 raft_consensus.cc:3060] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:41.682582  3983 leader_election.cc:290] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.642774 30775 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 9, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 9 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.697676 30775 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:41.708132 30775 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:41.726056 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:41.773033 31604 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:16:41.727613 30995 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.730726  4275 consensus_queue.cc:237] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.768234  4082 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:41.739488  4257 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:41.782250 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 242930us
I20260709 13:16:41.783007 30923 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
W20260709 13:16:41.783594 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 211243us
W20260709 13:16:41.785665 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 253270us
I20260709 13:16:41.786391 30922 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:41.786453 30923 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.788244 30922 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:41.800526 30882 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:41.792758  4268 raft_consensus.cc:2749] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:41.793016  4158 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:16:41.824357 30997 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.810844  4179 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:41.823269 31604 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:41.833098  4323 consensus_queue.cc:1059] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:41.834504  4145 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.781883  4082 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.849951 30996 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:41.863652 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 77261us
I20260709 13:16:41.865209 30923 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.865455 30883 raft_consensus.cc:1240] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:41.867758 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:41.876283 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 335673us
I20260709 13:16:41.876462 30882 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:41.873746  3996 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:41.879453  4159 consensus_queue.cc:1059] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:41.880183  4082 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:41.880515  4159 raft_consensus.cc:3055] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:41.880890  4159 raft_consensus.cc:740] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:41.881742  4159 consensus_queue.cc:260] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.881783 30775 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 8 to 12, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 12 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:41.883224  4159 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:41.886421 30775 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:41.889109 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 64898.9us
I20260709 13:16:41.891741 30997 leader_election.cc:304] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.887744 31570 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:41.912900  4291 raft_consensus.cc:3055] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:41.913626  4291 raft_consensus.cc:740] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.920058  4242 raft_consensus.cc:3055] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:41.920552  4242 raft_consensus.cc:740] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
W20260709 13:16:41.920771 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49085.7us
I20260709 13:16:41.921375  4242 consensus_queue.cc:260] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.922617  4242 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:41.927668 30880 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:41.929204 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.860651  4145 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.896147  4194 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:41.931433 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 66297.2us
I20260709 13:16:41.896034  3679 raft_consensus.cc:2804] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:16:41.937335 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45679.9us
I20260709 13:16:41.917228  4217 raft_consensus.cc:2804] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:41.941200 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:41.943632 30997 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:41.950956  4257 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:41.955933  4327 raft_consensus.cc:2749] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.957182  4217 raft_consensus.cc:697] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:41.958149  4217 consensus_queue.cc:237] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.934198  4320 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.942824  4258 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:41.962240  4258 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.963845 31605 raft_consensus.cc:1275] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:41.964944  4258 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:41.978451 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:41.979547 30882 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:41.980623 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:41.980846 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:41.981056  3679 raft_consensus.cc:697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.981382  3960 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:41.981805  3960 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.982177  3960 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.982034  3679 consensus_queue.cc:237] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.984917  4322 consensus_queue.cc:1059] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:41.929265  4268 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:16:41.986325 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:41.986999  4322 consensus_queue.cc:1243] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer 95b998a6735f4180986a8b8f7d84b8fc log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:41.991559  4288 raft_consensus.cc:3055] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:41.930248  4291 consensus_queue.cc:260] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:41.992343  4288 raft_consensus.cc:740] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:41.993165  4288 consensus_queue.cc:260] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:41.994282  4288 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:41.994642  3996 consensus_queue.cc:1048] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:41.998219 31027 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:41.973034  4145 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:42.006177  3924 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:42.006487  4181 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:42.006991  4181 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:42.009119  4181 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:42.010279  4181 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:16:42.012189 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68634us
I20260709 13:16:42.012962 30997 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:42.012213  3968 raft_consensus.cc:2749] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:16:42.013911  3968 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:16:42.014089 30997 leader_election.cc:304] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:42.014887  4243 raft_consensus.cc:2749] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:42.015959 30923 leader_election.cc:304] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.017616 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:42.018133  4329 raft_consensus.cc:2749] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:42.022570  4145 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:42.023066  4145 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.024312 30958 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:42.025583  4145 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:42.025900 30956 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:42.026803  4214 consensus_queue.cc:1048] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:42.031558 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:42.034853  3924 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:42.035607  4257 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:42.037711 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:42.038036 30998 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:42.038345 30882 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:42.039621  4325 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:42.056629 30923 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.063474 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.067273 30923 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.045113 30775 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 9 to 13, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 13 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:42.007596  4291 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:42.046476 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:42.073089 30923 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.077570 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53c19478dc740149d296778042dd3a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:42.078157 30958 raft_consensus.cc:3060] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:42.079569 31570 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.082823 31570 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.084328 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:42.085196 30952 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:42.088536 30951 raft_consensus.cc:1240] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:42.089313 31570 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.090431 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:42.091177 30951 raft_consensus.cc:3060] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:42.096887 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:42.108840 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:42.109408 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154fc3698684427dab2fe05492989f2e" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:42.109969 31026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fc12a76fb487399ec1bbd35b7a4ca" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:42.111577 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:42.112205 31024 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 11.
I20260709 13:16:42.112986 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:42.116492 31028 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:42.116452 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.118149 31570 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.071452  4268 raft_consensus.cc:2749] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:16:42.124164 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 51142.9us
I20260709 13:16:42.125273  4045 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:42.074086  4329 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:42.071676  4181 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:42.130990 30923 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.079365  4214 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:42.103343  3810 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:42.101503  4215 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:42.123245  4145 raft_consensus.cc:2749] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:42.143028 30958 raft_consensus.cc:2468] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:42.124380 30951 raft_consensus.cc:2468] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:42.065877  3960 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.126849  4002 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:42.128961  4082 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:42.146773  3810 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:42.184473 31604 raft_consensus.cc:1240] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:42.171787 31032 raft_consensus.cc:2468] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:42.143800  4181 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.186726  4321 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:42.192749  4331 log.cc:927] Time spent T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:16:42.193584  4330 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:42.217048  3960 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:42.218703 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:42.199823  3810 raft_consensus.cc:3060] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.222864 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:42.244055 31031 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:42.248124 31571 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:42.254613  4332 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:42.235963  4258 raft_consensus.cc:493] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:42.265345  4258 raft_consensus.cc:515] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.196337 30775 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 8 to 11, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:42.267908 30775 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 9 to 10, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 10 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.273465 31029 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:16:42.273914 31029 pending_rounds.cc:85] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Aborting all ops after (but not including) 9
I20260709 13:16:42.274143 31029 pending_rounds.cc:107] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:16:42.274401 31029 raft_consensus.cc:2889] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:42.297528 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49522.3us
I20260709 13:16:42.313727  4045 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:16:42.270155 30775 catalog_manager.cc:5697] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 10 to 11, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 11 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.372334 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:42.373140 31604 raft_consensus.cc:2393] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:42.358350  4258 leader_election.cc:290] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:42.345218  4329 consensus_queue.cc:1059] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:16:42.374461  4181 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:42.417500 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 303047us
I20260709 13:16:42.418673 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:42.425215 31570 leader_election.cc:304] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.426482 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:42.431972 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:42.432966 31570 leader_election.cc:304] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:42.441906 31029 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:42.429800  4159 raft_consensus.cc:2749] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:42.459014 30951 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:42.430478  4082 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:16:42.434814  4215 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:42.474747  4005 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 13:16:42.486477  4336 log.cc:927] Time spent T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:16:42.465577  4214 raft_consensus.cc:2804] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:42.472203 30775 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 4 to 8, term changed from 8 to 13, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to <none>, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted, no longer has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 13 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:42.506002 30775 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 12 to 14, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 14 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:42.515300  3960 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:16:42.535276 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 45899.7us
W20260709 13:16:42.535977 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 53649.7us
I20260709 13:16:42.539499 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:42.540145 30875 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:42.541433  3644 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.541934  3644 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:42.555434  4340 log.cc:927] Time spent T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:42.469132  4215 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:42.556459  4215 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:42.468562  4217 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:16:42.564884 31604 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:42.464722  4056 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:16:42.582051  4275 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:42.582861  3996 raft_consensus.cc:3055] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:42.568113  4214 raft_consensus.cc:697] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:42.583431  3996 raft_consensus.cc:740] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:42.597412 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:42.604913 31598 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:42.606410 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:42.608943 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:42.609300  4005 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:42.621790  4005 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.622203  4005 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:42.622283 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 83310.1us
I20260709 13:16:42.604930  3644 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:42.634141 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 143680us
W20260709 13:16:42.634831 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 170395us
I20260709 13:16:42.636404 31025 raft_consensus.cc:3060] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:42.650624 30875 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:42.686226 31025 raft_consensus.cc:1275] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:42.726092 31023 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Rejecting Update request from peer 74f5a5b7556240508983221981af4ab4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:42.583954 30775 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 10 to 13, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:42.737061 31604 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:42.658449  3996 consensus_queue.cc:260] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:42.726701  4313 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:42.675835  4214 consensus_queue.cc:237] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.735222  4328 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:42.714036  4288 consensus_queue.cc:1059] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:16:42.787585  4328 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:42.794929  3983 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:16:42.763993  3810 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:42.817979  4005 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.820633  4005 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:42.823000  3810 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:42.820865  4328 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.824986  4328 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:42.829877 31604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:42.831065 31604 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:16:42.841646  4353 log.cc:927] Time spent T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:16:42.851018  4215 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.879130 31604 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:42.815482  3960 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:42.706339  4349 consensus_queue.cc:1048] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:16:42.892174  3960 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:42.898281  3960 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:42.899612  4215 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:42.905908  4360 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
W20260709 13:16:42.906576  4358 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:16:42.938247 30775 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.944413 30775 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:42.952737 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
W20260709 13:16:42.977056 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 192688us
I20260709 13:16:42.984023 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe74086270b4498abc8ede59e5e23f3a" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:42.994321 30951 raft_consensus.cc:1275] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:42.996929 30956 raft_consensus.cc:1275] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:43.002041 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:43.003288 31029 raft_consensus.cc:2393] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 14: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:43.004496 31598 raft_consensus.cc:1240] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:43.001379 30956 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:16:43.019306  3925 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:43.024966  3925 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:43.044322 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:43.045449 30952 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 13.
I20260709 13:16:43.026889  3925 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.093554 30879 raft_consensus.cc:1240] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:43.094008 30924 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:43.100412  3960 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.110657  3960 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:43.143297 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 49707.8us
I20260709 13:16:43.147140  3960 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:43.150005  4361 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:43.153638 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:43.150079  4247 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:43.150583  4361 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:43.159466  4247 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:43.168166  4247 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:43.169200  3996 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.169600  4247 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:43.169945 31570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.175045 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:43.176319 30956 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 16: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:43.177583 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:43.191201  4320 consensus_queue.cc:1059] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:43.192641 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:43.193578 30951 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
W20260709 13:16:43.194680 30997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.199263 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:43.202796 31023 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:43.200336 31025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:43.207132 30997 leader_election.cc:304] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:43.208843  3679 raft_consensus.cc:2749] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:43.159329  4361 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:43.215664  4371 log.cc:927] Time spent T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:43.222223 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:43.223703  3505 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:43.224642  3505 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.226910  3505 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.228431 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:43.229079 31599 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 18.
I20260709 13:16:43.230509 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:43.231510  3644 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:43.232086  3644 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:43.232560  3644 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:43.192572  4320 raft_consensus.cc:3055] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:43.240763  4320 raft_consensus.cc:740] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:43.241956  4320 consensus_queue.cc:260] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.254558 30875 raft_consensus.cc:2468] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
W20260709 13:16:43.256063 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 46579.1us
I20260709 13:16:43.258872  3991 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:43.240806 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 69312.8us
I20260709 13:16:43.280006  4320 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.292755 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:43.308765 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:43.309804 30958 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 18: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:43.314282 30924 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:43.316673  4357 raft_consensus.cc:2804] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:43.317227  4357 raft_consensus.cc:697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:43.318176  4357 consensus_queue.cc:237] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:43.336800  4194 consensus_queue.cc:1048] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:16:43.373708 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:43.376300  4349 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:16:43.376780  4349 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.377187  4349 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:43.381699  3644 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.385288  3644 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.386497  4349 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.400038 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:43.400959 31596 raft_consensus.cc:2368] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 18. Current term is 19.
I20260709 13:16:43.401399 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:43.402189 30954 raft_consensus.cc:2393] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 18: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:43.407006 30847 leader_election.cc:400] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 18. Current term is 19.
I20260709 13:16:43.407361 30847 leader_election.cc:403] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:16:43.408077  3991 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:43.346429  4361 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.422240 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:43.428643  4350 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:43.429003 31024 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:43.429111  4350 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:43.429384 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:43.429641  4350 raft_consensus.cc:3060] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:43.431807  4321 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:43.438310  4290 consensus_queue.cc:1048] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:16:43.453219 30951 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.462534 30951 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:43.464854  4349 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:43.469915 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:43.470844 30952 raft_consensus.cc:3060] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:16:43.470809  4214 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:43.483639 30952 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 19.
I20260709 13:16:43.484982 31570 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:43.487679  3960 raft_consensus.cc:2804] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:16:43.493208  3960 raft_consensus.cc:697] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:43.495369 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:43.495651  3960 consensus_queue.cc:237] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.501235  4361 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.502708 30875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:43.509275 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:43.510207 31029 raft_consensus.cc:606] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:43.515236 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:43.515928 31024 raft_consensus.cc:606] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:43.522006 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:43.522655 30875 raft_consensus.cc:606] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:43.525637 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:43.526425 31598 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:43.529091 30922 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:43.529409 30922 leader_election.cc:403] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:16:43.530650  4320 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:43.532080  3991 raft_consensus.cc:2749] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425) with higher term. Message: Invalid argument: T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc for earlier term 18. Current term is 19.
I20260709 13:16:43.532689 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:43.533429 30875 raft_consensus.cc:606] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:43.533836 30875 raft_consensus.cc:614] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:43.541523  3924 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:43.542258 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:43.542980 31024 raft_consensus.cc:606] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Received request to transfer leadership to TS 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:43.543370 31024 raft_consensus.cc:614] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:43.558482 30951 raft_consensus.cc:1275] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:16:43.563802 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:43.577558  4082 consensus_queue.cc:1048] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:43.590695 30880 raft_consensus.cc:2468] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 19.
I20260709 13:16:43.542258  3924 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.630121 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:43.627452  4373 log.cc:927] Time spent T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:43.656936  4194 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:43.663825  4194 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.666275  4194 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.666963  4357 raft_consensus.cc:493] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.667531 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:43.668780 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:43.669482 30951 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:43.667528  4357 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.677495 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:43.678584  3983 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:43.678996  3983 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:43.679365  4357 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.681495 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:43.679363  3983 raft_consensus.cc:3060] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.685542 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:43.698655 31029 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:16:43.690842  3679 raft_consensus.cc:993] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:43.700080  3679 raft_consensus.cc:1081] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:43.725504  3924 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.730042 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:43.733072 31596 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:43.749312 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:43.750017 30956 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:43.733542 31598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7378a710ae3644c686285da393d03ae1"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:16:43.752974 31598 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.753471 31598 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.750180  3505 raft_consensus.cc:993] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:43.756304  3505 raft_consensus.cc:1081] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:43.741622  4350 raft_consensus.cc:515] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.764765 31599 raft_consensus.cc:2410] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:16:43.773125 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:43.774833 30956 raft_consensus.cc:2393] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 in current term 16: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:43.776938 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a248ff3a5e13493783eef6f7b80fb0ea" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:43.785004 31025 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:43.789503  4268 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:43.793727  4357 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:43.794303  4357 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.796567  4357 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.798550 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:43.799695 31032 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:43.803275 31596 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:43.804981  4257 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:16:43.770488  4350 leader_election.cc:290] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:43.815452 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:43.816162 31603 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:43.817409 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:43.822644 30922 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:43.840463  4002 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:43.840994  4002 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:43.841372  4002 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.858027  4002 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.859087  3983 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.868947 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
W20260709 13:16:43.873723 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 112289us
I20260709 13:16:43.877584  3924 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:43.888005 30956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:16:43.888813 30956 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.889272 30956 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.895098  4364 raft_consensus.cc:2749] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:43.887192  3924 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:43.902078  3924 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.901257 31598 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.913482 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:43.908989  4002 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.918674 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:43.921190 31598 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:43.930801 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:43.931998 31032 raft_consensus.cc:2393] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 in current term 13: Already voted for candidate f535fccbafb14e3f92bd45065da403db in this term.
I20260709 13:16:43.936599 30956 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:43.941090 30879 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:43.944342 30957 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:43.950846 30880 raft_consensus.cc:1275] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:43.954624 30956 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:43.957176  4344 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.963883  4364 consensus_queue.cc:1048] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:43.969411 31029 raft_consensus.cc:2468] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:43.961524  4344 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:43.982554  4344 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.982870 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:43.984115  3983 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:43.994236 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:43.994899 30880 raft_consensus.cc:3055] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:16:43.995210 30880 raft_consensus.cc:740] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:43.996029 30880 consensus_queue.cc:260] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:43.998800 31603 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:44.006242 30879 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:44.004391 30880 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.002636 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:44.008091 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:44.009228 30877 raft_consensus.cc:1240] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Rejecting Update request from peer f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15. Ops: []
I20260709 13:16:44.010134 31571 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:44.010438  3644 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.011132  3644 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.013721  3644 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:44.020603 31570 leader_election.cc:304] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:44.023051 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:44.024060 31599 raft_consensus.cc:2393] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 12: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:44.025964 30922 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: f535fccbafb14e3f92bd45065da403db
I20260709 13:16:44.028077  4268 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:44.024065 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:44.029074 30958 raft_consensus.cc:1813] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Handling vote request from an unknown peer f535fccbafb14e3f92bd45065da403db
I20260709 13:16:44.028599  4268 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:44.029572 30958 raft_consensus.cc:2368] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15.
I20260709 13:16:44.030011  4268 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.031126  3644 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:44.032059 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:44.032688 31032 raft_consensus.cc:3055] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:44.032979 31032 raft_consensus.cc:740] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:44.016602  4349 raft_consensus.cc:2804] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:44.033901  4349 raft_consensus.cc:697] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:44.033653 31032 consensus_queue.cc:260] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.032688  4214 raft_consensus.cc:2804] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:44.035111  4214 raft_consensus.cc:697] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:44.034880  4349 consensus_queue.cc:237] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.036077  4214 consensus_queue.cc:237] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.037622  3924 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.041059 31032 raft_consensus.cc:3060] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.046267 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:44.046989 31024 raft_consensus.cc:3060] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.054220 30952 raft_consensus.cc:2468] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 12.
I20260709 13:16:44.056516 30951 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:44.076524  3924 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:44.083393 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:44.084290 31599 raft_consensus.cc:2393] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 95b998a6735f4180986a8b8f7d84b8fc in current term 15: Already voted for candidate 74f5a5b7556240508983221981af4ab4 in this term.
I20260709 13:16:44.084093  4214 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:44.085750 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:44.087096 31029 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 14.
I20260709 13:16:44.087999 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:44.088148 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:44.089299  4005 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:44.089717  4005 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.089759 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:44.090209  4005 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.094513 30875 raft_consensus.cc:1275] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:16:44.099292  3960 consensus_queue.cc:1048] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:44.106778 31024 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:44.111521 30952 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:44.116529 30848 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:44.117213 30996 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:44.117995 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 63747us
I20260709 13:16:44.118075  4344 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:44.117516 30880 raft_consensus.cc:2468] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
I20260709 13:16:44.125181  4385 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:44.125818  4385 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:44.127352 30997 leader_election.cc:400] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Vote denied by peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199) with higher term. Message: Invalid argument: T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for earlier term 14. Current term is 15.
I20260709 13:16:44.128681 30924 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:44.137215  4385 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:44.164179 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 54822.2us
I20260709 13:16:44.165253 30997 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4
I20260709 13:16:44.173509  4344 raft_consensus.cc:993] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:44.174032  3679 raft_consensus.cc:1081] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:44.150002  4005 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.185942  4005 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:44.186378 31032 raft_consensus.cc:2468] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
W20260709 13:16:44.188067 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 109963us
I20260709 13:16:44.192180 30957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51636
I20260709 13:16:44.193534 30957 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.193881 30957 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.208505 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:44.210363 31031 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.212033 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:44.216564  4390 log.cc:927] Time spent T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:16:44.213035  4362 raft_consensus.cc:2804] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:44.217218  4362 raft_consensus.cc:697] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:44.218155  4362 consensus_queue.cc:237] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.220968  4389 raft_consensus.cc:2804] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:44.221560  4389 raft_consensus.cc:697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:44.222500  4290 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.222605  4389 consensus_queue.cc:237] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.223166  4290 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.225941  4290 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:44.226998 31599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:44.229456 31599 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:44.230790 30996 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:44.231673  4290 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:44.232199  4290 raft_consensus.cc:493] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.232697  4290 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:44.258893 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:44.262563 30957 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.264793 31031 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95b998a6735f4180986a8b8f7d84b8fc in term 15.
I20260709 13:16:44.269593 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:44.270315 30883 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.272071 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:44.273142  3991 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:44.273649  3991 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Leader. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:44.274631  3991 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.304685 30957 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:44.310158 30883 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:44.310487 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:44.311085 31024 raft_consensus.cc:3055] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:44.311479 31024 raft_consensus.cc:740] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:44.311872 30924 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:44.340551  4364 raft_consensus.cc:2804] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:44.341156  4364 raft_consensus.cc:697] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:44.342027  4364 consensus_queue.cc:237] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.324182 31024 consensus_queue.cc:260] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.357328 31024 raft_consensus.cc:3060] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:44.360101 30779 catalog_manager.cc:5697] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.361711 30779 catalog_manager.cc:5697] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 14, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 14 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.362973 30779 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:44.370235 30779 catalog_manager.cc:5697] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.373355 30779 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 14, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 14 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.374946 30779 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.411000 30779 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 13, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 13 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.423885 31024 raft_consensus.cc:2468] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 12.
I20260709 13:16:44.476548 31024 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:44.478567  3960 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:44.478962  4290 raft_consensus.cc:515] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.491263  4357 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:44.491923  4357 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:44.496536 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:44.496714 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:44.497547 31031 raft_consensus.cc:2368] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:44.500603 31032 raft_consensus.cc:1240] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Rejecting Update request from peer bda0856a7efd4d0e96615b66bef383c6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:44.500317 30923 leader_election.cc:400] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:44.501644 30923 leader_election.cc:403] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:44.501744 30883 raft_consensus.cc:1275] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:16:44.505304  4268 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:16:44.507683 31024 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:44.508427  3996 consensus_queue.cc:1059] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:44.508823  4349 consensus_queue.cc:1048] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:16:44.509310  3996 raft_consensus.cc:3055] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:44.509646  3996 raft_consensus.cc:740] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:44.510218  4349 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:44.510433  3996 consensus_queue.cc:260] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.511654  3996 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:44.516080  4357 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:44.516500 30779 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.517997 30779 catalog_manager.cc:5697] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 9 to 13, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 13 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.519733 30779 catalog_manager.cc:5697] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.524243  4290 leader_election.cc:290] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:44.525174 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:44.525785 31596 raft_consensus.cc:3060] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:44.529266 30779 catalog_manager.cc:5697] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 18, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 18 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.533761 30779 catalog_manager.cc:5697] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 15, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.546847 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57205f89b2ab4d2c8a699a5178d20da0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:44.572414 31596 raft_consensus.cc:2468] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:44.580900  4214 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.581460  4214 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.584105 30996 leader_election.cc:304] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:44.585321  3720 raft_consensus.cc:2804] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:44.585860  3720 raft_consensus.cc:697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:44.586723  3720 consensus_queue.cc:237] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:44.589457 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc" is_pre_election: true
I20260709 13:16:44.605970 30958 raft_consensus.cc:1275] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:44.620190 30779 catalog_manager.cc:5697] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.622275 30779 catalog_manager.cc:5697] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:44.630700 30957 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:44.638602 30779 catalog_manager.cc:5697] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 9 to 16, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 16 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.637015  4268 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487) with higher term. Message: Invalid argument: T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bda0856a7efd4d0e96615b66bef383c6 for earlier term 14. Current term is 15.
I20260709 13:16:44.654533 30880 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:16:44.651877 30779 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 15 to 18, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 18 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } attrs { replace: true } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:44.662906 30775 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 249) took 17360 ms (client timeout 15000 ms). Trace:
W20260709 13:16:44.663815 30775 rpcz_store.cc:269] 0709 13:16:27.302206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.302502 (+   296us) service_pool.cc:224] Handling call
0709 13:16:43.289598 (+15987096us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b54002f1128. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273e5c4161 00007f273e64e3af 00007f273e64fb11 00007f2740b502d1 00007f2740b50b2f 00007f2740a0fd4b 00007f2740b17c3e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc
0709 13:16:44.662726 (+1373128us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:43.411491 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:43.412198 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:43.412251 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:16:43.412283 (+    32us) tablet.cc:662] Decoding operations
0709 13:16:43.465188 (+ 52905us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:43.465313 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:43.465350 (+    37us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:16:43.467127 (+  1777us) tablet.cc:701] Row locks acquired
0709 13:16:43.467191 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:16:43.467430 (+   239us) write_op.cc:270] Start()
0709 13:16:43.467647 (+   217us) write_op.cc:276] Timestamp: P: 1783603003467352 usec, L: 0
0709 13:16:43.467691 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:16:43.511258 (+ 43567us) log.cc:844] Serialized 6580 byte log entry
0709 13:16:43.895206 (+383948us) op_driver.cc:464] REPLICATION: finished
0709 13:16:44.009459 (+114253us) write_op.cc:301] APPLY: starting
0709 13:16:44.009573 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:44.122291 (+112718us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:44.122438 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:44.266024 (+143586us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:44.266377 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:16:44.266436 (+    59us) write_op.cc:312] APPLY: finished
0709 13:16:44.266846 (+   410us) log.cc:844] Serialized 156 byte log entry
0709 13:16:44.267038 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:44.267202 (+   164us) write_op.cc:454] Released schema lock
0709 13:16:44.267277 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:44.267747 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:44.267795 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":177548,"reported_tablets":44,"spinlock_wait_cycles":2434304,"child_traces":[["op",{"apply.queue_time_us":113889,"apply.run_cpu_time_us":24661,"apply.run_wall_time_us":258293,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":120629,"prepare.run_cpu_time_us":12738,"prepare.run_wall_time_us":213579,"raft.queue_time_us":214066,"raft.run_cpu_time_us":15624,"raft.run_wall_time_us":68202,"replication_time_us":427355,"spinlock_wait_cycles":76160,"thread_start_us":379270,"threads_started":4,"wal-append.queue_time_us":164837}]]}
I20260709 13:16:44.671043 31596 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:16:44.670131  4320 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:44.685817 30949 raft_consensus.cc:2410] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:16:44.685614 30779 catalog_manager.cc:5697] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 17 to 20, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 20 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.649375  4257 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:16:44.704053  4214 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:44.706094 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:44.707027 30958 raft_consensus.cc:2410] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74f5a5b7556240508983221981af4ab4 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:16:44.650207  4349 consensus_queue.cc:1048] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:16:44.709964 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:44.687134 30779 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 15, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.722160 30779 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.732249 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:44.733826 30779 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 11, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 11 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.736352 30779 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 9 to 11, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 11 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.751297 30779 catalog_manager.cc:5697] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.759261 30779 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 17, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 17 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.732288  4214 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:44.760697 30779 catalog_manager.cc:5697] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 7 to 14, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 14 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:44.750461  4257 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:16:44.794567 30883 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:44.778499 30779 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.821944 30779 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 14, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 14 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:44.843881 30779 catalog_manager.cc:5697] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 13, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 13 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.854370 30779 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 14, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.861620 30779 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:44.804529  4268 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:16:44.867892 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45047.6us
I20260709 13:16:44.865846 30779 catalog_manager.cc:5697] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.880362 31023 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:44.898831 30779 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 17, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 17 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:44.935318  4412 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:16:44.937785  4417 log.cc:927] Time spent T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:44.908638 30779 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.983975  3991 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:45.003902 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 131183us
I20260709 13:16:45.035820 30952 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:16:45.124445  4418 log.cc:927] Time spent T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:16:45.176219 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 104074us
W20260709 13:16:45.177347 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 92764.7us
W20260709 13:16:45.188094 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 118892us
I20260709 13:16:45.219715 31598 raft_consensus.cc:1275] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:16:45.224453  4428 log.cc:927] Time spent T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:16:45.324030  4410 log.cc:927] Time spent T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:16:45.314792  3720 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:16:45.386793 30954 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer 95b998a6735f4180986a8b8f7d84b8fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:45.475682 31024 raft_consensus.cc:1275] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:16:45.498776 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 62743.9us
I20260709 13:16:45.509084 31024 raft_consensus.cc:1275] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:16:45.560294 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 55609.9us
I20260709 13:16:45.572558 31596 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:16:45.571365  3505 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:16:45.584522  4430 log.cc:927] Time spent T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:45.584959  4436 consensus_queue.cc:1048] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:45.567574  4320 consensus_queue.cc:1048] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:16:45.588099 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet d95504ff00154bdf99a5de1ad11f4f58 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:57118
I20260709 13:16:45.622376  4461 tablet_replica.cc:333] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:16:45.608335  3960 raft_consensus.cc:493] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.635604  3960 raft_consensus.cc:515] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:45.643260  3960 leader_election.cc:290] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:45.647176 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:45.651547 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f210916a06449d99b2c71170e4d3d68" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:45.659451  4429 consensus_queue.cc:1048] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:45.665189  4431 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:45.680923 31570 leader_election.cc:304] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:45.698626 30954 raft_consensus.cc:1275] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:16:45.699083 30954 pending_rounds.cc:85] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Aborting all ops after (but not including) 11
I20260709 13:16:45.699304 30954 pending_rounds.cc:107] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:16:45.699568 30954 raft_consensus.cc:2889] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.720865  4458 consensus_queue.cc:1048] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:45.739329  4461 raft_consensus.cc:2243] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.740486  4461 pending_rounds.cc:70] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Trying to abort 1 pending ops.
I20260709 13:16:45.740816  4461 pending_rounds.cc:77] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7305637665158795264 op_type: NO_OP noop_request { }
I20260709 13:16:45.741336  4461 raft_consensus.cc:2889] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:45.742770  4461 raft_consensus.cc:2272] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.763976  4461 ts_tablet_manager.cc:1916] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:45.822507  4215 raft_consensus.cc:2749] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:45.844340  4464 log.cc:927] Time spent T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:16:45.875892  4467 log.cc:927] Time spent T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:16:45.981566  4461 ts_tablet_manager.cc:1929] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:16:45.982174  4461 log.cc:1199] T d95504ff00154bdf99a5de1ad11f4f58 P f535fccbafb14e3f92bd45065da403db: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/wals/d95504ff00154bdf99a5de1ad11f4f58
I20260709 13:16:46.048768 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet d95504ff00154bdf99a5de1ad11f4f58 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:16:46.164680 30957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51632
I20260709 13:16:46.165251 30957 raft_consensus.cc:606] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Received request to transfer leadership
I20260709 13:16:46.173314 30957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51632
I20260709 13:16:46.174028 30957 raft_consensus.cc:606] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Received request to transfer leadership
W20260709 13:16:46.175287 30767 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0daef7b4af5348a298c365152f0bea47 already in progress [suppressed 4 similar messages]
W20260709 13:16:46.241046 30767 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 65789.5us
I20260709 13:16:46.242427 30957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51632
I20260709 13:16:46.242933 30957 raft_consensus.cc:606] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Received request to transfer leadership
I20260709 13:16:46.254827 30776 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.256892 30776 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 8 to 4, term changed from 13 to 8, leader changed from <none> to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) added, now has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 8 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } attrs { replace: true } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
W20260709 13:16:46.286715 30829 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:16:46.287195 30829 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0daef7b4af5348a298c365152f0bea47 already in progress
W20260709 13:16:46.287497 30829 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0daef7b4af5348a298c365152f0bea47 already in progress
I20260709 13:16:46.297540 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet d95504ff00154bdf99a5de1ad11f4f58 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:57118
I20260709 13:16:46.303840 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet d95504ff00154bdf99a5de1ad11f4f58 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:16:46.302888 30779 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55002 (request call id 354) took 3584 ms. Trace:
I20260709 13:16:46.306722 30779 rpcz_store.cc:276] 0709 13:16:42.723836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.728622 (+  4786us) service_pool.cc:224] Handling call
0709 13:16:46.297767 (+3569145us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:45.372733 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:45.494049 (+121316us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:45.494865 (+   816us) write_op.cc:435] Acquired schema lock
0709 13:16:45.498262 (+  3397us) tablet.cc:662] Decoding operations
0709 13:16:45.617610 (+119348us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:45.617668 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:45.617685 (+    17us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:16:45.619118 (+  1433us) tablet.cc:701] Row locks acquired
0709 13:16:45.619132 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:16:45.619238 (+   106us) write_op.cc:270] Start()
0709 13:16:45.619322 (+    84us) write_op.cc:276] Timestamp: P: 1783603005619204 usec, L: 0
0709 13:16:45.619337 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:16:45.628120 (+  8783us) log.cc:844] Serialized 12484 byte log entry
0709 13:16:45.846775 (+218655us) op_driver.cc:464] REPLICATION: finished
0709 13:16:45.931293 (+ 84518us) write_op.cc:301] APPLY: starting
0709 13:16:45.931393 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:46.073407 (+142014us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:46.073500 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:46.151469 (+ 77969us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:46.151934 (+   465us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0709 13:16:46.151990 (+    56us) write_op.cc:312] APPLY: finished
0709 13:16:46.152600 (+   610us) log.cc:844] Serialized 276 byte log entry
0709 13:16:46.153459 (+   859us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.153738 (+   279us) write_op.cc:454] Released schema lock
0709 13:16:46.155121 (+  1383us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:46.157365 (+  2244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.157398 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":176026,"reported_tablets":46,"spinlock_wait_cycles":1392384,"child_traces":[["op",{"apply.queue_time_us":84278,"apply.run_cpu_time_us":42928,"apply.run_wall_time_us":226055,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137951,"num_ops":32,"prepare.queue_time_us":127971,"prepare.run_cpu_time_us":24618,"prepare.run_wall_time_us":433586,"raft.queue_time_us":72291,"raft.run_cpu_time_us":11834,"raft.run_wall_time_us":89973,"replication_time_us":227273,"thread_start_us":373946,"threads_started":4,"wal-append.queue_time_us":143853}]]}
I20260709 13:16:46.342881 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:46.350320 30776 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 248) took 46656 ms (client timeout 15000 ms). Trace:
W20260709 13:16:46.350805 30776 rpcz_store.cc:269] 0709 13:15:59.692729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.699641 (+  6912us) service_pool.cc:224] Handling call
0709 13:15:59.944419 (+244778us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5400260054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc4090 00007f273ac62f3a 00007f2740a191cc 00007f2740b1737e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc 00007f273efd7392 00007f2738f9548c 00007f2738f948c6
0709 13:16:46.348832 (+46404413us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:46.288277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:46.292769 (+  4492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:46.292812 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:16:46.292828 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:46.293305 (+   477us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:46.293366 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:46.293401 (+    35us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:46.293679 (+   278us) tablet.cc:701] Row locks acquired
0709 13:16:46.293694 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:16:46.293851 (+   157us) write_op.cc:270] Start()
0709 13:16:46.293968 (+   117us) write_op.cc:276] Timestamp: P: 1783603006293805 usec, L: 0
0709 13:16:46.293986 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:46.294644 (+   658us) log.cc:844] Serialized 1160 byte log entry
0709 13:16:46.297686 (+  3042us) op_driver.cc:464] REPLICATION: finished
0709 13:16:46.298202 (+   516us) write_op.cc:301] APPLY: starting
0709 13:16:46.298306 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:46.300073 (+  1767us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:46.300188 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:46.301757 (+  1569us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:46.301978 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:16:46.302027 (+    49us) write_op.cc:312] APPLY: finished
0709 13:16:46.302229 (+   202us) log.cc:844] Serialized 33 byte log entry
0709 13:16:46.302410 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.302501 (+    91us) write_op.cc:454] Released schema lock
0709 13:16:46.302543 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:46.309554 (+  7011us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.309584 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":89364,"reported_tablets":44,"spinlock_wait_cycles":24775040,"child_traces":[["op",{"apply.queue_time_us":295,"apply.run_cpu_time_us":4730,"apply.run_wall_time_us":6242,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":2827,"prepare.run_wall_time_us":6656,"replication_time_us":3543}]]}
I20260709 13:16:46.378268 30777 catalog_manager.cc:5697] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.397444  4434 raft_consensus.cc:993] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:46.398065  3996 raft_consensus.cc:1081] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:46.411055 31023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36670
I20260709 13:16:46.411706 31023 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.412106 31023 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.416643 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:46.417394 31024 raft_consensus.cc:606] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:46.420809 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ab89a799c64088901472d6633cfb83"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:46.421386 31024 raft_consensus.cc:606] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:46.424216 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:46.424789 31024 raft_consensus.cc:606] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:46.380595 30777 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: config changed from index 4 to 8, term changed from 8 to 12, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to <none>, VOTER f535fccbafb14e3f92bd45065da403db (127.29.5.131) evicted, no longer has a pending config: VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129), VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130), VOTER 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 12 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.427614 31024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:46.434594 31024 raft_consensus.cc:606] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:46.439723 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e61719587d824d0680b05c15592027a3"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
mode: GRACEFUL
new_leader_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:45416
I20260709 13:16:46.440302 31031 raft_consensus.cc:606] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Received request to transfer leadership to TS 74f5a5b7556240508983221981af4ab4
I20260709 13:16:46.441398 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:46.434017 30777 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 9 to 10, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 10 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.443113 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:46.443109 30777 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.453290 31023 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.464723 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:46.465392 30883 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.527185 30883 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:46.542138  4389 raft_consensus.cc:993] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.542670  4389 raft_consensus.cc:1081] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.555748 31605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:16:46.556442 31605 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.556764 31605 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.561991 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:46.562665 31596 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.562873 31023 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:46.576205 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:46.576781 30957 raft_consensus.cc:3055] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:46.577075 30957 raft_consensus.cc:740] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:46.577826 30957 consensus_queue.cc:260] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.580525 30957 raft_consensus.cc:3060] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.544862 30777 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 11 to 13, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 13 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.599037 31596 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:46.600196 30996 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:46.606099  3679 raft_consensus.cc:2804] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:46.610812 30957 raft_consensus.cc:2468] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:46.605406 30777 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 9 to 11, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 11 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.606693  3679 raft_consensus.cc:697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:46.615801  3679 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.631078 31605 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.633508 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:46.634668 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:46.635569 31024 raft_consensus.cc:3055] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:46.635938 31024 raft_consensus.cc:740] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:46.636830 31024 consensus_queue.cc:260] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.638180 31024 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.639243 30777 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 9 to 10, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 10 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.634217 30883 raft_consensus.cc:3060] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:46.648164 31605 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:46.668362 30883 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:46.669113 31024 raft_consensus.cc:2468] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:46.669759 31571 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:46.670733  4424 raft_consensus.cc:2804] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:46.671271  4424 raft_consensus.cc:697] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:46.672250  4424 consensus_queue.cc:237] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.723680  3679 raft_consensus.cc:993] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.724309  3679 raft_consensus.cc:1081] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.737323 31605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e61719587d824d0680b05c15592027a3"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:16:46.738050 31605 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.738473 31605 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:46.747180 31605 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.769140 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:46.769380 31605 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:46.769773 30883 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:46.772066 30776 catalog_manager.cc:5697] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 12, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 12 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:46.774144 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:46.773916 30776 catalog_manager.cc:5697] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 9 to 14, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.774713 31024 raft_consensus.cc:3055] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:46.775092 31024 raft_consensus.cc:740] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:46.775873 31024 consensus_queue.cc:260] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.775910 30776 catalog_manager.cc:5697] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 14, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 14 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.777109 31024 raft_consensus.cc:3060] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:46.777455 30776 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 15, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:46.792528 30776 catalog_manager.cc:5697] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 15 to 16, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 16 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.793622 30883 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
I20260709 13:16:46.794873 31571 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:46.795809  4427 raft_consensus.cc:2804] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:46.796326  4427 raft_consensus.cc:697] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:46.797204  4427 consensus_queue.cc:237] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.801364 31024 raft_consensus.cc:2468] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
I20260709 13:16:46.799932 30776 catalog_manager.cc:5697] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 15, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 15 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.823940  4453 raft_consensus.cc:993] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:46.824594  4453 raft_consensus.cc:1081] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:46.827160 30952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ab89a799c64088901472d6633cfb83"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51636
I20260709 13:16:46.827733 30952 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.828101 30952 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.884349  3679 raft_consensus.cc:993] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.884941  3679 raft_consensus.cc:1081] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.891399 31599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:16:46.892004 31599 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:46.892385 31599 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:46.804960 30776 catalog_manager.cc:5697] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 12, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 12 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.897691 31018 tablet_service.cc:1558] Processing DeleteTablet for tablet d95504ff00154bdf99a5de1ad11f4f58 with delete_type TABLET_DATA_TOMBSTONED (TS f535fccbafb14e3f92bd45065da403db not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:57118
I20260709 13:16:46.897679 30776 catalog_manager.cc:5697] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 14, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 14 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:46.911072 30776 catalog_manager.cc:5697] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 13, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
W20260709 13:16:46.918375 30777 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54998 (request call id 325) took 25387 ms (client timeout 15000 ms). Trace:
W20260709 13:16:46.918944 30777 rpcz_store.cc:269] 0709 13:16:21.657188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.693714 (+ 36526us) service_pool.cc:224] Handling call
0709 13:16:46.918267 (+25224553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:46.675029 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:46.675627 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:46.675667 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:16:46.675686 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:46.676577 (+   891us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:46.676643 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:46.676675 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:46.677300 (+   625us) tablet.cc:701] Row locks acquired
0709 13:16:46.677320 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:46.677485 (+   165us) write_op.cc:270] Start()
0709 13:16:46.677603 (+   118us) write_op.cc:276] Timestamp: P: 1783603006677438 usec, L: 0
0709 13:16:46.677630 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:16:46.679143 (+  1513us) log.cc:844] Serialized 2781 byte log entry
0709 13:16:46.681436 (+  2293us) op_driver.cc:464] REPLICATION: finished
0709 13:16:46.681942 (+   506us) write_op.cc:301] APPLY: starting
0709 13:16:46.682023 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:46.689552 (+  7529us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:46.689692 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:46.696616 (+  6924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:46.735910 (+ 39294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:16:46.735967 (+    57us) write_op.cc:312] APPLY: finished
0709 13:16:46.736226 (+   259us) log.cc:844] Serialized 73 byte log entry
0709 13:16:46.748177 (+ 11951us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.748290 (+   113us) write_op.cc:454] Released schema lock
0709 13:16:46.748336 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:46.748768 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:46.748799 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":12891,"apply.run_wall_time_us":66765,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29274,"num_ops":7,"prepare.queue_time_us":3329,"prepare.run_cpu_time_us":3662,"prepare.run_wall_time_us":4399,"replication_time_us":3688}]]}
I20260709 13:16:46.940138 30952 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:46.942590 30883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:46.915089 30776 catalog_manager.cc:5697] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:46.943089 30883 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:46.947409 30776 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 15, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:46.948840 31599 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:46.949826 30776 catalog_manager.cc:5697] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 12 to 13, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 13 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:46.951149 30776 catalog_manager.cc:5697] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:46.952256 31599 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:46.953697 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:46.954417 30880 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:46.955379 30952 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:46.957458 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:46.958016 31024 raft_consensus.cc:3055] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:46.958252 31024 raft_consensus.cc:740] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:46.961519 30883 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:46.962615 30924 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:46.958920  4453 raft_consensus.cc:993] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: : Instructing follower 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.972333  4453 raft_consensus.cc:1081] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Signalling peer 74f5a5b7556240508983221981af4ab4 to start an election
I20260709 13:16:46.975419 30767 catalog_manager.cc:5028] TS f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): tablet d95504ff00154bdf99a5de1ad11f4f58 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:16:46.976951  4434 raft_consensus.cc:2804] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:46.977674  4434 raft_consensus.cc:697] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:46.978889  4434 consensus_queue.cc:237] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:47.028133 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 87799.4us
I20260709 13:16:47.032780 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:47.033437 31031 raft_consensus.cc:3055] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:47.033744 31031 raft_consensus.cc:740] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:47.032301 30880 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:47.036602 31571 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:47.041891  4485 raft_consensus.cc:2804] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:47.042449  4485 raft_consensus.cc:697] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:47.046933 31031 consensus_queue.cc:260] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:47.048430 31031 raft_consensus.cc:3060] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:47.043445  4485 consensus_queue.cc:237] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:47.059571 31024 consensus_queue.cc:260] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:47.067662 31024 raft_consensus.cc:3060] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:47.067032 31031 raft_consensus.cc:2468] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 12.
I20260709 13:16:47.083350 30875 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:47.084968  4427 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:47.087284 31024 raft_consensus.cc:2468] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
W20260709 13:16:47.088124 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 124840us
I20260709 13:16:47.095441 30957 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:47.097348  4453 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:47.102412  4483 log.cc:927] Time spent T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.078s	user 0.000s	sys 0.010s
I20260709 13:16:47.112018 31599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2"
dest_uuid: "74f5a5b7556240508983221981af4ab4"
 from {username='slave'} at 127.0.0.1:54208
I20260709 13:16:47.112677 31599 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.113040 31599 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.144786 31599 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:47.149050 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:47.149641 30880 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.175242 30880 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
I20260709 13:16:47.180078 31599 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:47.181131 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:47.181763 31024 raft_consensus.cc:3055] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:16:47.181715 31571 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc; no voters: 
I20260709 13:16:47.182512 31024 raft_consensus.cc:740] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:47.183255 31024 consensus_queue.cc:260] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:47.187259 31024 raft_consensus.cc:3060] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:47.187503  4485 raft_consensus.cc:2804] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:47.196861 31025 raft_consensus.cc:1275] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:47.197157  4485 raft_consensus.cc:697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:47.189509 31031 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:47.198300  4485 consensus_queue.cc:237] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:47.201196  4486 consensus_queue.cc:1048] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:16:47.202018  4424 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:47.212007 31024 raft_consensus.cc:2468] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 18.
I20260709 13:16:47.227640 30880 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:47.228159 31599 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:16:47.230039  4343 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:47.231421  4453 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:47.291278 30778 catalog_manager.cc:5697] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 11 to 15, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 15 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.318514 30875 raft_consensus.cc:1275] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:47.319865 30778 catalog_manager.cc:5697] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 10 to 13, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 13 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.321842 30778 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 12 to 15, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.328850  4424 consensus_queue.cc:1048] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:47.328481 30778 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 14 to 16, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 16 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.384604 30778 catalog_manager.cc:5697] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 15 to 18, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 18 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.386184 30778 catalog_manager.cc:5697] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 12 to 15, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 15 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.414067 30778 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 15 to 17, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 17 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.426348 30829 placement_policy_util.cc:248] tablet d95504ff00154bdf99a5de1ad11f4f58: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:16:47.415517 30778 catalog_manager.cc:5697] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 8 to 15, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 15 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.428848 30778 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 13 to 17, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 17 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.444347 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:47.461462 30778 catalog_manager.cc:5697] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.480582 31025 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:47.482421  4425 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:47.487890 30778 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 11 to 12, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 12 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.501726 30875 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:47.503572  4397 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:47.543617 31031 raft_consensus.cc:1275] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:47.548424  4434 consensus_queue.cc:1048] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:47.564458 30875 raft_consensus.cc:1275] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:16:47.566001  4424 consensus_queue.cc:1048] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:47.591959 30882 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:47.598883  4425 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:47.638981 30778 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 362) took 5998 ms. Trace:
I20260709 13:16:47.645340 30781 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 12 to 13, leader changed from <none> to 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129). New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.658910 30781 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.649029 31023 raft_consensus.cc:1275] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:47.661173  4486 consensus_queue.cc:1048] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:16:47.663385 30778 rpcz_store.cc:276] 0709 13:16:41.640977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.641131 (+   154us) service_pool.cc:224] Handling call
0709 13:16:47.638900 (+5997769us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:47.517942 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:47.518915 (+   973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:47.518956 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:16:47.518975 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:47.520025 (+  1050us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:47.520085 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:47.520115 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:47.521067 (+   952us) tablet.cc:701] Row locks acquired
0709 13:16:47.521085 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:47.521224 (+   139us) write_op.cc:270] Start()
0709 13:16:47.521337 (+   113us) write_op.cc:276] Timestamp: P: 1783603007521181 usec, L: 0
0709 13:16:47.521359 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:47.521938 (+   579us) log.cc:844] Serialized 4330 byte log entry
0709 13:16:47.529339 (+  7401us) op_driver.cc:464] REPLICATION: finished
0709 13:16:47.530224 (+   885us) write_op.cc:301] APPLY: starting
0709 13:16:47.530319 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:47.538951 (+  8632us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:47.539036 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:47.597759 (+ 58723us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:47.597986 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:16:47.598028 (+    42us) write_op.cc:312] APPLY: finished
0709 13:16:47.598325 (+   297us) log.cc:844] Serialized 105 byte log entry
0709 13:16:47.598487 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.598614 (+   127us) write_op.cc:454] Released schema lock
0709 13:16:47.598664 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:47.599021 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.599052 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":625,"apply.run_cpu_time_us":15374,"apply.run_wall_time_us":68770,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46002,"num_ops":11,"prepare.queue_time_us":2956,"prepare.run_cpu_time_us":3947,"prepare.run_wall_time_us":8759,"replication_time_us":5399}]]}
I20260709 13:16:47.681005 30776 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 15, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.727154 30781 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54998 (request call id 326) took 6495 ms. Trace:
I20260709 13:16:47.727686 30781 rpcz_store.cc:276] 0709 13:16:41.231971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.232168 (+   197us) service_pool.cc:224] Handling call
0709 13:16:47.727081 (+6494913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:47.664594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:47.665088 (+   494us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:47.665124 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:47.665141 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:47.665566 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:47.665620 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:47.665646 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:47.665939 (+   293us) tablet.cc:701] Row locks acquired
0709 13:16:47.665957 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:47.666080 (+   123us) write_op.cc:270] Start()
0709 13:16:47.666182 (+   102us) write_op.cc:276] Timestamp: P: 1783603007666038 usec, L: 0
0709 13:16:47.666201 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:47.666788 (+   587us) log.cc:844] Serialized 913 byte log entry
0709 13:16:47.669066 (+  2278us) op_driver.cc:464] REPLICATION: finished
0709 13:16:47.670218 (+  1152us) write_op.cc:301] APPLY: starting
0709 13:16:47.670318 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:47.671939 (+  1621us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:47.672050 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:47.673627 (+  1577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:47.673833 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:16:47.673889 (+    56us) write_op.cc:312] APPLY: finished
0709 13:16:47.674087 (+   198us) log.cc:844] Serialized 33 byte log entry
0709 13:16:47.675056 (+   969us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.675155 (+    99us) write_op.cc:454] Released schema lock
0709 13:16:47.675196 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:47.675554 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.675584 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1403,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":965,"apply.run_cpu_time_us":4491,"apply.run_wall_time_us":5300,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":2459,"prepare.run_wall_time_us":2460,"replication_time_us":2768}]]}
W20260709 13:16:47.782531 30780 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54990 (request call id 361) took 22909 ms (client timeout 15000 ms). Trace:
W20260709 13:16:47.783042 30780 rpcz_store.cc:269] 0709 13:16:24.873018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.873295 (+   277us) service_pool.cc:224] Handling call
0709 13:16:47.782341 (+22909046us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":755240,"reported_tablets":45}
I20260709 13:16:47.784441 30776 catalog_manager.cc:5697] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 17 to 18, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 18 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.786041 30776 catalog_manager.cc:5697] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 11 to 12, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 12 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.787381 30776 catalog_manager.cc:5697] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 15 to 16, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 16 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.788658 30776 catalog_manager.cc:5697] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 15, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 15 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } }
I20260709 13:16:47.790863 30776 catalog_manager.cc:5697] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 17 to 18, leader changed from f535fccbafb14e3f92bd45065da403db (127.29.5.131) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 18 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.824333 31025 consensus_queue.cc:237] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:47.831318 31605 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:47.832157 30882 raft_consensus.cc:1275] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:16:47.833042  4343 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:47.835429  4458 consensus_queue.cc:1048] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:47.838205 30774 catalog_manager.cc:5697] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 12 to 13, leader changed from 74f5a5b7556240508983221981af4ab4 (127.29.5.132) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 13 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.847234 30774 catalog_manager.cc:5697] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 11 to 15, leader changed from bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 15 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.851038 31605 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 4 to 12, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.852211 30875 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 4 to 12, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.845788  4458 raft_consensus.cc:2955] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 4 to 12, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.882474 30781 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.884822 30781 catalog_manager.cc:5697] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:47.886225 30781 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "95b998a6735f4180986a8b8f7d84b8fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.917619 30767 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0daef7b4af5348a298c365152f0bea47 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.942662 30774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37940 (request call id 250) took 4450 ms. Trace:
I20260709 13:16:47.943424 30774 rpcz_store.cc:276] 0709 13:16:43.492576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.492883 (+   307us) service_pool.cc:224] Handling call
0709 13:16:43.697454 (+204571us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400260054. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f273abc4090 00007f273ac62f3a 00007f2740a191cc 00007f2740b1737e 00007f273efd82a4 00007f273efd8232 00007f273efd8161 00007f273efd80dc 00007f273efd7392 00007f2738f9548c 00007f2738f948c6
0709 13:16:47.861300 (+4163846us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.861338 (+    38us) write_op.cc:454] Released schema lock
0709 13:16:47.942584 (+ 81246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:47.851471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:47.852349 (+   878us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:47.852402 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:16:47.852421 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:47.852807 (+   386us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:47.852868 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:47.852899 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:47.853219 (+   320us) tablet.cc:701] Row locks acquired
0709 13:16:47.853240 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:47.853380 (+   140us) write_op.cc:270] Start()
0709 13:16:47.853483 (+   103us) write_op.cc:276] Timestamp: P: 1783603007853336 usec, L: 0
0709 13:16:47.853506 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:47.854075 (+   569us) log.cc:844] Serialized 913 byte log entry
0709 13:16:47.856063 (+  1988us) op_driver.cc:464] REPLICATION: finished
0709 13:16:47.856587 (+   524us) write_op.cc:301] APPLY: starting
0709 13:16:47.856660 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:47.858009 (+  1349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:47.858107 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:47.859480 (+  1373us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:47.859676 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:16:47.859730 (+    54us) write_op.cc:312] APPLY: finished
0709 13:16:47.859949 (+   219us) log.cc:844] Serialized 33 byte log entry
0709 13:16:47.860101 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:47.860184 (+    83us) write_op.cc:454] Released schema lock
0709 13:16:47.860225 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"dns_us":257,"reported_tablets":44,"spinlock_wait_cycles":263608704,"child_traces":[["op",{"apply.queue_time_us":345,"apply.run_cpu_time_us":3924,"apply.run_wall_time_us":3931,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":160,"prepare.run_cpu_time_us":2658,"prepare.run_wall_time_us":2885,"replication_time_us":2434}]]}
I20260709 13:16:47.959048 30776 catalog_manager.cc:5697] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db reported cstate change: config changed from index 4 to 12, VOTER bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130) evicted. New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.005611 30945 tablet_service.cc:1558] Processing DeleteTablet for tablet 0daef7b4af5348a298c365152f0bea47 with delete_type TABLET_DATA_TOMBSTONED (TS bda0856a7efd4d0e96615b66bef383c6 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51632
I20260709 13:16:48.030223  4514 tablet_replica.cc:333] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:16:48.038697 31605 consensus_queue.cc:237] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:48.038726  4514 raft_consensus.cc:2243] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.053507  4514 raft_consensus.cc:2272] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.066354  4514 ts_tablet_manager.cc:1916] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:48.092695 31023 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:48.094993  4427 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:48.106549 30954 raft_consensus.cc:1275] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:16:48.108886  4425 consensus_queue.cc:1048] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:48.130550  4486 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 5 to 12, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:48.135905 31024 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 5 to 12, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:48.138728 30954 raft_consensus.cc:2955] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 5 to 12, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } } }
I20260709 13:16:48.166605 30766 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3909ef5ede2e43f1872fec585566b998 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:48.168633  4514 ts_tablet_manager.cc:1929] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:16:48.169080  4514 log.cc:1199] T 0daef7b4af5348a298c365152f0bea47 P bda0856a7efd4d0e96615b66bef383c6: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/wals/0daef7b4af5348a298c365152f0bea47
I20260709 13:16:48.170732 30767 catalog_manager.cc:5028] TS bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): tablet 0daef7b4af5348a298c365152f0bea47 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:16:48.176213 30774 catalog_manager.cc:5697] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 reported cstate change: config changed from index 5 to 12, VOTER 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) evicted. New cstate: current_term: 18 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.209479 30866 tablet_service.cc:1558] Processing DeleteTablet for tablet 3909ef5ede2e43f1872fec585566b998 with delete_type TABLET_DATA_TOMBSTONED (TS 95b998a6735f4180986a8b8f7d84b8fc not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:34340
W20260709 13:16:48.216154 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 45137.3us
I20260709 13:16:48.254024  4519 tablet_replica.cc:333] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:48.262285  4519 raft_consensus.cc:2243] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.263419  4519 raft_consensus.cc:2272] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.280709  4519 ts_tablet_manager.cc:1916] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:48.330526  4519 ts_tablet_manager.cc:1929] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 13:16:48.344017  4519 log.cc:1199] T 3909ef5ede2e43f1872fec585566b998 P 95b998a6735f4180986a8b8f7d84b8fc: Deleting WAL directory at /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/wals/3909ef5ede2e43f1872fec585566b998
I20260709 13:16:48.350335 30768 catalog_manager.cc:5028] TS 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): tablet 3909ef5ede2e43f1872fec585566b998 (table test-workload [id=e436a38e5fbb442c80119635c71a3d0d]) successfully deleted
I20260709 13:16:48.525514 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:48.723344 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:48.724022 30875 raft_consensus.cc:606] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:16:48.729323 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:48.729836 30875 raft_consensus.cc:606] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Received request to transfer leadership to TS f535fccbafb14e3f92bd45065da403db
I20260709 13:16:48.745427 30875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58"
dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
mode: GRACEFUL
new_leader_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:57298
I20260709 13:16:48.746101 30875 raft_consensus.cc:606] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Received request to transfer leadership to TS bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:48.748238 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:48.751000 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:48.851380  4446 raft_consensus.cc:993] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:48.851981  4446 raft_consensus.cc:1081] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:48.860018 31024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:16:48.860571 31024 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.860890 31024 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.899988 31024 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:48.902799 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:48.903421 30882 raft_consensus.cc:3055] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:48.903718 30882 raft_consensus.cc:740] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:48.904585 30882 consensus_queue.cc:260] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:48.905682 30882 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.914940 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:48.915598 30954 raft_consensus.cc:3060] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.950847  3924 raft_consensus.cc:993] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:48.951496  3924 raft_consensus.cc:1081] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Signalling peer bda0856a7efd4d0e96615b66bef383c6 to start an election
I20260709 13:16:48.970310 30952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58"
dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
 from {username='slave'} at 127.0.0.1:51648
I20260709 13:16:48.971009 30952 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.971655 30952 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:48.988261 30954 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:48.993495 31024 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:48.996423 30997 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:48.997318  4343 raft_consensus.cc:2804] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:48.997861  4343 raft_consensus.cc:697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:48.990005 30882 raft_consensus.cc:2468] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:48.998659  4343 consensus_queue.cc:237] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:49.004806 30952 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:49.013568 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:49.014297 30882 raft_consensus.cc:3055] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:16:49.014650 30882 raft_consensus.cc:740] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:49.015578 30952 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:49.015854 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:49.016789 31605 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.020573 30882 consensus_queue.cc:260] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:49.028764 30882 raft_consensus.cc:3060] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:49.026295 31605 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:49.057339 30922 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:49.058172  4434 raft_consensus.cc:2804] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:49.058691  4434 raft_consensus.cc:697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:49.059533  4434 consensus_queue.cc:237] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:49.067641 30882 raft_consensus.cc:2468] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:49.125664 30774 catalog_manager.cc:5697] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 16 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.135735 30776 catalog_manager.cc:5697] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 16 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.145659  4446 raft_consensus.cc:993] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: : Instructing follower f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:49.146221  4446 raft_consensus.cc:1081] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Signalling peer f535fccbafb14e3f92bd45065da403db to start an election
I20260709 13:16:49.153149 31023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e"
dest_uuid: "f535fccbafb14e3f92bd45065da403db"
 from {username='slave'} at 127.0.0.1:36654
I20260709 13:16:49.153793 31023 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.154207 31023 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.197889 31023 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:49.222004 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "95b998a6735f4180986a8b8f7d84b8fc"
I20260709 13:16:49.222612 30882 raft_consensus.cc:3055] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:16:49.222894 30882 raft_consensus.cc:740] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 95b998a6735f4180986a8b8f7d84b8fc, State: Running, Role: LEADER
I20260709 13:16:49.223621 30882 consensus_queue.cc:260] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:49.224687 30882 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.227046 31023 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:49.231805 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:49.233675 30954 raft_consensus.cc:3060] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:49.246752 30882 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:49.250439 30998 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:49.251327  4343 raft_consensus.cc:2804] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:49.251945  4343 raft_consensus.cc:697] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:49.252851  4343 consensus_queue.cc:237] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:49.248227 30954 raft_consensus.cc:2468] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:49.270989 30776 catalog_manager.cc:5697] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 15, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:49.618253 30875 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:49.623152  4434 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:49.650656 30952 raft_consensus.cc:1275] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:16:49.667423  4343 consensus_queue.cc:1048] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:49.688247 31596 raft_consensus.cc:1275] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:16:49.691367  4523 consensus_queue.cc:1048] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:49.702032 30952 raft_consensus.cc:1275] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:16:49.752187 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:49.770010  4343 consensus_queue.cc:1048] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:49.949056 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
W20260709 13:16:50.012948 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 61470.5us
W20260709 13:16:50.029556 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 56447us
W20260709 13:16:50.035564 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.080428 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 50392.7us
W20260709 13:16:50.141908 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 123518us
W20260709 13:16:50.150228 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 68115.7us
W20260709 13:16:50.228762 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.232292 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.253351 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.264164 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.266646 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.255900 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 97355.1us
W20260709 13:16:50.267234 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.265169 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 90401.7us
W20260709 13:16:50.261925 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 175914us
W20260709 13:16:50.291824 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.268011 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.295815 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.304117 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.306676 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.322870 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.325892 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.328660 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.329413 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.329996 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.330610 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.331210 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.333236 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.332314 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.334982 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.337574 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.340062 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.344209 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.343318 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.359010 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.372313 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:50.374442 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.626976  4446 raft_consensus.cc:493] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:50.627987  4446 raft_consensus.cc:515] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:50.633847  4446 leader_election.cc:290] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:50.635248 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:50.637311 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72bcdd8ce60141b4a8ae93bf6451b437" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:50.644359 30847 leader_election.cc:304] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:50.651803  4446 raft_consensus.cc:2749] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:50.704366  4518 raft_consensus.cc:493] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:50.704970  4518 raft_consensus.cc:515] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:50.707212  4518 leader_election.cc:290] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:50.709263 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:50.710506 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "076984be4730440fba459e1d130954f5" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:50.712831 30848 leader_election.cc:304] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:50.714375  4518 raft_consensus.cc:2749] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:50.812014  4518 raft_consensus.cc:493] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.812713  4518 raft_consensus.cc:515] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:50.815099  4518 leader_election.cc:290] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:50.816447 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:50.829361 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 138534us
W20260709 13:16:51.239871 30997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.038s
W20260709 13:16:51.240295 30997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.038s
I20260709 13:16:51.262197 31024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b00f9d4e8d04efbaf4620845ca672d7" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.364642  4568 raft_consensus.cc:493] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.370015  4568 raft_consensus.cc:515] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.373651  4568 leader_election.cc:290] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.376228  4568 raft_consensus.cc:493] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.377456  4573 raft_consensus.cc:493] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.376839  4565 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.376709  4568 raft_consensus.cc:515] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.388360  4568 leader_election.cc:290] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.378142  4573 raft_consensus.cc:515] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.398603  4568 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.399375  4568 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.400308  4573 leader_election.cc:290] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.400831  4573 raft_consensus.cc:493] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.401274  4573 raft_consensus.cc:515] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.385775  4565 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.404199  4565 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.403219  4573 leader_election.cc:290] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.410485  4580 raft_consensus.cc:493] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.411074  4580 raft_consensus.cc:515] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.438088  4584 raft_consensus.cc:493] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.444303  4584 raft_consensus.cc:515] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.453209  4568 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.414528  4573 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.465833  4580 leader_election.cc:290] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.466734  4573 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.469985  4573 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:51.479643 30996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.015s	sys 0.043s
W20260709 13:16:51.480087 30996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.016s	sys 0.043s
W20260709 13:16:51.500861 30924 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 46 similar messages]
I20260709 13:16:51.105827  4518 raft_consensus.cc:493] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.507565  4518 raft_consensus.cc:515] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.509517  4584 leader_election.cc:290] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.509711  4518 leader_election.cc:290] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.504084  4588 raft_consensus.cc:493] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.520135  4584 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.527878  4583 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.531818  4583 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.537949  4584 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.540621  4584 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.549453  4583 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.531068  4588 raft_consensus.cc:515] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.564306 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.568472  4588 leader_election.cc:290] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.569069  4592 raft_consensus.cc:493] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.571542  4587 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.574265  4587 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.580272  4592 raft_consensus.cc:515] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.586973 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66bbb42e064e8da439f811c09eb47c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.596549  4595 raft_consensus.cc:493] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.602916  4572 raft_consensus.cc:493] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.610519 31570 leader_election.cc:304] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.612622  4576 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.613953  4424 raft_consensus.cc:2749] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:51.616804  4576 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.618800  4576 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.625116  4592 leader_election.cc:290] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.612546  4572 raft_consensus.cc:515] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.637655  4576 raft_consensus.cc:493] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.639806  4576 raft_consensus.cc:515] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.641891  4576 leader_election.cc:290] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.643394  4587 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.644908  4593 raft_consensus.cc:493] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.646073  4593 raft_consensus.cc:515] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.650828  4593 leader_election.cc:290] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.614826  4595 raft_consensus.cc:515] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.653110  4566 raft_consensus.cc:493] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f535fccbafb14e3f92bd45065da403db)
I20260709 13:16:51.654374  4563 raft_consensus.cc:493] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.656241  4592 raft_consensus.cc:493] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.680106  4566 raft_consensus.cc:515] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.683055  4563 raft_consensus.cc:515] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.705523  4592 raft_consensus.cc:515] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.706120  4563 leader_election.cc:290] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.703684  4566 leader_election.cc:290] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.709379  4572 leader_election.cc:290] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.710700  4594 raft_consensus.cc:493] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.714109 30958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.714466 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.714919 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.711843  4564 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:16:51.715819 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.717981 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.715845 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.718341 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.720003 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.721225 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.722007 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd69fc9d45f54c7d900248ad54571d11" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.724115 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.726315 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.726598 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.727725  4567 raft_consensus.cc:493] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.739831  4592 leader_election.cc:290] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.742545 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c96de632da240f8a659ee13a19ef435" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.744009 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.735608 30848 leader_election.cc:304] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.711308  4594 raft_consensus.cc:515] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.749717  4584 raft_consensus.cc:493] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74f5a5b7556240508983221981af4ab4)
I20260709 13:16:51.749919 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e3faee40af435fab9e73535ef9df52" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.750218 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7378a710ae3644c686285da393d03ae1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.750310  4584 raft_consensus.cc:515] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.750795 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.730798  4567 raft_consensus.cc:515] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.752240  4563 raft_consensus.cc:2749] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:51.752523  4584 leader_election.cc:290] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.749948 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72ea41cd9114780855924982fc9b2a8" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.751538  4594 leader_election.cc:290] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.754191 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92cbaf1d3603474f977498657c46f628" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.754503 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdbb6fa9a0f3410e860b9d01eb25293d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.755604 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c9907b959044453b57011278bbecdff" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.755935 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d60dde9ca04c6d8ed4b863efa56b5c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.756290 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce19c3ff1834bd091f05b950c3df1e1" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.757879 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.759057 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.759855 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4763729fc346458245f7d6bca89a8c" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.760566 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7959c8f3c783472ab0e42eac55ff018a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.760835 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ada02d2b3964383bd24a8a7b03c7ceb" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.761861 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01eed2523a3452fbe85af4db99a20bf" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.763000  4567 leader_election.cc:290] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:51.768486 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca3b2e6549e45b7bced35922035bc4e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.745965  4564 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:51.769809 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.771597  4564 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.774564 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.775569 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.776301 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb2fb5af0cc748fc9f94576b72a2157d" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.774523 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.779110 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.781144 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.782114 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.783450  4595 leader_election.cc:290] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:51.779909 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.787954 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95504ff00154bdf99a5de1ad11f4f58" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.788206 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:51.789255 29718 tablet_replica.cc:333] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:51.792275 29718 raft_consensus.cc:2243] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.792920 29718 raft_consensus.cc:2272] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.796897 31032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:51.800205 29718 tablet_replica.cc:333] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:51.801157 29718 raft_consensus.cc:2243] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.808470 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee5193a8eea94bdd87b6db99fc59a40e" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.817651 29718 raft_consensus.cc:2272] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.834029 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.834893 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bced1836a1cd4749bcd4db4d53decc9a" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.846624 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0daef7b4af5348a298c365152f0bea47" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.848278 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9efafd3545426e86d2b3a0961f36cd" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.852883 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ab89a799c64088901472d6633cfb83" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.856739 30848 leader_election.cc:304] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.867805  4551 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:51.868501  4551 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:51.870908  4551 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:51.874650 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61719587d824d0680b05c15592027a3" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.876540 29718 tablet_replica.cc:333] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:51.877722 29718 raft_consensus.cc:2243] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:51.878033 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:51.878949 29718 raft_consensus.cc:2272] T fea166084ed848e08ef7f36b2a4b4e5f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:51.879900 30848 raft_consensus.cc:2686] T fd69fc9d45f54c7d900248ad54571d11 P 95b998a6735f4180986a8b8f7d84b8fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:51.881728 30848 leader_election.cc:304] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.882659  4595 raft_consensus.cc:2749] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.908972 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26cbe63a7a21474a881ca2ae72df9719" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.911908 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe26980d1594c1eb11b68b8a2a07295" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.913568 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d317b7eabb7461fb2fd34c7ccc257b2" candidate_uuid: "95b998a6735f4180986a8b8f7d84b8fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:51.921242 30848 leader_election.cc:304] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.922201  4593 raft_consensus.cc:2749] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:51.922727 30848 leader_election.cc:304] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.923609  4593 raft_consensus.cc:2749] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:51.924135 30848 leader_election.cc:304] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.925000  4593 raft_consensus.cc:2749] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.929304 30847 leader_election.cc:304] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.930044 30848 leader_election.cc:304] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.940418  4593 raft_consensus.cc:2749] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:51.943604 30848 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.944548  4595 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.945916 30848 leader_election.cc:304] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.919657 29718 tablet_replica.cc:333] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:51.947431 29718 raft_consensus.cc:2243] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.947919  4595 raft_consensus.cc:2749] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.949093  4593 raft_consensus.cc:2749] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.951943 29718 raft_consensus.cc:2272] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.949548 30847 leader_election.cc:304] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.955735  4593 raft_consensus.cc:2749] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.957302 30847 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:51.958127  4593 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.959503 30847 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:51.961211  4593 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.962476 30847 leader_election.cc:304] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:51.960572 29718 tablet_replica.cc:333] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:51.964969 29718 raft_consensus.cc:2243] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.966676  4593 raft_consensus.cc:2749] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.969504 29718 raft_consensus.cc:2272] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.967711 30847 leader_election.cc:304] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:51.976784  4593 raft_consensus.cc:2749] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:51.978577 30847 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:51.987010  4593 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:51.991937 30847 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:51.993242 29718 tablet_replica.cc:333] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:51.997793 29718 raft_consensus.cc:2243] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:52.009996 30847 raft_consensus.cc:2686] T db4763729fc346458245f7d6bca89a8c P 95b998a6735f4180986a8b8f7d84b8fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:52.011207 30847 leader_election.cc:304] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:52.014317  4593 raft_consensus.cc:2749] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:52.012214 29718 raft_consensus.cc:2272] T 7c9efafd3545426e86d2b3a0961f36cd P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.018595 29718 tablet_replica.cc:333] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.021800 29718 raft_consensus.cc:2243] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.019232 30847 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:52.022558 30847 raft_consensus.cc:2686] T 7959c8f3c783472ab0e42eac55ff018a P 95b998a6735f4180986a8b8f7d84b8fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:52.023488 30847 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:52.027896 30847 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:52.028458  4593 raft_consensus.cc:2706] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:16:52.031147 29718 raft_consensus.cc:2272] T c01eed2523a3452fbe85af4db99a20bf P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.033974  4593 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:52.038601 30847 leader_election.cc:304] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:52.039431 30847 raft_consensus.cc:2686] T bced1836a1cd4749bcd4db4d53decc9a P 95b998a6735f4180986a8b8f7d84b8fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:52.041438 30847 leader_election.cc:304] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:52.042315  4593 raft_consensus.cc:2749] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:52.046271 30847 leader_election.cc:304] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:52.048005 30847 leader_election.cc:304] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:52.047317  4593 raft_consensus.cc:2749] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:52.049419  4564 raft_consensus.cc:2749] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:52.050602 30847 leader_election.cc:304] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:52.050909 29718 tablet_replica.cc:333] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.051424  4564 raft_consensus.cc:2749] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:52.051827 30847 leader_election.cc:304] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95b998a6735f4180986a8b8f7d84b8fc; no voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:52.052006 29718 raft_consensus.cc:2243] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.052677  4564 raft_consensus.cc:2749] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:16:52.052846 29718 raft_consensus.cc:2272] T bca3b2e6549e45b7bced35922035bc4e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.056264 29718 tablet_replica.cc:333] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.057511 29718 raft_consensus.cc:2243] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.058822 29718 raft_consensus.cc:2272] T fa9513cbd3af40a4a69f7a596298664c P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.064419 31571 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:52.064955 31571 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:52.065632 29718 tablet_replica.cc:333] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.066243  4548 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:52.066665 29718 raft_consensus.cc:2243] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.078537 29718 raft_consensus.cc:2272] T f167b704a74542d08476d7ce70c368d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.081867 29718 tablet_replica.cc:333] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.089205 29718 raft_consensus.cc:2243] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.090513 29718 raft_consensus.cc:2272] T c9e26088d2e34c8f8fa1005abb24a48e P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.107614 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800388e60 after lost signal to thread 29721
W20260709 13:16:52.108996 30812 debug-util.cc:398] Leaking SignalData structure 0x7b080024c080 after lost signal to thread 30815
W20260709 13:16:52.109687 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800388e40 after lost signal to thread 30907
W20260709 13:16:52.110934 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08001700e0 after lost signal to thread 30982
W20260709 13:16:52.113135 30812 debug-util.cc:398] Leaking SignalData structure 0x7b0800321440 after lost signal to thread 31056
W20260709 13:16:52.115089 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc140 after lost signal to thread 31629
W20260709 13:16:52.115532 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8fe0 after lost signal to thread 3924
W20260709 13:16:52.116714 30812 debug-util.cc:398] Leaking SignalData structure 0x7b08003e81e0 after lost signal to thread 4523
I20260709 13:16:52.120843 29718 tablet_replica.cc:333] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.121872 29718 raft_consensus.cc:2243] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.129165 29718 raft_consensus.cc:2272] T 50513ab15e104c00b0e439d104e5e2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.138522 29718 tablet_replica.cc:333] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.139451 29718 raft_consensus.cc:2243] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.140180 29718 raft_consensus.cc:2272] T ee5193a8eea94bdd87b6db99fc59a40e P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.143211 29718 tablet_replica.cc:333] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.150952 29718 raft_consensus.cc:2243] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.152259 29718 raft_consensus.cc:2272] T 93599b7a5b2c4798aaa9425aa5ecc686 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.155278 29718 tablet_replica.cc:333] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.156226 29718 raft_consensus.cc:2243] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.156792 29718 pending_rounds.cc:70] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Trying to abort 1 pending ops.
I20260709 13:16:52.157084 29718 pending_rounds.cc:77] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305637925129072640 op_type: NO_OP noop_request { }
I20260709 13:16:52.157508 29718 raft_consensus.cc:2889] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:52.157919 29718 raft_consensus.cc:2272] T d95504ff00154bdf99a5de1ad11f4f58 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.160604 29718 tablet_replica.cc:333] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.161504 29718 raft_consensus.cc:2243] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.162149 29718 raft_consensus.cc:2272] T 7378a710ae3644c686285da393d03ae1 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.164907 29718 tablet_replica.cc:333] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.165802 29718 raft_consensus.cc:2243] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.166442 29718 raft_consensus.cc:2272] T 26cbe63a7a21474a881ca2ae72df9719 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.174463 29718 tablet_replica.cc:333] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.175372 29718 raft_consensus.cc:2243] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.176486 29718 raft_consensus.cc:2272] T 0407b8cc64ba44db9159961c6f9cd76b P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.184196 29718 tablet_replica.cc:333] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.185182 29718 raft_consensus.cc:2243] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.197170 29718 raft_consensus.cc:2272] T 03793cde81754b27ba1c03bc763faac4 P 95b998a6735f4180986a8b8f7d84b8fc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.214135 29718 tablet_replica.cc:333] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.215126 29718 raft_consensus.cc:2243] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.215745 29718 raft_consensus.cc:2272] T fdbb6fa9a0f3410e860b9d01eb25293d P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.219663 29718 tablet_replica.cc:333] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.220660 29718 raft_consensus.cc:2243] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.221522 29718 raft_consensus.cc:2272] T 076984be4730440fba459e1d130954f5 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.227609 29718 tablet_replica.cc:333] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.231089 29718 raft_consensus.cc:2243] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.234241 29718 raft_consensus.cc:2272] T 305d528ec3044fc288a8d49789c8d2ab P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.238692 29718 tablet_replica.cc:333] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.239569 29718 raft_consensus.cc:2243] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.240237 29718 raft_consensus.cc:2272] T d72ea41cd9114780855924982fc9b2a8 P 95b998a6735f4180986a8b8f7d84b8fc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.242852 29718 tablet_replica.cc:333] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.243708 29718 raft_consensus.cc:2243] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.244804 29718 raft_consensus.cc:2272] T b1c88e7048de4bf6844c6d2a437a128f P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.253567 29718 tablet_replica.cc:333] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.254494 29718 raft_consensus.cc:2243] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.255919 29718 raft_consensus.cc:2272] T 1293e489425441668ab2722e4649ca3f P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.267917 29718 tablet_replica.cc:333] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.268879 29718 raft_consensus.cc:2243] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.270459 29718 raft_consensus.cc:2272] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.279666 29718 tablet_replica.cc:333] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.280930 29718 raft_consensus.cc:2243] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.283804 29718 raft_consensus.cc:2272] T cb2fb5af0cc748fc9f94576b72a2157d P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.286517 29718 tablet_replica.cc:333] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.293533 29718 raft_consensus.cc:2243] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.294267 29718 raft_consensus.cc:2272] T 3fe26980d1594c1eb11b68b8a2a07295 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.297351 29718 tablet_replica.cc:333] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.308444 29718 raft_consensus.cc:2243] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.309358 29718 raft_consensus.cc:2272] T 7c96de632da240f8a659ee13a19ef435 P 95b998a6735f4180986a8b8f7d84b8fc [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.312533 29718 tablet_replica.cc:333] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.313442 29718 raft_consensus.cc:2243] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.314268 29718 raft_consensus.cc:2272] T 0daef7b4af5348a298c365152f0bea47 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.324721 29718 tablet_replica.cc:333] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.325448 29718 raft_consensus.cc:2243] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.353605 29718 raft_consensus.cc:2272] T 5924d1603d2049ddae792a7d77c50cf2 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.366273 29718 tablet_replica.cc:333] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.376559 29718 raft_consensus.cc:2243] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.380776 29718 raft_consensus.cc:2272] T 2c9907b959044453b57011278bbecdff P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.398252 29718 tablet_replica.cc:333] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.401399 29718 raft_consensus.cc:2243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.402155 29718 raft_consensus.cc:2272] T 6ce19c3ff1834bd091f05b950c3df1e1 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.405660 29718 tablet_replica.cc:333] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.411460 29718 raft_consensus.cc:2243] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.414477 29718 raft_consensus.cc:2272] T 3b00f9d4e8d04efbaf4620845ca672d7 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.432066 29718 tablet_replica.cc:333] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.433043 29718 raft_consensus.cc:2243] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.434352 29718 raft_consensus.cc:2272] T 668bd932e9e04f40b8ccf829b43b99d0 P 95b998a6735f4180986a8b8f7d84b8fc [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.437405 29718 tablet_replica.cc:333] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.438189 29718 raft_consensus.cc:2243] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.439309 29718 raft_consensus.cc:2272] T adb189bd941147e0924cc38c9f01bd11 P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.442037 29718 tablet_replica.cc:333] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.453245 29718 raft_consensus.cc:2243] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.456225 29718 raft_consensus.cc:2272] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.461987  4564 raft_consensus.cc:670] T 72bcdd8ce60141b4a8ae93bf6451b437 P 95b998a6735f4180986a8b8f7d84b8fc: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:16:52.465770 29718 tablet_replica.cc:333] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.471006 29718 raft_consensus.cc:2243] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.471917 29718 raft_consensus.cc:2272] T 92cbaf1d3603474f977498657c46f628 P 95b998a6735f4180986a8b8f7d84b8fc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.475101 29718 tablet_replica.cc:333] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.478143 29718 raft_consensus.cc:2243] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.488665 29718 raft_consensus.cc:2272] T 41ab89a799c64088901472d6633cfb83 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.498462 29718 tablet_replica.cc:333] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.499370 29718 raft_consensus.cc:2243] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.500036 29718 raft_consensus.cc:2272] T b8e3faee40af435fab9e73535ef9df52 P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.502864 29718 tablet_replica.cc:333] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.508386 29718 raft_consensus.cc:2243] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:16:52.509691 29718 raft_consensus.cc:2272] T 6bc558c3b0eb4c249f836374861bb23c P 95b998a6735f4180986a8b8f7d84b8fc [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.520125 29718 tablet_replica.cc:333] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.520936 29718 raft_consensus.cc:2243] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.521723 29718 raft_consensus.cc:2272] T 23d60dde9ca04c6d8ed4b863efa56b5c P 95b998a6735f4180986a8b8f7d84b8fc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.524623 29718 tablet_replica.cc:333] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.525522 29718 raft_consensus.cc:2243] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.526214 29718 raft_consensus.cc:2272] T 0ada02d2b3964383bd24a8a7b03c7ceb P 95b998a6735f4180986a8b8f7d84b8fc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:52.548278 29718 tablet_replica.cc:333] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc: stopping tablet replica
I20260709 13:16:52.549121 29718 raft_consensus.cc:2243] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:52.550197 29718 raft_consensus.cc:2272] T e61719587d824d0680b05c15592027a3 P 95b998a6735f4180986a8b8f7d84b8fc [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:52.763120 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:52.857249  4603 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:52.857875  4603 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:52.860199  4603 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:52.861208 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:52.911743 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:52.913666 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:52.919509 30998 leader_election.cc:336] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:52.920215 30998 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:52.921224  4603 raft_consensus.cc:2749] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:16:52.923645 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 45915us
W20260709 13:16:52.975270 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:52.984714 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.082736 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.122124 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.129416 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.136164 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.147938 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.208472 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 60400.2us
I20260709 13:16:53.254675  4586 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.256397  4586 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.260874 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 59880.3us
I20260709 13:16:53.264322  4586 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.278944  4548 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.280236  4548 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.293097  4603 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.293901  4548 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.294562  4611 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.295104 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.297832 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.300236  4606 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.305905  4606 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.307904  4603 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.318185 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.310026  4606 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.320698 31030 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
I20260709 13:16:53.322937  4603 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.327189  4397 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:53.331792 30998 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.333480  4397 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.337131  4397 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.315729  4611 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.340724 30924 leader_election.cc:336] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.342789  4611 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.344419 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.348246 30924 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.348734  4397 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:16:53.352246 30998 leader_election.cc:336] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.352712  4397 raft_consensus.cc:493] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.353178  4397 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.351233 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
W20260709 13:16:53.352083 31571 leader_election.cc:336] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.355602 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 48086.5us
I20260709 13:16:53.356099 31605 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
W20260709 13:16:53.356760 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 50379.4us
I20260709 13:16:53.362118  4551 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.363070 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.363065  4551 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.366389  4551 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.363488 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.359752  4586 raft_consensus.cc:2749] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:16:53.374506 31571 leader_election.cc:336] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.375276  4603 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:53.375798  4603 raft_consensus.cc:493] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.376224  4603 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.380105  4586 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.373138  4397 raft_consensus.cc:515] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:53.380590 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.381860  4586 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.385356  4586 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:53.381677 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 57187.8us
I20260709 13:16:53.387063 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.388365  4397 leader_election.cc:290] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.389796 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:53.390432 31030 raft_consensus.cc:3060] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.412513  4551 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.413417  4551 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.416486  4548 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.417405  4548 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.418669 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.419564 31570 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:53.420717  4612 raft_consensus.cc:2749] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:16:53.422216 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea166084ed848e08ef7f36b2a4b4e5f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.423046 30955 raft_consensus.cc:2393] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 16: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:53.426483 31030 raft_consensus.cc:2468] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
W20260709 13:16:53.431808 30924 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.434307 30923 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.435534  4606 raft_consensus.cc:2804] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:53.435489 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.436682  4548 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.438798  4551 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:53.443204 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.447695 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.448378 31571 leader_election.cc:336] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.448989 31571 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.453441 30997 leader_election.cc:304] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:53.454365  4611 raft_consensus.cc:2749] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:53.454856 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.430486  4603 raft_consensus.cc:515] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.432677 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.458634 30924 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.459169 30924 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:53.462276 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.463166  4586 raft_consensus.cc:2749] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:16:53.470314 30998 leader_election.cc:336] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.480185 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 55819.7us
I20260709 13:16:53.480301  4606 raft_consensus.cc:697] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:53.485378  4606 consensus_queue.cc:237] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:53.487221 30924 leader_election.cc:336] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.488322 30924 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:53.489112 31570 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:53.490386  4616 raft_consensus.cc:2749] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:53.492425  4611 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.493114  4611 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.495908 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.496582 30955 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:53.497679 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.499483  4611 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:53.500648 30998 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.502607 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50513ab15e104c00b0e439d104e5e2a8" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:53.503240 31603 raft_consensus.cc:3060] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.509380  4611 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.510300  4611 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.513144  4614 raft_consensus.cc:2749] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:53.513266  4611 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:53.514475 30924 leader_election.cc:336] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.515413 31603 raft_consensus.cc:2468] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:53.515498  4617 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.528265  4617 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.520785 30996 leader_election.cc:304] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.531409  4602 raft_consensus.cc:2804] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:53.531718 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.531988  4602 raft_consensus.cc:697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:53.532521  4616 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:53.532939  4616 raft_consensus.cc:493] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.533293  4616 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:53.533147  4602 consensus_queue.cc:237] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.536120 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.536266 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
W20260709 13:16:53.536651 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.536952 30949 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:53.516748  4603 leader_election.cc:290] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.532351 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.537897  4549 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:53.526366 30998 leader_election.cc:336] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.539090  4549 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.544325 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:53.544852  4549 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.545228  4615 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:16:53.546555 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.547297 31598 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 17.
I20260709 13:16:53.548604 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.552032  4549 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:53.552562  4549 raft_consensus.cc:493] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.553280  4549 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:53.546489 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.559755  4617 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:53.565225 30998 leader_election.cc:336] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.568120 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.569461 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:16:53.571607  4603 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:53.572489  4603 raft_consensus.cc:493] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.573235  4603 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.579994  4610 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:53.582167  4616 raft_consensus.cc:515] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.584050  4617 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.584913  4617 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.594249  4614 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.597080  4614 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.599664 30774 catalog_manager.cc:5697] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 16 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.605315  4616 leader_election.cc:290] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.603472  4603 raft_consensus.cc:515] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.608026  4549 raft_consensus.cc:515] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.610535  4549 leader_election.cc:290] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.613286 31603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa9513cbd3af40a4a69f7a596298664c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:53.613921 31603 raft_consensus.cc:3060] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:53.614246  4617 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:53.614904 31571 leader_election.cc:336] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.616164 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.621699  4603 leader_election.cc:290] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.623029  4614 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.623718 31603 raft_consensus.cc:2468] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 18.
I20260709 13:16:53.624112 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.625927 31030 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 15.
W20260709 13:16:53.628084 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 52951.5us
I20260709 13:16:53.629761 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93599b7a5b2c4798aaa9425aa5ecc686" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:53.630368 30949 raft_consensus.cc:3060] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:16:53.630990 30996 leader_election.cc:304] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.631873  4549 raft_consensus.cc:2804] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:53.632477  4549 raft_consensus.cc:697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 18 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:53.633703 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.633950  4606 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.634655  4610 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.635689  4617 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:53.637606  4617 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.638019  4617 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.633615  4549 consensus_queue.cc:237] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.637216  4610 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.637629 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.650831  4548 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.650902  4606 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.651578  4548 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.653319  4606 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.653842  4610 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.654088  4615 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.654753  4615 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.657183  4617 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.658433 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.660174  4615 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.660840  4548 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.647796  4602 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.661580 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.662168 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.664826 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e26088d2e34c8f8fa1005abb24a48e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:53.665391 30924 leader_election.cc:336] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.667196 30949 raft_consensus.cc:2468] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
W20260709 13:16:53.674310 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.675027 30952 raft_consensus.cc:3060] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.670657 31598 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 17.
I20260709 13:16:53.674814 30956 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
W20260709 13:16:53.675683 31571 leader_election.cc:336] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.675930  4602 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.677457 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:53.675119 30924 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.679526 31570 leader_election.cc:304] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.680459  4616 raft_consensus.cc:2804] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:53.680976  4616 raft_consensus.cc:697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:53.681953  4616 consensus_queue.cc:237] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.684783  4615 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:53.684077 30778 catalog_manager.cc:5697] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 16 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.685235  4615 raft_consensus.cc:493] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.688366 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.690245 31030 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 13.
I20260709 13:16:53.691342 30952 raft_consensus.cc:2468] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 16.
I20260709 13:16:53.693199  4614 raft_consensus.cc:2749] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:16:53.693512  4602 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.695067 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.689455  4615 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.696050  4602 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.696782  4602 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.698992  4602 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.701627 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.699713  4602 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.702867  4602 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.703653  4548 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.709751  4548 raft_consensus.cc:493] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.710180  4548 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.710758 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5924d1603d2049ddae792a7d77c50cf2" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:53.711344 31030 raft_consensus.cc:3060] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:53.705822 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:16:53.716387 31598 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:53.717875  4617 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.720723  4615 raft_consensus.cc:515] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.723234  4615 leader_election.cc:290] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.734248  4622 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.727139 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.728665 31030 raft_consensus.cc:2468] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 16.
I20260709 13:16:53.724473 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c88e7048de4bf6844c6d2a437a128f" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
W20260709 13:16:53.735210 30998 leader_election.cc:336] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.737149 30952 raft_consensus.cc:3060] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:16:53.737432 30998 leader_election.cc:336] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.738054 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 72692.7us
I20260709 13:16:53.738300 30923 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.739300  4614 raft_consensus.cc:2804] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:53.739903  4614 raft_consensus.cc:697] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:53.735982  4622 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:53.738240 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.743224  4614 consensus_queue.cc:237] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.746217  4623 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:16:53.746723  4623 raft_consensus.cc:493] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:53.747610 30998 leader_election.cc:336] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.747102  4623 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:53.750349  4602 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.750176 30998 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
W20260709 13:16:53.758936 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.759461 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.754081  4548 raft_consensus.cc:515] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.765430 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305d528ec3044fc288a8d49789c8d2ab" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
W20260709 13:16:53.765831 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 89594.2us
I20260709 13:16:53.766283 31030 raft_consensus.cc:3060] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.767159 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:53.761623 30952 raft_consensus.cc:2468] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:53.762243  4602 raft_consensus.cc:2749] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.768973 31570 leader_election.cc:304] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:53.773896  4615 raft_consensus.cc:2804] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:53.774536  4615 raft_consensus.cc:697] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:53.775645  4615 consensus_queue.cc:237] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.783178 30924 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.782573 30997 leader_election.cc:304] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.780764  4586 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:16:53.784976  4586 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.784574 30924 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc, f535fccbafb14e3f92bd45065da403db
I20260709 13:16:53.779817  4548 leader_election.cc:290] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.786170  4586 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:53.786764  4603 raft_consensus.cc:2804] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:53.787034 31030 raft_consensus.cc:2468] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 14.
I20260709 13:16:53.787317  4603 raft_consensus.cc:697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:53.783942  4606 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.788255 31570 leader_election.cc:304] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.788259  4606 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.788411  4603 consensus_queue.cc:237] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.789109  4548 raft_consensus.cc:2804] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:53.789810  4548 raft_consensus.cc:697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:53.790989  4548 consensus_queue.cc:237] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.792264  4606 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:53.794154 30924 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.794840 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:53.796470 30998 leader_election.cc:336] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.801002  4614 raft_consensus.cc:2749] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.801276 30998 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.804361 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
W20260709 13:16:53.804842 30998 leader_election.cc:336] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.804883 31030 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 13.
W20260709 13:16:53.805847 31571 leader_election.cc:336] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.806921  4549 raft_consensus.cc:2749] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:16:53.808068  4622 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:53.801002  4623 raft_consensus.cc:515] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.813011 29718 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30904)
I20260709 13:16:53.815198  4586 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.815668  4623 leader_election.cc:290] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
I20260709 13:16:53.817574 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "668bd932e9e04f40b8ccf829b43b99d0" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:53.818203 31598 raft_consensus.cc:3060] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:16:53.828370 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.829241  4614 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.829679  4614 raft_consensus.cc:493] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.830060  4614 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.834349 31598 raft_consensus.cc:2468] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 15.
I20260709 13:16:53.833879 30776 catalog_manager.cc:5697] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 16 to 17, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 17 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.835670 30996 leader_election.cc:304] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.836944  4622 raft_consensus.cc:2804] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:16:53.837631  4622 raft_consensus.cc:697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:53.838187 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.838718  4622 consensus_queue.cc:237] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.840014 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:53.843665 30952 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 13.
I20260709 13:16:53.857456 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03793cde81754b27ba1c03bc763faac4" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4"
I20260709 13:16:53.838647  4614 raft_consensus.cc:515] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.859241 30955 raft_consensus.cc:2393] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f535fccbafb14e3f92bd45065da403db in current term 14: Already voted for candidate bda0856a7efd4d0e96615b66bef383c6 in this term.
I20260709 13:16:53.860006  4616 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:53.860837 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.860579  4616 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.858376 31598 raft_consensus.cc:3060] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:16:53.863209  4616 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.864339  4614 leader_election.cc:290] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:53.857792 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 
W20260709 13:16:53.866484 30998 leader_election.cc:336] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.846676  4586 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:16:53.861635 31571 leader_election.cc:336] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.867043 30998 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.868861 31571 leader_election.cc:336] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.870070 31598 raft_consensus.cc:2468] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 18.
I20260709 13:16:53.872108 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0407b8cc64ba44db9159961c6f9cd76b" candidate_uuid: "bda0856a7efd4d0e96615b66bef383c6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:53.872721 31031 raft_consensus.cc:3060] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:53.873450 30924 leader_election.cc:336] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.874959 30924 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.875645 30924 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.875818 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.876412 31030 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:53.877887 30997 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:16:53.879861 30924 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.880003 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 
I20260709 13:16:53.881145  4616 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:16:53.867466  4603 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.883055 30922 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.882232  4616 raft_consensus.cc:493] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.884212  4603 raft_consensus.cc:493] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
W20260709 13:16:53.897101 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.900588  4548 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.901218  4548 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.903501  4548 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:53.904661 30924 leader_election.cc:336] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.912302  4603 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.890638  4586 raft_consensus.cc:2804] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:16:53.913769  4586 raft_consensus.cc:697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 18 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:53.914816  4586 consensus_queue.cc:237] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:16:53.915488 31571 leader_election.cc:336] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.895330  4616 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:53.916312 31571 leader_election.cc:336] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:16:53.915472 30998 leader_election.cc:336] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.918509 31023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db" is_pre_election: true
I20260709 13:16:53.919171 31023 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 9.
I20260709 13:16:53.919536 31032 raft_consensus.cc:1275] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:16:53.917936 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:53.933264 31031 raft_consensus.cc:2468] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda0856a7efd4d0e96615b66bef383c6 in term 14.
I20260709 13:16:53.946516  4616 raft_consensus.cc:515] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:53.948482  4623 raft_consensus.cc:2749] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:53.950323 30923 leader_election.cc:304] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.952801  4617 consensus_queue.cc:1048] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:53.954079 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:53.954226  4617 raft_consensus.cc:2804] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:53.958009  4617 raft_consensus.cc:697] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Becoming Leader. State: Replica: bda0856a7efd4d0e96615b66bef383c6, State: Running, Role: LEADER
I20260709 13:16:53.958995  4617 consensus_queue.cc:237] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:53.960007  4615 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:53.960899  4615 raft_consensus.cc:493] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:53.962627  4615 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:53.971437 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.006264  4616 leader_election.cc:290] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
W20260709 13:16:53.997762 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:54.008628 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb189bd941147e0924cc38c9f01bd11" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:54.009255 31029 raft_consensus.cc:3060] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:16:54.012957 31571 leader_election.cc:336] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:53.983640  4603 raft_consensus.cc:515] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
W20260709 13:16:54.019037 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.020291  4603 leader_election.cc:290] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:54.024986 30998 leader_election.cc:336] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:54.035066 31029 raft_consensus.cc:2468] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 17.
I20260709 13:16:54.031334 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1293e489425441668ab2722e4649ca3f" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:54.036579 30955 raft_consensus.cc:3060] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:54.037786 31598 raft_consensus.cc:1275] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:16:54.039825 31570 leader_election.cc:304] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:54.043695  4603 consensus_queue.cc:1048] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:16:54.053658  4621 raft_consensus.cc:2804] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:16:54.054365  4621 raft_consensus.cc:697] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:54.055357  4621 consensus_queue.cc:237] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:54.068384 30955 raft_consensus.cc:2468] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f535fccbafb14e3f92bd45065da403db in term 14.
I20260709 13:16:54.069830 30997 leader_election.cc:304] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:54.076798  4611 raft_consensus.cc:2804] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:16:54.077541  4611 raft_consensus.cc:697] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Becoming Leader. State: Replica: f535fccbafb14e3f92bd45065da403db, State: Running, Role: LEADER
I20260709 13:16:54.078334 30774 catalog_manager.cc:5697] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 16 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.078809  4611 consensus_queue.cc:237] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:16:54.080255 30774 catalog_manager.cc:5697] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 13 to 14, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 14 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.083802 30776 catalog_manager.cc:5697] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 16 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.089653 30776 catalog_manager.cc:5697] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 17 to 18, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 18 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.095700  4615 raft_consensus.cc:515] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:54.098217  4615 leader_election.cc:290] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:16:54.099315 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bc558c3b0eb4c249f836374861bb23c" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f535fccbafb14e3f92bd45065da403db"
I20260709 13:16:54.100039 31029 raft_consensus.cc:3060] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:54.112470 31571 leader_election.cc:336] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:54.086390 30778 catalog_manager.cc:5697] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 17 to 18, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 18 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.114986 30778 catalog_manager.cc:5697] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 16 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.116936 30778 catalog_manager.cc:5697] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 14 to 15, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 15 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.125880 31029 raft_consensus.cc:2468] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 10.
I20260709 13:16:54.127205 31570 leader_election.cc:304] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc
I20260709 13:16:54.129142  4616 raft_consensus.cc:2804] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.129695  4616 raft_consensus.cc:697] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
I20260709 13:16:54.130574  4616 consensus_queue.cc:237] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:54.154680 30776 catalog_manager.cc:5697] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 reported cstate change: term changed from 13 to 14, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130). New cstate: current_term: 14 leader_uuid: "bda0856a7efd4d0e96615b66bef383c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.195410  4612 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:54.196116  4612 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:54.199512 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6" is_pre_election: true
I20260709 13:16:54.200197 30956 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 15.
I20260709 13:16:54.201396 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
W20260709 13:16:54.203142 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.203467  4615 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:16:54.203951  4615 raft_consensus.cc:493] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 95b998a6735f4180986a8b8f7d84b8fc)
I20260709 13:16:54.204339  4615 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:54.224772 30955 raft_consensus.cc:1275] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:54.235684 30778 catalog_manager.cc:5697] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db reported cstate change: term changed from 13 to 14, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to f535fccbafb14e3f92bd45065da403db (127.29.5.131). New cstate: current_term: 14 leader_uuid: "f535fccbafb14e3f92bd45065da403db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.218726  4612 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:16:54.266232 30955 raft_consensus.cc:1275] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:16:54.274333  4549 consensus_queue.cc:1048] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:54.276371 31029 raft_consensus.cc:1275] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:16:54.281594 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.282328  4643 log.cc:927] Time spent T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:54.269798  4621 consensus_queue.cc:1048] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:16:54.295588  4606 consensus_queue.cc:1048] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:16:54.297261 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.311664 31598 raft_consensus.cc:1275] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:16:54.314947 30952 raft_consensus.cc:1275] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:16:54.325796  4602 consensus_queue.cc:1048] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:16:54.328119  4615 raft_consensus.cc:515] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:54.330324  4615 leader_election.cc:290] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Requested vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:16:54.338515 31571 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:54.375844 30949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f167b704a74542d08476d7ce70c368d0" candidate_uuid: "74f5a5b7556240508983221981af4ab4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bda0856a7efd4d0e96615b66bef383c6"
I20260709 13:16:54.376812 30949 raft_consensus.cc:3060] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:16:54.365062 31603 raft_consensus.cc:1275] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:16:54.379916 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 43724us
W20260709 13:16:54.388521 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.369596 30778 catalog_manager.cc:5697] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 16 to 17, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 17 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.390019 30778 catalog_manager.cc:5697] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 9 to 10, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 10 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:54.394011 31031 raft_consensus.cc:1275] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:54.397891  4615 consensus_queue.cc:1048] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:16:54.398574 30949 raft_consensus.cc:2468] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f5a5b7556240508983221981af4ab4 in term 16.
I20260709 13:16:54.417841  4606 consensus_queue.cc:1048] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:54.420271 31570 leader_election.cc:304] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6; no voters: 
I20260709 13:16:54.423954  4616 raft_consensus.cc:2804] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:16:54.424489  4616 raft_consensus.cc:697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Becoming Leader. State: Replica: 74f5a5b7556240508983221981af4ab4, State: Running, Role: LEADER
W20260709 13:16:54.425380 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.428141 31032 raft_consensus.cc:1275] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:16:54.432897 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.446221 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.452642 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.453991 31571 leader_election.cc:336] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:16:54.468578  4651 consensus_queue.cc:1048] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:16:54.456022  4611 consensus_queue.cc:1048] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:16:54.425431  4616 consensus_queue.cc:237] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:16:54.552570 31029 raft_consensus.cc:1275] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:16:54.588313  4642 consensus_queue.cc:1048] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:16:54.649472 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 192628us
I20260709 13:16:54.652069 30956 raft_consensus.cc:1275] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Refusing update from remote peer f535fccbafb14e3f92bd45065da403db: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:16:54.667560 31032 raft_consensus.cc:1275] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:54.669589  4642 consensus_queue.cc:1048] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:16:54.670183  4620 consensus_queue.cc:1048] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:16:54.683525  4659 log.cc:927] Time spent T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: Append to log took a long time: real 0.072s	user 0.000s	sys 0.007s
I20260709 13:16:54.697484 30776 catalog_manager.cc:5697] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 reported cstate change: term changed from 15 to 16, leader changed from 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129) to 74f5a5b7556240508983221981af4ab4 (127.29.5.132). New cstate: current_term: 16 leader_uuid: "74f5a5b7556240508983221981af4ab4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:54.712132 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.723083 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.728406 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 77597.5us
W20260709 13:16:54.747458 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:54.758280 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.766861 31598 raft_consensus.cc:1275] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Refusing update from remote peer bda0856a7efd4d0e96615b66bef383c6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:16:54.787071  4662 consensus_queue.cc:1048] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:16:54.813663 29718 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30904)
I20260709 13:16:55.001295 30952 raft_consensus.cc:1275] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Refusing update from remote peer 74f5a5b7556240508983221981af4ab4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:16:55.006620  4651 consensus_queue.cc:1048] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:16:55.063639 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:55.386111 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.484838 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.527704 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.600040 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.746174 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.808408 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.814320 29718 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30904)
W20260709 13:16:55.843042 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.885342 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.947204 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.955969 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:55.980454 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.040066 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.095350 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.106124 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.158676 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.185658 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.199654 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.217711 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.338377 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.339082 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.356710 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.379277 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.395540 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.396278 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.485755 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.502159 30998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111) [suppressed 391 similar messages]
W20260709 13:16:56.506875 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.540796 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.560511 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.653059 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.671978 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.744000 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:56.744063 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.782004 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.814975 29718 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30904)
W20260709 13:16:56.849432 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.861517 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.888517 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:56.935213 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.154227 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.226629 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.501552 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.544663 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.659749 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.749079 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.815462 29718 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30904)
W20260709 13:16:57.860257 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:57.971529 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.082000 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.154407 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.159221 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.220937 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.255684 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.347265 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.349551 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.365612 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.367174 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.412298 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.413811 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.477682 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.497068 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.540674 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.567396 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.580771 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.598768 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.619387 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.630278 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.679994 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.734208 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.754925 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:58.816267 29718 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30904)
W20260709 13:16:58.848129 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:58.874823 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 60220.4us
W20260709 13:16:58.941933 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:59.012027 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:59.073563 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:59.149132 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.219168 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:59.221953 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.228705 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.240900 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.246809 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:59.281826 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.318331 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.325943 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:16:59.376281 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.432876 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.554611 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:59.816735 29718 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:00.214913 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.227800 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 81496.4us
W20260709 13:17:00.219101 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.258224 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 74455.7us
W20260709 13:17:00.266058 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.370666 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.505575 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.591823 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.597059 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:17:00.755755 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.874492 29718 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:00.892531 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.900465 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.900883 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.927393 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.928058 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.929296 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.938476 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.948195 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.960500 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.984930 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:00.984921 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.016283 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.043067 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.057137 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.069360 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.142529 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.175024 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.181298 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.206416 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.385354 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.404516 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.407629 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.516851 31571 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111) [suppressed 443 similar messages]
W20260709 13:17:01.611215 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.726239 31053 debug-util.cc:398] Leaking SignalData structure 0x7b0800356d00 after lost signal to thread 29721
W20260709 13:17:01.727608 31053 debug-util.cc:398] Leaking SignalData structure 0x7b08003479a0 after lost signal to thread 30815
W20260709 13:17:01.729082 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080005e3e0 after lost signal to thread 30982
W20260709 13:17:01.730329 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080016b600 after lost signal to thread 31056
W20260709 13:17:01.731619 31053 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae700 after lost signal to thread 31629
W20260709 13:17:01.777125 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.788934 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 117050us
W20260709 13:17:01.799352 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.811017 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.812570 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.811641 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.842008 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.863262 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.863709 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:01.880649 29718 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:01.939862 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:01.956473 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:02.044198 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.045331 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.483474 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.695807 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.704754 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.744499 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.827978 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.844530 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:02.862345 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:02.881147 29718 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:02.889568 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.115700 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.132826 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.157851 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.174124 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.347797 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.383265 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.385782 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.425506 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.428607 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.472383 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.515247 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:17:03.521354 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.543292 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.546139 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.575070 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.613212 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.633031 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.661772 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:03.692245 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.697867 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.700937 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:03.881865 29718 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:03.904160 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.061574 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.073475 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.089113 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.174294 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.217640 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.240473 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.339066 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.360426 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.361001 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.371236 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.393860 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.446552 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.501539 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:04.853716 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:04.882655 29718 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:04.948458 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 56996.7us
W20260709 13:17:05.040208 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.045939 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 128232us
W20260709 13:17:05.056172 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 88420.4us
W20260709 13:17:05.065436 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.090029 30996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 47875.6us
W20260709 13:17:05.116093 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.177866 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.392551 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.475562 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.598330 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.633386 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.649015 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.665819 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.670320 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.694829 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.715975 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.742049 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.766397 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:17:05.858376 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.883786 29718 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:05.953390 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:05.995812 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.051316 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.060791 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.165843 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.172787 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.187623 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.196946 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.244406 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.262924 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.287529 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.323638 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:46199, user_credentials={real_user=slave}} blocked reactor thread for 47440.9us
W20260709 13:17:06.353041 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.387385 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.390111 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.407907 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.419472 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.517318 30924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111) [suppressed 433 similar messages]
W20260709 13:17:06.528659 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.647104 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.712229 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.717245 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:06.791436 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.884346 29718 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:06.909070 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:06.978021 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:07.006238 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.023715 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.044692 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.092921 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:07.160925 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.263496 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.577647 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.717780 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.751488 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.792346 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.804057 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:07.811298 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.884852 29718 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:07.889535 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.955998 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:07.970145 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.016211 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.150390 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:17:08.150616 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.153929 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 44830.9us
W20260709 13:17:08.201532 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.263319 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.321817 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.485175 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.555603 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:08.885386 29718 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:09.094108 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.101918 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.302560 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3be0 after lost signal to thread 29721
W20260709 13:17:09.304318 30979 debug-util.cc:398] Leaking SignalData structure 0x7b080041c8e0 after lost signal to thread 30815
W20260709 13:17:09.305841 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9160 after lost signal to thread 30982
W20260709 13:17:09.314741 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08003e68c0 after lost signal to thread 31056
W20260709 13:17:09.316198 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec160 after lost signal to thread 31629
W20260709 13:17:09.316782 30979 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0600 after lost signal to thread 4717
W20260709 13:17:09.348666 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.362411 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.364841 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.382025 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.382576 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.383111 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.443733 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:09.516417 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.521824 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:09.523862 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.533062 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.538465 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.540665 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.569077 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.670341 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.742372 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:09.886015 29718 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:09.901800 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.956007 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:09.965744 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.079972 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.177769 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.180269 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.301546 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.397264 31053 debug-util.cc:398] Leaking SignalData structure 0x7b0800344740 after lost signal to thread 29721
W20260709 13:17:10.398579 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080018bc40 after lost signal to thread 30815
W20260709 13:17:10.408305 31053 debug-util.cc:398] Leaking SignalData structure 0x7b080022bc40 after lost signal to thread 30982
W20260709 13:17:10.409754 31053 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca040 after lost signal to thread 31056
W20260709 13:17:10.420734 31053 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6f80 after lost signal to thread 31629
W20260709 13:17:10.526144 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.543232 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.579001 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.594239 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.637616 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.658772 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.700629 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.735638 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.757416 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:10.876250 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:10.886518 29718 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:11.054631 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.604332 30924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111) [suppressed 354 similar messages]
W20260709 13:17:11.651729 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47453.6us
W20260709 13:17:11.689246 31570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 72507.1us
W20260709 13:17:11.716470 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.726150 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.733035 30923 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:37487, user_credentials={real_user=slave}} blocked reactor thread for 72186.6us
W20260709 13:17:11.745469 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:17:11.761375 30998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 47229.1us
W20260709 13:17:11.765607 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.770200 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.775636 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.838728 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.887080 29718 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:11.914777 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:11.928480 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.002086 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.008847 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.052824 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.108394 31571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 55632.2us
W20260709 13:17:12.107694 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.168970 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.225289 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 51441.3us
W20260709 13:17:12.236778 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.239260 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.239879 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.247244 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.248051 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.248533 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.252018 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.254864 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.258948 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.259536 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.266193 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.384498 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.432821 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080041b600 after lost signal to thread 29721
W20260709 13:17:12.434242 31626 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca560 after lost signal to thread 30815
W20260709 13:17:12.435981 31626 debug-util.cc:398] Leaking SignalData structure 0x7b0800398060 after lost signal to thread 30982
W20260709 13:17:12.437441 31626 debug-util.cc:398] Leaking SignalData structure 0x7b080035a720 after lost signal to thread 31056
W20260709 13:17:12.439042 31626 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb440 after lost signal to thread 31629
W20260709 13:17:12.452771 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.617463 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.620910 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.661574 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:12.839461 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:12.887804 29718 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:12.919075 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.220482 30924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.129:41351, user_credentials={real_user=slave}} blocked reactor thread for 75087.4us
W20260709 13:17:13.381703 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.430393 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.433502 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.546423 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:42425, user_credentials={real_user=slave}} blocked reactor thread for 76606.2us
W20260709 13:17:13.560783 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.582612 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.768450 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.797639 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.798599 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.822243 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:13.853940 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.864460 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:13.888551 29718 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:13.977882 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.049328 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.137785 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.297223 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.341904 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.346213 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.353015 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.390293 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:17:14.470206 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.547808 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.558841 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.560626 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.614959 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.622159 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.646152 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:14.705474 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.706655 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.712386 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:14.713145 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.718216 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.768836 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.770962 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:14.782029 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.823531 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.837925 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:14.889115 29718 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:14.932898 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:15.093091 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:15.109623 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:15.232458 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:15.242789 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:15.270277 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:15.293249 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:15.299882 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:15.662441 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:15.713302 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:15.812479 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:15.889694 29718 thread.cc:527] Waited for 23000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:16.021620 30924 consensus_peers.cc:597] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.080022 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.200492 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.279855 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.334285 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.360984 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.410144 30924 consensus_peers.cc:597] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.413511 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.448885 30924 consensus_peers.cc:597] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.490589 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.508178 30924 consensus_peers.cc:597] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.557858 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:17:16.591010 30924 consensus_peers.cc:597] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.611604 30924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111) [suppressed 453 similar messages]
W20260709 13:17:16.827064 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.890224 29718 thread.cc:527] Waited for 24000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:16.949663 30924 consensus_peers.cc:597] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.961265 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.963585 30924 consensus_peers.cc:597] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:16.974871 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.110929 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.116007 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.141790 30998 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.148983 30924 consensus_peers.cc:597] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.169692 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.192468 30998 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.203642 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.276831 30998 consensus_peers.cc:597] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.282286 30924 consensus_peers.cc:597] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.280939 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.290865 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.330552 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.352160 30998 consensus_peers.cc:597] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.442278 30924 consensus_peers.cc:597] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.455233 30998 consensus_peers.cc:597] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.466862 30924 consensus_peers.cc:597] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.495463 30998 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.513064 30924 consensus_peers.cc:597] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.602779 30924 consensus_peers.cc:597] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.664435 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:17.778213 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.784403 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:17.890729 29718 thread.cc:527] Waited for 25000ms trying to join with diag-logger (tid 30904)
W20260709 13:17:18.070441 30924 consensus_peers.cc:597] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.113654 30924 consensus_peers.cc:597] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:17:18.276728 31571 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:18.337705 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
W20260709 13:17:18.391268 30998 consensus_peers.cc:597] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:17:18.477044 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
W20260709 13:17:18.503914 30998 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.504505 31571 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.518872 31570 consensus_peers.cc:597] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.537602 31570 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.546994 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:18.548275 29718 tablet_replica.cc:333] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.549309 29718 raft_consensus.cc:2243] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.550248 29718 raft_consensus.cc:2272] T fd69fc9d45f54c7d900248ad54571d11 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.552402 29718 tablet_replica.cc:333] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.552995 29718 raft_consensus.cc:2243] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.555248 29718 raft_consensus.cc:2272] T bd89ff847a344f8a8ef89d9556b85846 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.557758 29718 tablet_replica.cc:333] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.558354 29718 raft_consensus.cc:2243] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.558993 29718 raft_consensus.cc:2272] T bced1836a1cd4749bcd4db4d53decc9a P bda0856a7efd4d0e96615b66bef383c6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.561928 29718 tablet_replica.cc:333] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.562688 29718 raft_consensus.cc:2243] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.563964 29718 raft_consensus.cc:2272] T fea166084ed848e08ef7f36b2a4b4e5f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.565829 29718 tablet_replica.cc:333] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.566452 29718 raft_consensus.cc:2243] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.567289 29718 raft_consensus.cc:2272] T 7959c8f3c783472ab0e42eac55ff018a P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.569337 29718 tablet_replica.cc:333] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.570053 29718 raft_consensus.cc:2243] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.571002 29718 raft_consensus.cc:2272] T db4763729fc346458245f7d6bca89a8c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.573184 29718 tablet_replica.cc:333] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.573995 29718 raft_consensus.cc:2243] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.575044 29718 raft_consensus.cc:2272] T 7c9efafd3545426e86d2b3a0961f36cd P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.577160 29718 tablet_replica.cc:333] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.577706 29718 raft_consensus.cc:2243] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.578467 29718 raft_consensus.cc:2272] T c01eed2523a3452fbe85af4db99a20bf P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.580292 29718 tablet_replica.cc:333] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.581022 29718 raft_consensus.cc:2243] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.581791 29718 raft_consensus.cc:2272] T bca3b2e6549e45b7bced35922035bc4e P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.584247 29718 tablet_replica.cc:333] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.584803 29718 raft_consensus.cc:2243] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.585629 29718 raft_consensus.cc:2272] T ecebd472a2fc4b768869e3daa594c692 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.587502 29718 tablet_replica.cc:333] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.588099 29718 raft_consensus.cc:2243] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.588739 29718 raft_consensus.cc:2272] T c9e26088d2e34c8f8fa1005abb24a48e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.591033 29718 tablet_replica.cc:333] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.591732 29718 raft_consensus.cc:2243] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.592901 29718 raft_consensus.cc:2272] T ee5193a8eea94bdd87b6db99fc59a40e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.593350 31570 consensus_peers.cc:597] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.595407 29718 tablet_replica.cc:333] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.596217 29718 raft_consensus.cc:2243] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.596735 29718 raft_consensus.cc:2272] T 3909ef5ede2e43f1872fec585566b998 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.598956 29718 tablet_replica.cc:333] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.599644 29718 raft_consensus.cc:2243] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.600394 29718 raft_consensus.cc:2272] T f167b704a74542d08476d7ce70c368d0 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.602414 30997 consensus_peers.cc:597] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.602602 29718 tablet_replica.cc:333] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.603266 29718 raft_consensus.cc:2243] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.603986 29718 raft_consensus.cc:2272] T ef66bbb42e064e8da439f811c09eb47c P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.606112 29718 tablet_replica.cc:333] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.606647 29718 raft_consensus.cc:2243] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.607272 29718 raft_consensus.cc:2272] T 93599b7a5b2c4798aaa9425aa5ecc686 P bda0856a7efd4d0e96615b66bef383c6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.609863 29718 tablet_replica.cc:333] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.610450 29718 raft_consensus.cc:2243] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.611315 29718 raft_consensus.cc:2272] T d95504ff00154bdf99a5de1ad11f4f58 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.613148 29718 tablet_replica.cc:333] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.613687 29718 raft_consensus.cc:2243] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.614394 29718 raft_consensus.cc:2272] T 9a98a12e85a64722a1c7f956eb64734e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.616693 29718 tablet_replica.cc:333] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.617479 29718 raft_consensus.cc:2243] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.618809 29718 raft_consensus.cc:2272] T 03793cde81754b27ba1c03bc763faac4 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.621301 29718 tablet_replica.cc:333] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.622030 29718 raft_consensus.cc:2243] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.623306 29718 raft_consensus.cc:2272] T 0407b8cc64ba44db9159961c6f9cd76b P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.624918 30997 consensus_peers.cc:597] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.625950 29718 tablet_replica.cc:333] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.626863 29718 raft_consensus.cc:2243] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:18.627343 31570 consensus_peers.cc:597] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.627615 29718 raft_consensus.cc:2272] T 43a26907cc3847ef873d80998378ce0a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.629786 31570 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.630375 29718 tablet_replica.cc:333] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.631183 29718 raft_consensus.cc:2243] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.631910 29718 raft_consensus.cc:2272] T b1c88e7048de4bf6844c6d2a437a128f P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.633857 29718 tablet_replica.cc:333] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.634402 29718 raft_consensus.cc:2243] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.635305 29718 raft_consensus.cc:2272] T 6167067c2f0e477d90c7f8d4171022d3 P bda0856a7efd4d0e96615b66bef383c6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.637755 29718 tablet_replica.cc:333] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.638290 29718 raft_consensus.cc:2243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.639077 29718 raft_consensus.cc:2272] T 9f5fc12a76fb487399ec1bbd35b7a4ca P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.641649 29718 tablet_replica.cc:333] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.642582 29718 raft_consensus.cc:2243] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.643275 29718 raft_consensus.cc:2272] T 076984be4730440fba459e1d130954f5 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.645725 29718 tablet_replica.cc:333] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.646447 29718 raft_consensus.cc:2243] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:18.646971 31570 consensus_peers.cc:597] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.647128 29718 raft_consensus.cc:2272] T b53c19478dc740149d296778042dd3a8 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.647603 31570 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.649372 29718 tablet_replica.cc:333] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.649961 29718 raft_consensus.cc:2243] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.650409 29718 raft_consensus.cc:2272] T fe74086270b4498abc8ede59e5e23f3a P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.652372 29718 tablet_replica.cc:333] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.652887 29718 raft_consensus.cc:2243] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.653434 29718 raft_consensus.cc:2272] T 3b00f9d4e8d04efbaf4620845ca672d7 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.655663 29718 tablet_replica.cc:333] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.656421 29718 raft_consensus.cc:2243] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.657536 29718 raft_consensus.cc:2272] T d310a2b2db8c4c22a71ff675ed506d7e P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.657866 30997 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:18.659437 29718 tablet_replica.cc:333] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.660128 29718 raft_consensus.cc:2243] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.661032 29718 raft_consensus.cc:2272] T b8e3faee40af435fab9e73535ef9df52 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.663149 29718 tablet_replica.cc:333] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.663659 29718 raft_consensus.cc:2243] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.664273 29718 raft_consensus.cc:2272] T 7c96de632da240f8a659ee13a19ef435 P bda0856a7efd4d0e96615b66bef383c6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.665990 29718 tablet_replica.cc:333] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.666533 29718 raft_consensus.cc:2243] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.667330 29718 raft_consensus.cc:2272] T 6ce19c3ff1834bd091f05b950c3df1e1 P bda0856a7efd4d0e96615b66bef383c6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.669199 29718 tablet_replica.cc:333] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.669709 29718 raft_consensus.cc:2243] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.670532 29718 raft_consensus.cc:2272] T 5924d1603d2049ddae792a7d77c50cf2 P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.672410 29718 tablet_replica.cc:333] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.672910 29718 raft_consensus.cc:2243] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.673806 29718 raft_consensus.cc:2272] T 2c9907b959044453b57011278bbecdff P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.675506 29718 tablet_replica.cc:333] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.676066 29718 raft_consensus.cc:2243] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.676509 29718 raft_consensus.cc:2272] T 9f210916a06449d99b2c71170e4d3d68 P bda0856a7efd4d0e96615b66bef383c6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.678196 29718 tablet_replica.cc:333] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.678722 29718 raft_consensus.cc:2243] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.679575 29718 raft_consensus.cc:2272] T 57205f89b2ab4d2c8a699a5178d20da0 P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.682097 29718 tablet_replica.cc:333] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.682793 29718 raft_consensus.cc:2243] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.683362 29718 raft_consensus.cc:2272] T 23d60dde9ca04c6d8ed4b863efa56b5c P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.685556 29718 tablet_replica.cc:333] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.686076 29718 raft_consensus.cc:2243] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.686496 29718 raft_consensus.cc:2272] T 92cbaf1d3603474f977498657c46f628 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.688370 29718 tablet_replica.cc:333] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.688872 29718 raft_consensus.cc:2243] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.689632 29718 raft_consensus.cc:2272] T 41ab89a799c64088901472d6633cfb83 P bda0856a7efd4d0e96615b66bef383c6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.691298 29718 tablet_replica.cc:333] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.691751 29718 raft_consensus.cc:2243] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.692297 29718 raft_consensus.cc:2272] T a248ff3a5e13493783eef6f7b80fb0ea P bda0856a7efd4d0e96615b66bef383c6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.694005 29718 tablet_replica.cc:333] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.694455 29718 raft_consensus.cc:2243] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.694875 29718 raft_consensus.cc:2272] T 1293e489425441668ab2722e4649ca3f P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.696547 29718 tablet_replica.cc:333] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.697013 29718 raft_consensus.cc:2243] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:18.697954 29718 raft_consensus.cc:2272] T cb2fb5af0cc748fc9f94576b72a2157d P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.699985 29718 tablet_replica.cc:333] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.700449 29718 raft_consensus.cc:2243] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.700979 29718 raft_consensus.cc:2272] T 154fc3698684427dab2fe05492989f2e P bda0856a7efd4d0e96615b66bef383c6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.702687 29718 tablet_replica.cc:333] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6: stopping tablet replica
I20260709 13:17:18.703109 29718 raft_consensus.cc:2243] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.703575 29718 raft_consensus.cc:2272] T 3fe26980d1594c1eb11b68b8a2a07295 P bda0856a7efd4d0e96615b66bef383c6 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:18.726846 30997 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.732728 30997 consensus_peers.cc:597] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.743136 31570 consensus_peers.cc:597] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.745273 31571 consensus_peers.cc:597] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.750061 30997 consensus_peers.cc:597] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.763223 31570 consensus_peers.cc:597] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.777577 31570 consensus_peers.cc:597] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.795173 30997 consensus_peers.cc:597] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.801864 30998 consensus_peers.cc:597] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:18.822139 30997 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.827229 31571 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.847693 30997 consensus_peers.cc:597] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.872658 31570 consensus_peers.cc:597] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.887250 31571 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.890503 30997 consensus_peers.cc:597] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.928854 31570 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:18.961153 31571 consensus_peers.cc:597] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:17:18.986027 30997 consensus_peers.cc:597] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.018880 31570 consensus_peers.cc:597] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.023350 30997 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.040346 30997 consensus_peers.cc:597] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db -> Peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Couldn't send request to peer bda0856a7efd4d0e96615b66bef383c6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.179792 30998 consensus_peers.cc:597] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.423698 30998 consensus_peers.cc:597] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.486059 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
W20260709 13:17:19.523222 30998 consensus_peers.cc:597] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:19.552744 31571 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.564254  4800 raft_consensus.cc:493] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.564970  4800 raft_consensus.cc:515] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:17:19.567651  4800 leader_election.cc:290] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:17:19.572099 30998 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:17:19.572769 30997 leader_election.cc:336] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.573215 30997 leader_election.cc:304] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.574013  4800 raft_consensus.cc:2749] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:19.585450 30998 consensus_peers.cc:597] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.586463 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
W20260709 13:17:19.594223 31570 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.597064 31570 consensus_peers.cc:597] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.625293 31570 consensus_peers.cc:597] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.625982  4796 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.626569  4796 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
W20260709 13:17:19.627185 30998 consensus_peers.cc:597] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.628964  4796 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:17:19.629540 31570 consensus_peers.cc:597] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.630874 31598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6167067c2f0e477d90c7f8d4171022d3" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:17:19.632206  4809 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.632939  4809 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.636147  4809 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), 74f5a5b7556240508983221981af4ab4 (127.29.5.132:42425)
W20260709 13:17:19.639381 30997 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.639820 30997 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.640178 31596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d310a2b2db8c4c22a71ff675ed506d7e" candidate_uuid: "f535fccbafb14e3f92bd45065da403db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74f5a5b7556240508983221981af4ab4" is_pre_election: true
I20260709 13:17:19.640846  4796 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:19.644418 30997 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.645723 30996 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 74f5a5b7556240508983221981af4ab4, bda0856a7efd4d0e96615b66bef383c6
W20260709 13:17:19.646413 30998 consensus_peers.cc:597] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:17:19.646883  4805 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.650308  4801 raft_consensus.cc:493] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.650871  4801 raft_consensus.cc:515] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.653019  4801 leader_election.cc:290] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:17:19.653811 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:17:19.654379 31570 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.655097 29718 tablet_replica.cc:333] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.656275 29718 raft_consensus.cc:2243] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.657256 29718 raft_consensus.cc:2272] T fd69fc9d45f54c7d900248ad54571d11 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:19.658186 31571 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:17:19.659596 29718 tablet_replica.cc:333] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.660235 29718 raft_consensus.cc:2243] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.660784 29718 raft_consensus.cc:2272] T bd89ff847a344f8a8ef89d9556b85846 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:19.661482 31570 leader_election.cc:336] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.661501  4807 raft_consensus.cc:493] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.662124 31570 leader_election.cc:304] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.662324  4807 raft_consensus.cc:515] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.662860  4801 raft_consensus.cc:2749] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:19.663231 29718 tablet_replica.cc:333] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.663945 29718 raft_consensus.cc:2243] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.664462  4807 leader_election.cc:290] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:17:19.665053 29718 raft_consensus.cc:2272] T fa9513cbd3af40a4a69f7a596298664c P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:19.664062 31570 consensus_peers.cc:597] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.668056 29718 tablet_replica.cc:333] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
W20260709 13:17:19.668148 31571 leader_election.cc:336] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:17:19.668987 29718 raft_consensus.cc:2243] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.669529 29718 raft_consensus.cc:2272] T 7c9efafd3545426e86d2b3a0961f36cd P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.671818 29718 tablet_replica.cc:333] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.672426 29718 raft_consensus.cc:2243] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:19.672626 31570 leader_election.cc:336] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.673063 31570 leader_election.cc:304] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.673373 29718 raft_consensus.cc:2272] T ecebd472a2fc4b768869e3daa594c692 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.673694  4801 raft_consensus.cc:2749] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:19.675037 31570 consensus_peers.cc:597] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.675688 29718 tablet_replica.cc:333] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.676357 29718 raft_consensus.cc:2243] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.677242 29718 raft_consensus.cc:2272] T c9e26088d2e34c8f8fa1005abb24a48e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.679103 29718 tablet_replica.cc:333] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.679652 29718 raft_consensus.cc:2243] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.680575 29718 raft_consensus.cc:2272] T 50513ab15e104c00b0e439d104e5e2a8 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.682404 29718 tablet_replica.cc:333] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.682932 29718 raft_consensus.cc:2243] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.683480 29718 raft_consensus.cc:2272] T ee5193a8eea94bdd87b6db99fc59a40e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.685854 29718 tablet_replica.cc:333] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.686483 29718 raft_consensus.cc:2243] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.687216 29718 raft_consensus.cc:2272] T 3909ef5ede2e43f1872fec585566b998 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.689237 29718 tablet_replica.cc:333] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.689769 29718 raft_consensus.cc:2243] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.690673 29718 raft_consensus.cc:2272] T bca3b2e6549e45b7bced35922035bc4e P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.690766  4809 raft_consensus.cc:493] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.691299  4809 raft_consensus.cc:515] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } }
I20260709 13:17:19.692689 29718 tablet_replica.cc:333] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.693127  4809 leader_election.cc:290] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:17:19.693698 29718 raft_consensus.cc:2243] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.694747 29718 raft_consensus.cc:2272] T ef66bbb42e064e8da439f811c09eb47c P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.697304 29718 tablet_replica.cc:333] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
W20260709 13:17:19.697264 30998 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:17:19.698288 29718 raft_consensus.cc:2243] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:19.698863 30997 leader_election.cc:336] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.701100 30997 leader_election.cc:304] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f535fccbafb14e3f92bd45065da403db; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.701838  4809 raft_consensus.cc:2749] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:19.698897 29718 raft_consensus.cc:2272] T 7378a710ae3644c686285da393d03ae1 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.704265 29718 tablet_replica.cc:333] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.704855 29718 raft_consensus.cc:2243] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.705291 29718 raft_consensus.cc:2272] T 26cbe63a7a21474a881ca2ae72df9719 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.707228 29718 tablet_replica.cc:333] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.707939 29718 raft_consensus.cc:2243] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.708597 29718 raft_consensus.cc:2272] T 9a98a12e85a64722a1c7f956eb64734e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.711115 29718 tablet_replica.cc:333] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.711606 29718 raft_consensus.cc:2243] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.712186 29718 raft_consensus.cc:2272] T 0407b8cc64ba44db9159961c6f9cd76b P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.714151 29718 tablet_replica.cc:333] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.714673 29718 raft_consensus.cc:2243] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.715171 29718 raft_consensus.cc:2272] T 43a26907cc3847ef873d80998378ce0a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.717190 29718 tablet_replica.cc:333] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
W20260709 13:17:19.717294 31570 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.717772 29718 raft_consensus.cc:2243] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.718433 29718 raft_consensus.cc:2272] T 305d528ec3044fc288a8d49789c8d2ab P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.721186 29718 tablet_replica.cc:333] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.721979 29718 raft_consensus.cc:2243] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.723644 29718 raft_consensus.cc:2272] T 6167067c2f0e477d90c7f8d4171022d3 P f535fccbafb14e3f92bd45065da403db [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:19.726142 31571 consensus_peers.cc:597] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.727169 29718 tablet_replica.cc:333] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.728073 29718 raft_consensus.cc:2243] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.728585 29718 raft_consensus.cc:2272] T d72ea41cd9114780855924982fc9b2a8 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.730854 29718 tablet_replica.cc:333] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.731637 29718 raft_consensus.cc:2243] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.732522 29718 raft_consensus.cc:2272] T 1293e489425441668ab2722e4649ca3f P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.734690 29718 tablet_replica.cc:333] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.735190 29718 raft_consensus.cc:2243] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.735548 29718 raft_consensus.cc:2272] T 7d317b7eabb7461fb2fd34c7ccc257b2 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.737452 29718 tablet_replica.cc:333] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.737941 29718 raft_consensus.cc:2243] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.738324 29718 raft_consensus.cc:2272] T cb2fb5af0cc748fc9f94576b72a2157d P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.740129 29718 tablet_replica.cc:333] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.740576 29718 raft_consensus.cc:2243] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.741313 29718 raft_consensus.cc:2272] T 9f210916a06449d99b2c71170e4d3d68 P f535fccbafb14e3f92bd45065da403db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.743079 29718 tablet_replica.cc:333] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.743544 29718 raft_consensus.cc:2243] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.744033 29718 raft_consensus.cc:2272] T 5924d1603d2049ddae792a7d77c50cf2 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.745702 29718 tablet_replica.cc:333] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.746145 29718 raft_consensus.cc:2243] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.746486 29718 raft_consensus.cc:2272] T 41ab89a799c64088901472d6633cfb83 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.748122 29718 tablet_replica.cc:333] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.748556 29718 raft_consensus.cc:2243] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.749338 29718 raft_consensus.cc:2272] T 92cbaf1d3603474f977498657c46f628 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.751091 29718 tablet_replica.cc:333] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.751704 29718 raft_consensus.cc:2243] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.752650 29718 raft_consensus.cc:2272] T 7c96de632da240f8a659ee13a19ef435 P f535fccbafb14e3f92bd45065da403db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.754942 29718 tablet_replica.cc:333] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.755455 29718 raft_consensus.cc:2243] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.756398 29718 raft_consensus.cc:2272] T 0daef7b4af5348a298c365152f0bea47 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.758534 29718 tablet_replica.cc:333] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.759177 29718 raft_consensus.cc:2243] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.759075  4801 raft_consensus.cc:493] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.759729  4801 raft_consensus.cc:515] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.760427 29718 raft_consensus.cc:2272] T 3b00f9d4e8d04efbaf4620845ca672d7 P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:19.760525 31571 consensus_peers.cc:597] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.761951  4801 leader_election.cc:290] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
I20260709 13:17:19.763099 29718 tablet_replica.cc:333] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.763906 29718 raft_consensus.cc:2243] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.764758 29718 raft_consensus.cc:2272] T 668bd932e9e04f40b8ccf829b43b99d0 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:19.766853 31570 leader_election.cc:336] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.767342 29718 tablet_replica.cc:333] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
W20260709 13:17:19.767521 31571 leader_election.cc:336] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:17:19.768072 29718 raft_consensus.cc:2243] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.767976 31571 leader_election.cc:304] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.768915 29718 raft_consensus.cc:2272] T adb189bd941147e0924cc38c9f01bd11 P f535fccbafb14e3f92bd45065da403db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.769832  4801 raft_consensus.cc:2749] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:19.770884 31571 consensus_peers.cc:597] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.771471 29718 tablet_replica.cc:333] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.772285 29718 raft_consensus.cc:2243] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.773144 29718 raft_consensus.cc:2272] T 72bcdd8ce60141b4a8ae93bf6451b437 P f535fccbafb14e3f92bd45065da403db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.775678 29718 tablet_replica.cc:333] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.776260 29718 raft_consensus.cc:2243] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.777040 29718 raft_consensus.cc:2272] T b53c19478dc740149d296778042dd3a8 P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.778824 29718 tablet_replica.cc:333] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.779327 29718 raft_consensus.cc:2243] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.779930 29718 raft_consensus.cc:2272] T fe74086270b4498abc8ede59e5e23f3a P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.781643 29718 tablet_replica.cc:333] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.782121 29718 raft_consensus.cc:2243] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.782526 29718 raft_consensus.cc:2272] T e61719587d824d0680b05c15592027a3 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.784647 29718 tablet_replica.cc:333] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.785275 29718 raft_consensus.cc:2243] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.785802 29718 raft_consensus.cc:2272] T a248ff3a5e13493783eef6f7b80fb0ea P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.788002 29718 tablet_replica.cc:333] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.788542 29718 raft_consensus.cc:2243] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.789261 29718 raft_consensus.cc:2272] T 0ada02d2b3964383bd24a8a7b03c7ceb P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.790999 29718 tablet_replica.cc:333] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.791463 29718 raft_consensus.cc:2243] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.792238 29718 raft_consensus.cc:2272] T 57205f89b2ab4d2c8a699a5178d20da0 P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.793902 29718 tablet_replica.cc:333] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.794370 29718 raft_consensus.cc:2243] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.794778 29718 raft_consensus.cc:2272] T d310a2b2db8c4c22a71ff675ed506d7e P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.796597 29718 tablet_replica.cc:333] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.797205 29718 raft_consensus.cc:2243] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.797739 29718 raft_consensus.cc:2272] T 6bc558c3b0eb4c249f836374861bb23c P f535fccbafb14e3f92bd45065da403db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.800279 29718 tablet_replica.cc:333] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.800907 29718 raft_consensus.cc:2243] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.801486 29718 raft_consensus.cc:2272] T fea166084ed848e08ef7f36b2a4b4e5f P f535fccbafb14e3f92bd45065da403db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.803802 29718 tablet_replica.cc:333] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.804378 29718 raft_consensus.cc:2243] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.805335 29718 raft_consensus.cc:2272] T fdbb6fa9a0f3410e860b9d01eb25293d P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.807708 29718 tablet_replica.cc:333] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.808307 29718 raft_consensus.cc:2243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.809355 29718 raft_consensus.cc:2272] T 9f5fc12a76fb487399ec1bbd35b7a4ca P f535fccbafb14e3f92bd45065da403db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.811601 29718 tablet_replica.cc:333] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.812141 29718 raft_consensus.cc:2243] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:19.813151 29718 raft_consensus.cc:2272] T 076984be4730440fba459e1d130954f5 P f535fccbafb14e3f92bd45065da403db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.815158 29718 tablet_replica.cc:333] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db: stopping tablet replica
I20260709 13:17:19.815600 29718 raft_consensus.cc:2243] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:19.816115 29718 raft_consensus.cc:2272] T 154fc3698684427dab2fe05492989f2e P f535fccbafb14e3f92bd45065da403db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:19.828727  4801 raft_consensus.cc:493] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.829371  4801 raft_consensus.cc:515] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.831530  4801 leader_election.cc:290] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:17:19.832463  4801 raft_consensus.cc:493] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.832938  4801 raft_consensus.cc:515] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.835054  4801 leader_election.cc:290] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:17:19.835155 31570 leader_election.cc:336] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:17:19.836751 31570 leader_election.cc:336] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.837129 31570 leader_election.cc:304] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:17:19.837805  4801 raft_consensus.cc:2749] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:19.839634 31570 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
W20260709 13:17:19.840108 31571 leader_election.cc:336] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:17:19.840442 31571 leader_election.cc:304] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.841010  4801 raft_consensus.cc:2749] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:19.859522 31570 consensus_peers.cc:597] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.865496 31570 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:19.893826 31570 consensus_peers.cc:597] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.919044  4801 raft_consensus.cc:493] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.919649  4801 raft_consensus.cc:515] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.920925  4807 raft_consensus.cc:493] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.921491  4807 raft_consensus.cc:515] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.922061  4801 leader_election.cc:290] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:17:19.923570  4807 leader_election.cc:290] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:17:19.929049 31570 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
W20260709 13:17:19.929315 31571 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
I20260709 13:17:19.929633  4801 raft_consensus.cc:493] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
W20260709 13:17:19.929895 31570 leader_election.cc:336] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
W20260709 13:17:19.930027 31571 consensus_peers.cc:597] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:19.930168  4801 raft_consensus.cc:515] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "f535fccbafb14e3f92bd45065da403db" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 37487 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.930532 31570 leader_election.cc:304] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.931306  4807 raft_consensus.cc:2749] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:19.931602 31570 leader_election.cc:336] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111)
I20260709 13:17:19.932070 31570 leader_election.cc:304] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:17:19.932248  4801 leader_election.cc:290] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199), f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487)
I20260709 13:17:19.932747  4807 raft_consensus.cc:2749] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:17:19.936470 31570 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
W20260709 13:17:19.937112 31570 leader_election.cc:336] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111)
I20260709 13:17:19.937469 31570 leader_election.cc:304] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: bda0856a7efd4d0e96615b66bef383c6, f535fccbafb14e3f92bd45065da403db
I20260709 13:17:19.938087  4807 raft_consensus.cc:2749] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:19.971589 31570 consensus_peers.cc:597] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.980764  4807 raft_consensus.cc:493] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:19.981292  4807 raft_consensus.cc:515] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:19.983109  4807 leader_election.cc:290] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:17:19.986485 31571 leader_election.cc:336] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:17:19.987062 31570 leader_election.cc:336] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:19.987416 31570 leader_election.cc:304] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:19.988168  4807 raft_consensus.cc:2749] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:20.037652 31570 consensus_peers.cc:597] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.084362  4807 raft_consensus.cc:493] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:20.085005  4807 raft_consensus.cc:515] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:20.088212  4807 leader_election.cc:290] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:17:20.092355 31571 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:17:20.093971 31570 consensus_peers.cc:597] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:20.094498 31570 leader_election.cc:336] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:20.094808 31570 leader_election.cc:304] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:20.095563  4808 raft_consensus.cc:2749] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:20.132246  4808 raft_consensus.cc:493] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bda0856a7efd4d0e96615b66bef383c6)
I20260709 13:17:20.132735  4808 raft_consensus.cc:515] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "95b998a6735f4180986a8b8f7d84b8fc" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41351 } } peers { permanent_uuid: "bda0856a7efd4d0e96615b66bef383c6" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 46199 } } peers { permanent_uuid: "74f5a5b7556240508983221981af4ab4" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 42425 } attrs { promote: false } }
I20260709 13:17:20.134757  4808 leader_election.cc:290] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351), bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199)
W20260709 13:17:20.138322 31571 leader_election.cc:336] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111)
W20260709 13:17:20.140254 31570 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer f535fccbafb14e3f92bd45065da403db (127.29.5.131:37487): Couldn't send request to peer f535fccbafb14e3f92bd45065da403db. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:37487: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:20.141425 31570 leader_election.cc:336] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bda0856a7efd4d0e96615b66bef383c6 (127.29.5.130:46199): Network error: Client connection negotiation failed: client connection to 127.29.5.130:46199: connect: Connection refused (error 111)
I20260709 13:17:20.141820 31570 leader_election.cc:304] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74f5a5b7556240508983221981af4ab4; no voters: 95b998a6735f4180986a8b8f7d84b8fc, bda0856a7efd4d0e96615b66bef383c6
I20260709 13:17:20.142560  4808 raft_consensus.cc:2749] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:20.231082 31571 consensus_peers.cc:597] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:17:20.241673 31571 consensus_peers.cc:597] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:17:20.300740 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
W20260709 13:17:20.354100 31571 consensus_peers.cc:597] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 -> Peer 95b998a6735f4180986a8b8f7d84b8fc (127.29.5.129:41351): Couldn't send request to peer 95b998a6735f4180986a8b8f7d84b8fc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:41351: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:17:20.402750 29718 tablet_server.cc:179] TabletServer@127.29.5.132:0 shutting down...
I20260709 13:17:20.452630 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:20.453330 29718 tablet_replica.cc:333] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.454128 29718 raft_consensus.cc:2243] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.454646 29718 raft_consensus.cc:2272] T d95504ff00154bdf99a5de1ad11f4f58 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.456872 29718 tablet_replica.cc:333] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.457655 29718 raft_consensus.cc:2243] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.458644 29718 raft_consensus.cc:2272] T adb189bd941147e0924cc38c9f01bd11 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.461063 29718 tablet_replica.cc:333] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.461593 29718 raft_consensus.cc:2243] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.462105 29718 raft_consensus.cc:2272] T 668bd932e9e04f40b8ccf829b43b99d0 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.464152 29718 tablet_replica.cc:333] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.464735 29718 raft_consensus.cc:2243] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.465230 29718 raft_consensus.cc:2272] T 0daef7b4af5348a298c365152f0bea47 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.467142 29718 tablet_replica.cc:333] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.467813 29718 raft_consensus.cc:2243] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.468293 29718 raft_consensus.cc:2272] T 2c9907b959044453b57011278bbecdff P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.470291 29718 tablet_replica.cc:333] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.470844 29718 raft_consensus.cc:2243] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.471354 29718 raft_consensus.cc:2272] T 6ce19c3ff1834bd091f05b950c3df1e1 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.473328 29718 tablet_replica.cc:333] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.473857 29718 raft_consensus.cc:2243] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.474299 29718 raft_consensus.cc:2272] T 72bcdd8ce60141b4a8ae93bf6451b437 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.476276 29718 tablet_replica.cc:333] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.476854 29718 raft_consensus.cc:2243] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.477603 29718 raft_consensus.cc:2272] T 7d317b7eabb7461fb2fd34c7ccc257b2 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.479444 29718 tablet_replica.cc:333] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.479971 29718 raft_consensus.cc:2243] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.480646 29718 raft_consensus.cc:2272] T 3909ef5ede2e43f1872fec585566b998 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.482414 29718 tablet_replica.cc:333] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.482890 29718 raft_consensus.cc:2243] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.483484 29718 raft_consensus.cc:2272] T 50513ab15e104c00b0e439d104e5e2a8 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.485455 29718 tablet_replica.cc:333] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.486013 29718 raft_consensus.cc:2243] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.486488 29718 raft_consensus.cc:2272] T 9f5fc12a76fb487399ec1bbd35b7a4ca P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.488348 29718 tablet_replica.cc:333] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.488881 29718 raft_consensus.cc:2243] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.489338 29718 raft_consensus.cc:2272] T fdbb6fa9a0f3410e860b9d01eb25293d P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.491866 29718 tablet_replica.cc:333] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.492568 29718 raft_consensus.cc:2243] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.493427 29718 raft_consensus.cc:2272] T bced1836a1cd4749bcd4db4d53decc9a P 74f5a5b7556240508983221981af4ab4 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.496065 29718 tablet_replica.cc:333] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.496842 29718 raft_consensus.cc:2243] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.497427 29718 raft_consensus.cc:2272] T 6167067c2f0e477d90c7f8d4171022d3 P 74f5a5b7556240508983221981af4ab4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.499959 29718 tablet_replica.cc:333] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.500618 29718 raft_consensus.cc:2243] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.501575 29718 raft_consensus.cc:2272] T b1c88e7048de4bf6844c6d2a437a128f P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.503286 29718 tablet_replica.cc:333] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.503752 29718 raft_consensus.cc:2243] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.504491 29718 raft_consensus.cc:2272] T a248ff3a5e13493783eef6f7b80fb0ea P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.506203 29718 tablet_replica.cc:333] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.506669 29718 raft_consensus.cc:2243] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.507328 29718 raft_consensus.cc:2272] T e61719587d824d0680b05c15592027a3 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.509138 29718 tablet_replica.cc:333] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.509572 29718 raft_consensus.cc:2243] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.509948 29718 raft_consensus.cc:2272] T 03793cde81754b27ba1c03bc763faac4 P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.511719 29718 tablet_replica.cc:333] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.512254 29718 raft_consensus.cc:2243] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.512766 29718 raft_consensus.cc:2272] T fa9513cbd3af40a4a69f7a596298664c P 74f5a5b7556240508983221981af4ab4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.514539 29718 tablet_replica.cc:333] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.515002 29718 raft_consensus.cc:2243] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.515470 29718 raft_consensus.cc:2272] T b53c19478dc740149d296778042dd3a8 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.517182 29718 tablet_replica.cc:333] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.517650 29718 raft_consensus.cc:2243] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.518402 29718 raft_consensus.cc:2272] T fe74086270b4498abc8ede59e5e23f3a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.520180 29718 tablet_replica.cc:333] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.520637 29718 raft_consensus.cc:2243] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.521292 29718 raft_consensus.cc:2272] T 23d60dde9ca04c6d8ed4b863efa56b5c P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.522945 29718 tablet_replica.cc:333] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.523379 29718 raft_consensus.cc:2243] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.523882 29718 raft_consensus.cc:2272] T d310a2b2db8c4c22a71ff675ed506d7e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.525866 29718 tablet_replica.cc:333] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.526373 29718 raft_consensus.cc:2243] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.527235 29718 raft_consensus.cc:2272] T 305d528ec3044fc288a8d49789c8d2ab P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.529066 29718 tablet_replica.cc:333] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.529578 29718 raft_consensus.cc:2243] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.530344 29718 raft_consensus.cc:2272] T 43a26907cc3847ef873d80998378ce0a P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.532193 29718 tablet_replica.cc:333] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.532719 29718 raft_consensus.cc:2243] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.533618 29718 raft_consensus.cc:2272] T 93599b7a5b2c4798aaa9425aa5ecc686 P 74f5a5b7556240508983221981af4ab4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.535499 29718 tablet_replica.cc:333] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.536212 29718 raft_consensus.cc:2243] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.537017 29718 raft_consensus.cc:2272] T bd89ff847a344f8a8ef89d9556b85846 P 74f5a5b7556240508983221981af4ab4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.539067 29718 tablet_replica.cc:333] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.539532 29718 raft_consensus.cc:2243] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.540323 29718 raft_consensus.cc:2272] T f167b704a74542d08476d7ce70c368d0 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.542073 29718 tablet_replica.cc:333] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.542559 29718 raft_consensus.cc:2243] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.542977 29718 raft_consensus.cc:2272] T ef66bbb42e064e8da439f811c09eb47c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.544775 29718 tablet_replica.cc:333] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.545193 29718 raft_consensus.cc:2243] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.545888 29718 raft_consensus.cc:2272] T 26cbe63a7a21474a881ca2ae72df9719 P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.547551 29718 tablet_replica.cc:333] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.548074 29718 raft_consensus.cc:2243] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.548519 29718 raft_consensus.cc:2272] T b8e3faee40af435fab9e73535ef9df52 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.550153 29718 tablet_replica.cc:333] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.550573 29718 raft_consensus.cc:2243] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.551265 29718 raft_consensus.cc:2272] T 6bc558c3b0eb4c249f836374861bb23c P 74f5a5b7556240508983221981af4ab4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.553103 29718 tablet_replica.cc:333] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.553602 29718 raft_consensus.cc:2243] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.554023 29718 raft_consensus.cc:2272] T 57205f89b2ab4d2c8a699a5178d20da0 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.555941 29718 tablet_replica.cc:333] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.556445 29718 raft_consensus.cc:2243] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.556874 29718 raft_consensus.cc:2272] T ecebd472a2fc4b768869e3daa594c692 P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.558686 29718 tablet_replica.cc:333] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.559226 29718 raft_consensus.cc:2243] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.559721 29718 raft_consensus.cc:2272] T 7959c8f3c783472ab0e42eac55ff018a P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.561630 29718 tablet_replica.cc:333] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.562145 29718 raft_consensus.cc:2243] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.562666 29718 raft_consensus.cc:2272] T c01eed2523a3452fbe85af4db99a20bf P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.564581 29718 tablet_replica.cc:333] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.565100 29718 raft_consensus.cc:2243] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.565891 29718 raft_consensus.cc:2272] T 7378a710ae3644c686285da393d03ae1 P 74f5a5b7556240508983221981af4ab4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.567584 29718 tablet_replica.cc:333] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.568114 29718 raft_consensus.cc:2243] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.568866 29718 raft_consensus.cc:2272] T d72ea41cd9114780855924982fc9b2a8 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.570727 29718 tablet_replica.cc:333] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.571205 29718 raft_consensus.cc:2243] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.572031 29718 raft_consensus.cc:2272] T 9a98a12e85a64722a1c7f956eb64734e P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.573747 29718 tablet_replica.cc:333] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.574229 29718 raft_consensus.cc:2243] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.575029 29718 raft_consensus.cc:2272] T 3fe26980d1594c1eb11b68b8a2a07295 P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.577003 29718 tablet_replica.cc:333] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.577471 29718 raft_consensus.cc:2243] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:17:20.578250 29718 raft_consensus.cc:2272] T 154fc3698684427dab2fe05492989f2e P 74f5a5b7556240508983221981af4ab4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.580117 29718 tablet_replica.cc:333] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.580618 29718 raft_consensus.cc:2243] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.581187 29718 raft_consensus.cc:2272] T 0ada02d2b3964383bd24a8a7b03c7ceb P 74f5a5b7556240508983221981af4ab4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.583022 29718 tablet_replica.cc:333] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.583500 29718 raft_consensus.cc:2243] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.583988 29718 raft_consensus.cc:2272] T 9f210916a06449d99b2c71170e4d3d68 P 74f5a5b7556240508983221981af4ab4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:20.585855 29718 tablet_replica.cc:333] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4: stopping tablet replica
I20260709 13:17:20.586302 29718 raft_consensus.cc:2243] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:20.586740 29718 raft_consensus.cc:2272] T db4763729fc346458245f7d6bca89a8c P 74f5a5b7556240508983221981af4ab4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.086827 29718 tablet_server.cc:196] TabletServer@127.29.5.132:0 shutdown complete.
I20260709 13:17:21.165326 29718 master.cc:562] Master@127.29.5.190:37151 shutting down...
I20260709 13:17:21.212460 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:21.213095 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.213374 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9bcfacd34c704ab69ff2de017b2e1fb5: stopping tablet replica
I20260709 13:17:21.370481 29718 master.cc:584] Master@127.29.5.190:37151 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (212482 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:17:21.467679 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:33299
I20260709 13:17:21.468825 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:21.474838  4811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.475335  4810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.476369  4813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:21.476954 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:21.479591 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:21.479843 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:21.479974 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603041479962 us; error 0 us; skew 500 ppm
I20260709 13:17:21.480419 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:21.482688 29718 webserver.cc:533] Webserver started at http://127.29.5.190:36961/ using document root <none> and password file <none>
I20260709 13:17:21.483140 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:21.483292 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:21.483510 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:21.484704 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "c372735a2d724515b869797b948419e7"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.489327 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:21.492688  4818 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.493418 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:21.493722 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "c372735a2d724515b869797b948419e7"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.494019 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:21.516012 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:21.517297 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:21.556119 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:33299
I20260709 13:17:21.556182  4869 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:33299 every 8 connection(s)
I20260709 13:17:21.560160  4870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:21.571280  4870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7: Bootstrap starting.
I20260709 13:17:21.576334  4870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:21.580579  4870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7: No bootstrap required, opened a new log
I20260709 13:17:21.582669  4870 raft_consensus.cc:359] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c372735a2d724515b869797b948419e7" member_type: VOTER }
I20260709 13:17:21.583036  4870 raft_consensus.cc:385] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:21.583209  4870 raft_consensus.cc:740] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c372735a2d724515b869797b948419e7, State: Initialized, Role: FOLLOWER
I20260709 13:17:21.583701  4870 consensus_queue.cc:260] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c372735a2d724515b869797b948419e7" member_type: VOTER }
I20260709 13:17:21.584111  4870 raft_consensus.cc:399] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:21.584292  4870 raft_consensus.cc:493] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:21.584501  4870 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:21.588776  4870 raft_consensus.cc:515] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c372735a2d724515b869797b948419e7" member_type: VOTER }
I20260709 13:17:21.589236  4870 leader_election.cc:304] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c372735a2d724515b869797b948419e7; no voters: 
I20260709 13:17:21.590283  4870 leader_election.cc:290] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:21.590716  4873 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:21.592154  4873 raft_consensus.cc:697] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 1 LEADER]: Becoming Leader. State: Replica: c372735a2d724515b869797b948419e7, State: Running, Role: LEADER
I20260709 13:17:21.592897  4873 consensus_queue.cc:237] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c372735a2d724515b869797b948419e7" member_type: VOTER }
I20260709 13:17:21.593266  4870 sys_catalog.cc:565] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:21.598395  4875 sys_catalog.cc:455] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c372735a2d724515b869797b948419e7. Latest consensus state: current_term: 1 leader_uuid: "c372735a2d724515b869797b948419e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c372735a2d724515b869797b948419e7" member_type: VOTER } }
I20260709 13:17:21.599134  4875 sys_catalog.cc:458] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:21.599488  4874 sys_catalog.cc:455] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c372735a2d724515b869797b948419e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c372735a2d724515b869797b948419e7" member_type: VOTER } }
I20260709 13:17:21.600077  4874 sys_catalog.cc:458] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:21.601184  4881 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:21.608950  4881 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:21.609949 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:21.617686  4881 catalog_manager.cc:1383] Generated new cluster ID: 470c8d40a3494bcd81cfb2f03f5dc9dd
I20260709 13:17:21.617940  4881 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:21.643358  4881 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:21.644639  4881 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:21.657905  4881 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7: Generated new TSK 0
I20260709 13:17:21.658463  4881 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:21.676884 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:21.682824  4891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.684515  4892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.687350  4894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:21.688663 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:21.690548 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:21.690763 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:21.690943 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603041690905 us; error 0 us; skew 500 ppm
I20260709 13:17:21.691524 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:21.694079 29718 webserver.cc:533] Webserver started at http://127.29.5.129:46233/ using document root <none> and password file <none>
I20260709 13:17:21.694550 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:21.694737 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:21.695021 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:21.696322 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "7e2c2c6ff9224614b4b24e53c472d346"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.700683 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:17:21.704028  4899 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.704763 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:17:21.705085 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "7e2c2c6ff9224614b4b24e53c472d346"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.705358 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:21.720813 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:21.722003 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:21.723528 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:21.725816 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:21.726047 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.726289 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:21.726480 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.766294 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:36057
I20260709 13:17:21.766469  4961 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:36057 every 8 connection(s)
I20260709 13:17:21.771615 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:21.779660  4966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.780893  4967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.784307  4969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:21.784961 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:21.786548  4962 heartbeater.cc:344] Connected to a master server at 127.29.5.190:33299
I20260709 13:17:21.786944  4962 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:21.787598 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:21.787676  4962 heartbeater.cc:507] Master 127.29.5.190:33299 requested a full tablet report, sending...
W20260709 13:17:21.787974 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:21.788266 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603041788248 us; error 0 us; skew 500 ppm
I20260709 13:17:21.788909 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:21.790351  4835 ts_manager.cc:194] Registered new tserver with Master: 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:21.791603 29718 webserver.cc:533] Webserver started at http://127.29.5.130:44919/ using document root <none> and password file <none>
I20260709 13:17:21.792161 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:21.792375 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:21.792670 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:21.792778  4835 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40404
I20260709 13:17:21.794019 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.798588 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:21.801767  4974 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.802642 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:21.802964 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.803241 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:21.815320 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:21.816551 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:21.817934 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:21.820086 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:21.820389 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.820668 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:21.820941 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.860092 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:36371
I20260709 13:17:21.860188  5036 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:36371 every 8 connection(s)
I20260709 13:17:21.865084 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:21.872711  5040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.875244  5041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.880738  5043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:21.880889 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:21.881073  5037 heartbeater.cc:344] Connected to a master server at 127.29.5.190:33299
I20260709 13:17:21.881584  5037 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:21.882303 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:21.882596 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:21.882448  5037 heartbeater.cc:507] Master 127.29.5.190:33299 requested a full tablet report, sending...
I20260709 13:17:21.882927 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603041882908 us; error 0 us; skew 500 ppm
I20260709 13:17:21.883553 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:21.885164  4835 ts_manager.cc:194] Registered new tserver with Master: 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:21.886314 29718 webserver.cc:533] Webserver started at http://127.29.5.131:39357/ using document root <none> and password file <none>
I20260709 13:17:21.886886 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:21.886915  4835 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40412
I20260709 13:17:21.887135 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:21.887528 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:21.888934 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.893329 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:17:21.896970  5048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.897739 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:21.898082 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.898386 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:21.908226 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:21.909386 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:21.910750 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:21.912909 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:21.913123 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.913380 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:21.913547 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.952965 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:45459
I20260709 13:17:21.953073  5110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:45459 every 8 connection(s)
I20260709 13:17:21.957809 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:21.965237  5114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:21.965996  5115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:21.968883 29718 server_base.cc:1061] running on GCE node
W20260709 13:17:21.969530  5117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:21.970247  5111 heartbeater.cc:344] Connected to a master server at 127.29.5.190:33299
I20260709 13:17:21.970580 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:21.970621  5111 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:21.970947 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:21.971159 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603041971141 us; error 0 us; skew 500 ppm
I20260709 13:17:21.971588  5111 heartbeater.cc:507] Master 127.29.5.190:33299 requested a full tablet report, sending...
I20260709 13:17:21.971807 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:21.973805  4835 ts_manager.cc:194] Registered new tserver with Master: c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:21.974545 29718 webserver.cc:533] Webserver started at http://127.29.5.132:33467/ using document root <none> and password file <none>
I20260709 13:17:21.975040 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:21.975248 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:21.975363  4835 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40416
I20260709 13:17:21.975519 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:21.976894 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-3-root/instance:
uuid: "546aee349d8547699b9d86b3640f5aae"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.981251 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:17:21.984329  5122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:21.985095 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:17:21.985471 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-3-root
uuid: "546aee349d8547699b9d86b3640f5aae"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:21.985795 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:22.005007 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:22.006294 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:22.007747 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:22.010082 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:22.010313 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.010567 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:22.010757 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:22.050164 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.132:34111
I20260709 13:17:22.050252  5184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.132:34111 every 8 connection(s)
I20260709 13:17:22.063954  5185 heartbeater.cc:344] Connected to a master server at 127.29.5.190:33299
I20260709 13:17:22.064452  5185 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:22.065344  5185 heartbeater.cc:507] Master 127.29.5.190:33299 requested a full tablet report, sending...
I20260709 13:17:22.067196  4835 ts_manager.cc:194] Registered new tserver with Master: 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:22.067324 29718 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013918954s
I20260709 13:17:22.068655  4835 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40422
I20260709 13:17:22.096344  4835 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40438:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:17:22.349040  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 408af3f61ed34eed834a306bc4e6a465 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:22.350694  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408af3f61ed34eed834a306bc4e6a465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.352864  4922 tablet_service.cc:1511] Processing CreateTablet for tablet 89005842f7624652bbcd94368c089cb3 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:22.355561  4927 tablet_service.cc:1511] Processing CreateTablet for tablet 07ee2e2aa9aa4bba9f078425f142e0fc (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:22.357087  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 896e123c38644e439ea2de7c32690f10 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:22.359052  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 769e6ebd88db4a45830d07ff3d7b6b12 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:22.359091  4926 tablet_service.cc:1511] Processing CreateTablet for tablet 15cb77576c214fada45083baabff5c2d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:22.361433  4921 tablet_service.cc:1511] Processing CreateTablet for tablet f494c1d883684e3285f3d2e4ad7c0c97 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:22.363261  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89005842f7624652bbcd94368c089cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.363624  4920 tablet_service.cc:1511] Processing CreateTablet for tablet eac4779ad927429881b9f59f0f356abb (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:22.364974  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac4779ad927429881b9f59f0f356abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.365641  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896e123c38644e439ea2de7c32690f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.367030  4919 tablet_service.cc:1511] Processing CreateTablet for tablet be904dd9747941818620fdde5b5e8dd8 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:22.368018  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e6ebd88db4a45830d07ff3d7b6b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.369419  4918 tablet_service.cc:1511] Processing CreateTablet for tablet 4d965e514c434894bda41987fdad0b73 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:22.370355  4926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15cb77576c214fada45083baabff5c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.371515  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d965e514c434894bda41987fdad0b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.372519  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f494c1d883684e3285f3d2e4ad7c0c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.377744  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be904dd9747941818620fdde5b5e8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.381155  4927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ee2e2aa9aa4bba9f078425f142e0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.421653  4918 tablet_service.cc:1511] Processing CreateTablet for tablet 418c40cbfa1e482bac10f761a5a39a30 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:22.423048  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418c40cbfa1e482bac10f761a5a39a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.426936  5150 tablet_service.cc:1511] Processing CreateTablet for tablet 07ee2e2aa9aa4bba9f078425f142e0fc (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:22.428340  5150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ee2e2aa9aa4bba9f078425f142e0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.428653  5147 tablet_service.cc:1511] Processing CreateTablet for tablet 408af3f61ed34eed834a306bc4e6a465 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:22.429922  5147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408af3f61ed34eed834a306bc4e6a465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.431711  5146 tablet_service.cc:1511] Processing CreateTablet for tablet 89005842f7624652bbcd94368c089cb3 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:22.433043  5146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89005842f7624652bbcd94368c089cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.432910  5149 tablet_service.cc:1511] Processing CreateTablet for tablet 896e123c38644e439ea2de7c32690f10 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:22.434217  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896e123c38644e439ea2de7c32690f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.434998  5145 tablet_service.cc:1511] Processing CreateTablet for tablet a8d34906755246e3b3f0d4c435283a5a (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:22.436362  5145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d34906755246e3b3f0d4c435283a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.436178  5148 tablet_service.cc:1511] Processing CreateTablet for tablet bc62241274be438184b329dc0635e9d1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:22.437467  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc62241274be438184b329dc0635e9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.438241  5144 tablet_service.cc:1511] Processing CreateTablet for tablet eac4779ad927429881b9f59f0f356abb (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:22.439518  5144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac4779ad927429881b9f59f0f356abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.439406  5075 tablet_service.cc:1511] Processing CreateTablet for tablet 15cb77576c214fada45083baabff5c2d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:22.449397  5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15cb77576c214fada45083baabff5c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.441181  5143 tablet_service.cc:1511] Processing CreateTablet for tablet be904dd9747941818620fdde5b5e8dd8 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:22.443373  5142 tablet_service.cc:1511] Processing CreateTablet for tablet 2357ff63d6a543a8bb0105adfdd10a8e (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:22.445614  5141 tablet_service.cc:1511] Processing CreateTablet for tablet 418c40cbfa1e482bac10f761a5a39a30 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:22.447432  5076 tablet_service.cc:1511] Processing CreateTablet for tablet 07ee2e2aa9aa4bba9f078425f142e0fc (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:17:22.452703  5143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be904dd9747941818620fdde5b5e8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.453356  5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ee2e2aa9aa4bba9f078425f142e0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.456550  5141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418c40cbfa1e482bac10f761a5a39a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.457401  5074 tablet_service.cc:1511] Processing CreateTablet for tablet bc62241274be438184b329dc0635e9d1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:22.458841  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc62241274be438184b329dc0635e9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.459664  5068 tablet_service.cc:1511] Processing CreateTablet for tablet 2357ff63d6a543a8bb0105adfdd10a8e (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:22.461068  5073 tablet_service.cc:1511] Processing CreateTablet for tablet 769e6ebd88db4a45830d07ff3d7b6b12 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:22.462393  5067 tablet_service.cc:1511] Processing CreateTablet for tablet 4d965e514c434894bda41987fdad0b73 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:22.463562  5072 tablet_service.cc:1511] Processing CreateTablet for tablet 89005842f7624652bbcd94368c089cb3 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:17:22.465991  5071 tablet_service.cc:1511] Processing CreateTablet for tablet a8d34906755246e3b3f0d4c435283a5a (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:22.467345  5142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2357ff63d6a543a8bb0105adfdd10a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.461108  5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2357ff63d6a543a8bb0105adfdd10a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.468883  5067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d965e514c434894bda41987fdad0b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.471135  5070 tablet_service.cc:1511] Processing CreateTablet for tablet f494c1d883684e3285f3d2e4ad7c0c97 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:22.469058  5069 tablet_service.cc:1511] Processing CreateTablet for tablet be904dd9747941818620fdde5b5e8dd8 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:17:22.485616  5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d34906755246e3b3f0d4c435283a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.487943  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e6ebd88db4a45830d07ff3d7b6b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.489972  5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89005842f7624652bbcd94368c089cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.492115  5069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be904dd9747941818620fdde5b5e8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.496236  5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f494c1d883684e3285f3d2e4ad7c0c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.521996  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 44b74d3e9edb492b8818ba89bf9d7ff7 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:22.531025  4919 tablet_service.cc:1511] Processing CreateTablet for tablet 3b51f860fd714a01b39a1a9fb6db5974 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:22.523646  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b74d3e9edb492b8818ba89bf9d7ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.543682  5201 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:22.543793  5202 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:22.557511  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 4a71d181490848c0888d12dc4b65cc0d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:22.559481  5150 tablet_service.cc:1511] Processing CreateTablet for tablet 44b74d3e9edb492b8818ba89bf9d7ff7 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:22.576892  5150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b74d3e9edb492b8818ba89bf9d7ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.586126  5076 tablet_service.cc:1511] Processing CreateTablet for tablet 3b51f860fd714a01b39a1a9fb6db5974 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:22.580128  5074 tablet_service.cc:1511] Processing CreateTablet for tablet fd0db5a1497e4b73b5f7090a3e9bbf54 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:22.597246  5202 tablet_bootstrap.cc:654] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.601491  5073 tablet_service.cc:1511] Processing CreateTablet for tablet e735d761e3064ffa967bf9214069af1b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 13:17:22.604892  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:22.614827  5141 tablet_service.cc:1511] Processing CreateTablet for tablet fd0db5a1497e4b73b5f7090a3e9bbf54 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:22.616463  5141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0db5a1497e4b73b5f7090a3e9bbf54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.616235  5142 tablet_service.cc:1511] Processing CreateTablet for tablet e735d761e3064ffa967bf9214069af1b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:22.617930  5142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e735d761e3064ffa967bf9214069af1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.618685  5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b51f860fd714a01b39a1a9fb6db5974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.615329  5148 tablet_service.cc:1511] Processing CreateTablet for tablet 4a71d181490848c0888d12dc4b65cc0d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:22.620752  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a71d181490848c0888d12dc4b65cc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.621814  5071 tablet_service.cc:1511] Processing CreateTablet for tablet f1034335eb97407db28e1bb34a99a838 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:22.623602  5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1034335eb97407db28e1bb34a99a838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.626041  5070 tablet_service.cc:1511] Processing CreateTablet for tablet d49d805bf2f2496ba8e8f3db24871482 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:22.627450  5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49d805bf2f2496ba8e8f3db24871482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.628916  5149 tablet_service.cc:1511] Processing CreateTablet for tablet 20b3651a051845f49844d453fa92f074 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:22.629205  5143 tablet_service.cc:1511] Processing CreateTablet for tablet a60d1eac4c774fa9b9d2d947403a30c2 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:22.629382  5075 tablet_service.cc:1511] Processing CreateTablet for tablet 44b74d3e9edb492b8818ba89bf9d7ff7 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:17:22.632238  5143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60d1eac4c774fa9b9d2d947403a30c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.636471  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b3651a051845f49844d453fa92f074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.639950  4927 tablet_service.cc:1511] Processing CreateTablet for tablet e735d761e3064ffa967bf9214069af1b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:17:22.640158  4926 tablet_service.cc:1511] Processing CreateTablet for tablet d49d805bf2f2496ba8e8f3db24871482 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:22.651212  5002 tablet_service.cc:1511] Processing CreateTablet for tablet 15cb77576c214fada45083baabff5c2d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:17:22.652659  5002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15cb77576c214fada45083baabff5c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.656929  5001 tablet_service.cc:1511] Processing CreateTablet for tablet 896e123c38644e439ea2de7c32690f10 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:17:22.658305  5001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896e123c38644e439ea2de7c32690f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.660984  5000 tablet_service.cc:1511] Processing CreateTablet for tablet bc62241274be438184b329dc0635e9d1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:17:22.662315  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc62241274be438184b329dc0635e9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.664229  4999 tablet_service.cc:1511] Processing CreateTablet for tablet 769e6ebd88db4a45830d07ff3d7b6b12 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:17:22.665557  4999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e6ebd88db4a45830d07ff3d7b6b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.665728  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 20b3651a051845f49844d453fa92f074 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:22.668567  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b51f860fd714a01b39a1a9fb6db5974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.669387  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 408af3f61ed34eed834a306bc4e6a465 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:17:22.669469  5072 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56ea8740b747e0b6ee12d6e2333b6b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:22.670732  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 408af3f61ed34eed834a306bc4e6a465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.673815  4925 tablet_service.cc:1511] Processing CreateTablet for tablet a60d1eac4c774fa9b9d2d947403a30c2 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:22.675658  5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b74d3e9edb492b8818ba89bf9d7ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.676862  4997 tablet_service.cc:1511] Processing CreateTablet for tablet a8d34906755246e3b3f0d4c435283a5a (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:17:22.678236  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d34906755246e3b3f0d4c435283a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.659317  5069 tablet_service.cc:1511] Processing CreateTablet for tablet a60d1eac4c774fa9b9d2d947403a30c2 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:17:22.683462  4996 tablet_service.cc:1511] Processing CreateTablet for tablet f494c1d883684e3285f3d2e4ad7c0c97 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:17:22.684996  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0db5a1497e4b73b5f7090a3e9bbf54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.686117  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 2357ff63d6a543a8bb0105adfdd10a8e (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:17:22.688107  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e735d761e3064ffa967bf9214069af1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.688428  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 4d965e514c434894bda41987fdad0b73 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:17:22.685031  4995 tablet_service.cc:1511] Processing CreateTablet for tablet eac4779ad927429881b9f59f0f356abb (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:17:22.692473  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f494c1d883684e3285f3d2e4ad7c0c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.625360  5144 tablet_service.cc:1511] Processing CreateTablet for tablet f1034335eb97407db28e1bb34a99a838 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:22.693053  5069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60d1eac4c774fa9b9d2d947403a30c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.693349  5145 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56ea8740b747e0b6ee12d6e2333b6b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:22.702572  5201 tablet_bootstrap.cc:654] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.694664  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2357ff63d6a543a8bb0105adfdd10a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.707487  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d965e514c434894bda41987fdad0b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.695755  5144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1034335eb97407db28e1bb34a99a838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.683362  4918 tablet_service.cc:1511] Processing CreateTablet for tablet 53aee4bd1aa94a5f9275d30815804a88 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:22.706564  5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56ea8740b747e0b6ee12d6e2333b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.706655  5203 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:22.746172  5067 tablet_service.cc:1511] Processing CreateTablet for tablet 5844863880a54fe9a4194162d5c8f72c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:22.712611  4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac4779ad927429881b9f59f0f356abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.749111  5145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56ea8740b747e0b6ee12d6e2333b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.748939  4920 tablet_service.cc:1511] Processing CreateTablet for tablet 5844863880a54fe9a4194162d5c8f72c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:22.726627  4922 tablet_service.cc:1511] Processing CreateTablet for tablet 453a7f2f432e4b6d83de031143ba6238 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:22.736716  5068 tablet_service.cc:1511] Processing CreateTablet for tablet 53aee4bd1aa94a5f9275d30815804a88 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:22.747654  5067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844863880a54fe9a4194162d5c8f72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.752169  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b3651a051845f49844d453fa92f074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.754781  5202 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:22.774665  5202 ts_tablet_manager.cc:1403] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.231s	user 0.010s	sys 0.004s
I20260709 13:17:22.777932  5202 raft_consensus.cc:359] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:22.778671  5202 raft_consensus.cc:385] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.778980  5202 raft_consensus.cc:740] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.766549  5203 tablet_bootstrap.cc:654] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.780917  5142 tablet_service.cc:1511] Processing CreateTablet for tablet f7b2ed27eb764c4c8a356d249940b43a (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:22.782395  5142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2ed27eb764c4c8a356d249940b43a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.782634  5202 consensus_queue.cc:260] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:22.769093  5147 tablet_service.cc:1511] Processing CreateTablet for tablet 5844863880a54fe9a4194162d5c8f72c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:17:22.770794  5146 tablet_service.cc:1511] Processing CreateTablet for tablet 453a7f2f432e4b6d83de031143ba6238 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:22.773290  5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53aee4bd1aa94a5f9275d30815804a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.774111  4927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e735d761e3064ffa967bf9214069af1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.800009  4962 heartbeater.cc:499] Master 127.29.5.190:33299 was elected leader, sending a full tablet report...
I20260709 13:17:22.779457  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 418c40cbfa1e482bac10f761a5a39a30 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:17:22.812258  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a71d181490848c0888d12dc4b65cc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.813575  5147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844863880a54fe9a4194162d5c8f72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.824101  5185 heartbeater.cc:499] Master 127.29.5.190:33299 was elected leader, sending a full tablet report...
I20260709 13:17:22.824577  5206 tablet_bootstrap.cc:492] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:22.827060  5074 tablet_service.cc:1511] Processing CreateTablet for tablet f7b2ed27eb764c4c8a356d249940b43a (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:22.828465  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2ed27eb764c4c8a356d249940b43a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.838079  5206 tablet_bootstrap.cc:654] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:22.838863  5150 tablet_service.cc:1511] Processing CreateTablet for tablet 084dd96ef5764ccc9fa9d83933389f62 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:22.856113  4926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49d805bf2f2496ba8e8f3db24871482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.861588  5141 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9410663e6c48bf9ec25dc3b9c57805 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:22.868486  4996 tablet_service.cc:1511] Processing CreateTablet for tablet fd0db5a1497e4b73b5f7090a3e9bbf54 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:17:22.860481  5202 ts_tablet_manager.cc:1434] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.006s
I20260709 13:17:22.876987  5201 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:22.857358  5148 tablet_service.cc:1511] Processing CreateTablet for tablet 184945b6c18c46b4b5a242903e4df7ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:22.877471  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 418c40cbfa1e482bac10f761a5a39a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.874420  5143 tablet_service.cc:1511] Processing CreateTablet for tablet cea73967d5ce4c81b9f43fc970d37f88 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:22.881737  5002 tablet_service.cc:1511] Processing CreateTablet for tablet 3b51f860fd714a01b39a1a9fb6db5974 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:17:22.878254  5075 tablet_service.cc:1511] Processing CreateTablet for tablet b80fa21498e64631ad2657c5021c55e1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:22.888846  5069 tablet_service.cc:1511] Processing CreateTablet for tablet 084dd96ef5764ccc9fa9d83933389f62 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:22.889694  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 184945b6c18c46b4b5a242903e4df7ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:22.890069  5037 heartbeater.cc:499] Master 127.29.5.190:33299 was elected leader, sending a full tablet report...
I20260709 13:17:22.890620  5070 tablet_service.cc:1511] Processing CreateTablet for tablet 21d1ce843f5a4a4d82a4c35768da1639 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:22.950282  5000 tablet_service.cc:1511] Processing CreateTablet for tablet b80fa21498e64631ad2657c5021c55e1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:22.898370  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 4a71d181490848c0888d12dc4b65cc0d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:17:22.901798  5001 tablet_service.cc:1511] Processing CreateTablet for tablet d49d805bf2f2496ba8e8f3db24871482 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:17:22.849611  4919 tablet_service.cc:1511] Processing CreateTablet for tablet b80fa21498e64631ad2657c5021c55e1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:17:22.864661  5150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084dd96ef5764ccc9fa9d83933389f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.951539  5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d1ce843f5a4a4d82a4c35768da1639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.897940  4998 tablet_service.cc:1511] Processing CreateTablet for tablet f1034335eb97407db28e1bb34a99a838 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:17:22.952880  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184945b6c18c46b4b5a242903e4df7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.946396  5201 ts_tablet_manager.cc:1403] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.403s	user 0.019s	sys 0.009s
I20260709 13:17:22.927978  5144 tablet_service.cc:1511] Processing CreateTablet for tablet bb728a4f28ed48c082e7f2d65155bd4c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:22.957860  5201 raft_consensus.cc:359] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:22.958341  5144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb728a4f28ed48c082e7f2d65155bd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.958622  5201 raft_consensus.cc:385] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:22.958958  5201 raft_consensus.cc:740] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:22.932195  5074 tablet_service.cc:1511] Processing CreateTablet for tablet dd62f735924d4523b0a0b4061cb40814 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:22.934582  5068 tablet_service.cc:1511] Processing CreateTablet for tablet 795eacb4ba194dc8a9811b3471aae575 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:22.950730  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453a7f2f432e4b6d83de031143ba6238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.929944  5073 tablet_service.cc:1511] Processing CreateTablet for tablet bb728a4f28ed48c082e7f2d65155bd4c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:22.939574  5071 tablet_service.cc:1511] Processing CreateTablet for tablet ebed353d692f4b5390b659b83f88dc16 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:22.977854  5111 heartbeater.cc:499] Master 127.29.5.190:33299 was elected leader, sending a full tablet report...
I20260709 13:17:22.963546  5076 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9410663e6c48bf9ec25dc3b9c57805 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:22.960530  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd62f735924d4523b0a0b4061cb40814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.988474  5069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084dd96ef5764ccc9fa9d83933389f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.960927  5143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea73967d5ce4c81b9f43fc970d37f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.990944  5141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9410663e6c48bf9ec25dc3b9c57805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.993121  5146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453a7f2f432e4b6d83de031143ba6238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.995024  5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebed353d692f4b5390b659b83f88dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.997231  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5844863880a54fe9a4194162d5c8f72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.997953  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a60d1eac4c774fa9b9d2d947403a30c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.999120  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184945b6c18c46b4b5a242903e4df7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.000138  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80fa21498e64631ad2657c5021c55e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.005894  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53aee4bd1aa94a5f9275d30815804a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.005532  5149 tablet_service.cc:1511] Processing CreateTablet for tablet 969b73f3d2bc408aafcf19ab23755ee5 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:23.006994  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969b73f3d2bc408aafcf19ab23755ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.007453  5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795eacb4ba194dc8a9811b3471aae575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.968470  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80fa21498e64631ad2657c5021c55e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.010713  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a71d181490848c0888d12dc4b65cc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.012053  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1034335eb97407db28e1bb34a99a838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.016072  5001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49d805bf2f2496ba8e8f3db24871482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.017961  5002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b51f860fd714a01b39a1a9fb6db5974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.020063  5075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b80fa21498e64631ad2657c5021c55e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.024088  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb728a4f28ed48c082e7f2d65155bd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:22.959743  5201 consensus_queue.cc:260] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:23.028821  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0db5a1497e4b73b5f7090a3e9bbf54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.032122  5076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9410663e6c48bf9ec25dc3b9c57805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.032207  5202 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:23.036015  4995 tablet_service.cc:1511] Processing CreateTablet for tablet 20b3651a051845f49844d453fa92f074 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:17:23.037441  4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20b3651a051845f49844d453fa92f074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.041232  5203 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:23.041857  5203 ts_tablet_manager.cc:1403] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.336s	user 0.025s	sys 0.031s
W20260709 13:17:23.055467  5186 tablet.cc:2406] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:22.981776  4999 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56ea8740b747e0b6ee12d6e2333b6b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:17:23.057062  4999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56ea8740b747e0b6ee12d6e2333b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.072708  5203 raft_consensus.cc:359] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:23.078900  4920 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9410663e6c48bf9ec25dc3b9c57805 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:17:23.080622  5203 raft_consensus.cc:385] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.107836  5150 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf3fbfd93384fd8ba4351d1330239ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:23.110631  4993 tablet_service.cc:1511] Processing CreateTablet for tablet 53aee4bd1aa94a5f9275d30815804a88 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:17:23.112619  5150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf3fbfd93384fd8ba4351d1330239ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.113396  5071 tablet_service.cc:1511] Processing CreateTablet for tablet 5421978302744408a4763ff08b738c2d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:23.116369  5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5421978302744408a4763ff08b738c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.110280  5141 tablet_service.cc:1511] Processing CreateTablet for tablet dd62f735924d4523b0a0b4061cb40814 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:23.093495  5203 raft_consensus.cc:740] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.121505  5141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd62f735924d4523b0a0b4061cb40814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.121547  5203 consensus_queue.cc:260] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:23.116472  5201 ts_tablet_manager.cc:1434] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.161s	user 0.004s	sys 0.013s
I20260709 13:17:23.139992  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9410663e6c48bf9ec25dc3b9c57805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.140733  5201 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:23.142776  4924 tablet_service.cc:1511] Processing CreateTablet for tablet bb728a4f28ed48c082e7f2d65155bd4c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:17:23.154035  5206 tablet_bootstrap.cc:492] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:23.154700  5206 ts_tablet_manager.cc:1403] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.330s	user 0.017s	sys 0.030s
I20260709 13:17:23.154541  4997 tablet_service.cc:1511] Processing CreateTablet for tablet dd62f735924d4523b0a0b4061cb40814 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:17:23.156317  5207 raft_consensus.cc:493] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.158519  5206 raft_consensus.cc:359] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:23.159379  5206 raft_consensus.cc:385] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.160456  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 795eacb4ba194dc8a9811b3471aae575 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:23.162132  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795eacb4ba194dc8a9811b3471aae575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.176445  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb728a4f28ed48c082e7f2d65155bd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.176905  5002 tablet_service.cc:1511] Processing CreateTablet for tablet 453a7f2f432e4b6d83de031143ba6238 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:17:23.180083  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53aee4bd1aa94a5f9275d30815804a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.180794  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd62f735924d4523b0a0b4061cb40814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.181224  5074 tablet_service.cc:1511] Processing CreateTablet for tablet 36a37190f2bf45f0bdf40239c84eb18c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:23.185817  5002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453a7f2f432e4b6d83de031143ba6238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.133468  4922 tablet_service.cc:1511] Processing CreateTablet for tablet cea73967d5ce4c81b9f43fc970d37f88 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:23.131305  5072 tablet_service.cc:1511] Processing CreateTablet for tablet 969b73f3d2bc408aafcf19ab23755ee5 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:23.225348  4925 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf3fbfd93384fd8ba4351d1330239ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:23.159699  5206 raft_consensus.cc:740] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.113226  4921 tablet_service.cc:1511] Processing CreateTablet for tablet 21d1ce843f5a4a4d82a4c35768da1639 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:23.228755  5206 consensus_queue.cc:260] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:23.198271  5145 tablet_service.cc:1511] Processing CreateTablet for tablet ebed353d692f4b5390b659b83f88dc16 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:23.231566  5145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebed353d692f4b5390b659b83f88dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.232781  5000 tablet_service.cc:1511] Processing CreateTablet for tablet f7b2ed27eb764c4c8a356d249940b43a (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:17:23.234301  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b2ed27eb764c4c8a356d249940b43a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.236097  5144 tablet_service.cc:1511] Processing CreateTablet for tablet 597b56d5b0084f239a472638315fdb19 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:23.237573  5144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597b56d5b0084f239a472638315fdb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.237710  5143 tablet_service.cc:1511] Processing CreateTablet for tablet 780f1c1303f94a6d8b8b407d2392d1e7 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:23.201122  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a37190f2bf45f0bdf40239c84eb18c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:23.201418  4820 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.5.129:36057, user_credentials={real_user=slave}} blocked reactor thread for 82001.1us
I20260709 13:17:23.201880  5147 tablet_service.cc:1511] Processing CreateTablet for tablet 5421978302744408a4763ff08b738c2d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:23.202417  5203 ts_tablet_manager.cc:1434] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.160s	user 0.019s	sys 0.023s
I20260709 13:17:23.203311  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea73967d5ce4c81b9f43fc970d37f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.207875  5149 tablet_service.cc:1511] Processing CreateTablet for tablet 53d5ffde8fa846f7a2031a39ee4129ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:23.210171  4999 tablet_service.cc:1511] Processing CreateTablet for tablet 084dd96ef5764ccc9fa9d83933389f62 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:17:23.210208  5001 tablet_service.cc:1511] Processing CreateTablet for tablet 184945b6c18c46b4b5a242903e4df7ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:17:23.212849  5069 tablet_service.cc:1511] Processing CreateTablet for tablet f4c75efa2c834642afd84dcbcec453b9 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:23.194139  5202 tablet_bootstrap.cc:654] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.156893  5207 raft_consensus.cc:515] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:23.253229  5210 raft_consensus.cc:493] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.263554  4924 tablet_service.cc:1511] Processing CreateTablet for tablet ebed353d692f4b5390b659b83f88dc16 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:17:23.265771  5207 leader_election.cc:290] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:23.283754  5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969b73f3d2bc408aafcf19ab23755ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.287585  5206 ts_tablet_manager.cc:1434] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.132s	user 0.013s	sys 0.021s
I20260709 13:17:23.292158  4925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf3fbfd93384fd8ba4351d1330239ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.293831  5143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780f1c1303f94a6d8b8b407d2392d1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.207890  5067 tablet_service.cc:1511] Processing CreateTablet for tablet 53d5ffde8fa846f7a2031a39ee4129ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:23.287621  5070 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbedf50a3c84aecb67e73854339d8e3 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:23.311941  4999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084dd96ef5764ccc9fa9d83933389f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.275142  5210 raft_consensus.cc:515] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:23.314502  5203 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:23.337128  4923 tablet_service.cc:1511] Processing CreateTablet for tablet 5421978302744408a4763ff08b738c2d (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:17:23.339504  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d5ffde8fa846f7a2031a39ee4129ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.341781  5201 tablet_bootstrap.cc:654] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.342991  5069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c75efa2c834642afd84dcbcec453b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.350194  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebed353d692f4b5390b659b83f88dc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.359711  5001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184945b6c18c46b4b5a242903e4df7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.376044  5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbedf50a3c84aecb67e73854339d8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.383747  4921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d1ce843f5a4a4d82a4c35768da1639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.401046  5073 tablet_service.cc:1511] Processing CreateTablet for tablet 80b16d4ddd0e4ca2bc3cc095874dd0eb (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:23.401298  4919 tablet_service.cc:1511] Processing CreateTablet for tablet 780f1c1303f94a6d8b8b407d2392d1e7 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:23.422505  4926 tablet_service.cc:1511] Processing CreateTablet for tablet 597b56d5b0084f239a472638315fdb19 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:23.401415  5210 leader_election.cc:290] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:23.377656  5146 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbedf50a3c84aecb67e73854339d8e3 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:23.436568  5146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbedf50a3c84aecb67e73854339d8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.376616  4918 tablet_service.cc:1511] Processing CreateTablet for tablet 36a37190f2bf45f0bdf40239c84eb18c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:23.439940  4923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5421978302744408a4763ff08b738c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.442761  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b16d4ddd0e4ca2bc3cc095874dd0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.465170  4927 tablet_service.cc:1511] Processing CreateTablet for tablet f4c75efa2c834642afd84dcbcec453b9 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:23.467623  5148 tablet_service.cc:1511] Processing CreateTablet for tablet e110c0e66ae646dbba07c2ca28fd5631 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:23.468986  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e110c0e66ae646dbba07c2ca28fd5631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.470635  5068 tablet_service.cc:1511] Processing CreateTablet for tablet d65fd895041c443299524ba293a442c5 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:23.477660  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780f1c1303f94a6d8b8b407d2392d1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.479084  4927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c75efa2c834642afd84dcbcec453b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.479193  5206 tablet_bootstrap.cc:492] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:23.484076  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a37190f2bf45f0bdf40239c84eb18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.484547  4996 tablet_service.cc:1511] Processing CreateTablet for tablet 795eacb4ba194dc8a9811b3471aae575 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:17:23.484550  4995 tablet_service.cc:1511] Processing CreateTablet for tablet cea73967d5ce4c81b9f43fc970d37f88 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:17:23.485910  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795eacb4ba194dc8a9811b3471aae575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.486057  5067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d5ffde8fa846f7a2031a39ee4129ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.486495  4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea73967d5ce4c81b9f43fc970d37f88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.488854  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 969b73f3d2bc408aafcf19ab23755ee5 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:17:23.490222  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969b73f3d2bc408aafcf19ab23755ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.492353  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf3fbfd93384fd8ba4351d1330239ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:17:23.492774  5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65fd895041c443299524ba293a442c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.493709  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf3fbfd93384fd8ba4351d1330239ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.496089  5147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5421978302744408a4763ff08b738c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.501084  5202 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:23.501659  5202 ts_tablet_manager.cc:1403] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.470s	user 0.015s	sys 0.011s
I20260709 13:17:23.365100  5211 raft_consensus.cc:493] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.505479  5211 raft_consensus.cc:515] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:23.476683  5212 raft_consensus.cc:493] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.509156  5212 raft_consensus.cc:515] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:23.511584  5212 leader_election.cc:290] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:23.532516  4926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597b56d5b0084f239a472638315fdb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.452620  4994 tablet_service.cc:1511] Processing CreateTablet for tablet 21d1ce843f5a4a4d82a4c35768da1639 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:17:23.574617  5202 raft_consensus.cc:359] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:23.575438  5202 raft_consensus.cc:385] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.575747  5202 raft_consensus.cc:740] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.578346  5202 consensus_queue.cc:260] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:23.576668  5206 tablet_bootstrap.cc:654] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.561519  5211 leader_election.cc:290] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:23.587118  5202 ts_tablet_manager.cc:1434] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.004s
I20260709 13:17:23.598270  4996 tablet_service.cc:1511] Processing CreateTablet for tablet 36a37190f2bf45f0bdf40239c84eb18c (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:17:23.588380  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d1ce843f5a4a4d82a4c35768da1639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.604408  4996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36a37190f2bf45f0bdf40239c84eb18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.607887  5142 tablet_service.cc:1511] Processing CreateTablet for tablet 80b16d4ddd0e4ca2bc3cc095874dd0eb (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:23.618780  5002 tablet_service.cc:1511] Processing CreateTablet for tablet 597b56d5b0084f239a472638315fdb19 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:17:23.629366  5002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597b56d5b0084f239a472638315fdb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.622413  5202 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:23.652715  5142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b16d4ddd0e4ca2bc3cc095874dd0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.661890  5201 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:23.662117  5203 tablet_bootstrap.cc:654] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.662532  5201 ts_tablet_manager.cc:1403] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.522s	user 0.042s	sys 0.059s
I20260709 13:17:23.666952  5201 raft_consensus.cc:359] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:23.667752  5201 raft_consensus.cc:385] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.668121  5201 raft_consensus.cc:740] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.668969  5201 consensus_queue.cc:260] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:23.671104  5201 ts_tablet_manager.cc:1434] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:17:23.672068  5201 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:23.678783  5201 tablet_bootstrap.cc:654] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.679097  5206 tablet_bootstrap.cc:492] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:23.679651  5206 ts_tablet_manager.cc:1403] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.201s	user 0.016s	sys 0.005s
I20260709 13:17:23.681735  5202 tablet_bootstrap.cc:654] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:23.682832  5206 raft_consensus.cc:359] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:23.683701  5206 raft_consensus.cc:385] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.684026  5206 raft_consensus.cc:740] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.684774  5206 consensus_queue.cc:260] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
W20260709 13:17:23.717280  4819 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 203838us
I20260709 13:17:23.880852  4998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 29) took 1107 ms. Trace:
I20260709 13:17:23.778169  5203 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
W20260709 13:17:23.542200  4820 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.29.5.129:36057, user_credentials={real_user=slave}} blocked reactor thread for 205689us
I20260709 13:17:23.802085  5207 raft_consensus.cc:493] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.888883  5207 raft_consensus.cc:515] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:23.887756  4998 rpcz_store.cc:276] 0709 13:17:22.773758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.487925 (+714167us) service_pool.cc:224] Handling call
0709 13:17:23.489768 (+  1843us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.489863 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.806567 (+316704us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.867521 (+ 60954us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.880649 (+ 13128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.805409  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ee2e2aa9aa4bba9f078425f142e0fc" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:23.812803  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:23.818727  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:23.893203  4993 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 18) took 1172 ms. Trace:
I20260709 13:17:23.823832  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ee2e2aa9aa4bba9f078425f142e0fc" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:23.893662  4993 rpcz_store.cc:276] 0709 13:17:22.720391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.109663 (+389272us) service_pool.cc:224] Handling call
0709 13:17:23.111660 (+  1997us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.144198 (+ 32538us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.471473 (+327275us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.892493 (+421020us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.893026 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.828570  5201 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:23.895277  5201 ts_tablet_manager.cc:1403] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.223s	user 0.006s	sys 0.012s
I20260709 13:17:23.839169  5202 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:23.851711  5000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 20) took 1130 ms. Trace:
I20260709 13:17:23.896744  5000 rpcz_store.cc:276] 0709 13:17:22.720925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.190906 (+469981us) service_pool.cc:224] Handling call
0709 13:17:23.233771 (+ 42865us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.233883 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.599591 (+365708us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.830874 (+231283us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.851414 (+ 20540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.897472  5202 ts_tablet_manager.cc:1403] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.306s	user 0.017s	sys 0.001s
I20260709 13:17:23.860080  4997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 28) took 1086 ms. Trace:
I20260709 13:17:23.899927  4997 rpcz_store.cc:276] 0709 13:17:22.773321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.487327 (+714006us) service_pool.cc:224] Handling call
0709 13:17:23.493246 (+  5919us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.493355 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.594762 (+101407us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.846952 (+252190us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.850252 (+  3300us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:23.900619  5049 leader_election.cc:343] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.862933  4999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 23) took 1141 ms. Trace:
I20260709 13:17:23.869225  5072 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55958 (request call id 29) took 1144 ms. Trace:
I20260709 13:17:23.874459  4927 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbedf50a3c84aecb67e73854339d8e3 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:17:23.883360  5001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 22) took 1161 ms. Trace:
I20260709 13:17:23.563972  4920 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 23) took 1108 ms. Trace:
I20260709 13:17:23.899295  5000 tablet_service.cc:1511] Processing CreateTablet for tablet 780f1c1303f94a6d8b8b407d2392d1e7 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:17:23.886783  4922 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 25) took 1418 ms. Trace:
I20260709 13:17:23.887176  4926 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 31) took 1020 ms. Trace:
I20260709 13:17:23.902449  5203 ts_tablet_manager.cc:1403] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.614s	user 0.015s	sys 0.011s
I20260709 13:17:23.918494  5206 ts_tablet_manager.cc:1434] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.238s	user 0.007s	sys 0.001s
I20260709 13:17:23.939847  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780f1c1303f94a6d8b8b407d2392d1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.901775  5202 raft_consensus.cc:359] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:23.941727  5202 raft_consensus.cc:385] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.942065  5202 raft_consensus.cc:740] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.905262  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc62241274be438184b329dc0635e9d1" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:23.942865  4920 rpcz_store.cc:276] 0709 13:17:22.455988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.077951 (+621963us) service_pool.cc:224] Handling call
0709 13:17:23.091061 (+ 13110us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.098212 (+  7151us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.339510 (+241298us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.522790 (+183280us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.561158 (+ 38368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.942862  5202 consensus_queue.cc:260] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:23.907527  5201 raft_consensus.cc:359] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:23.924458  5001 rpcz_store.cc:276] 0709 13:17:22.721504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.209242 (+487738us) service_pool.cc:224] Handling call
0709 13:17:23.325299 (+116057us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b58008f7c98. stack: 00007f2737b3b343 00007f2737b3b240 00007f27374ca1d4 00007f2741208304 00007f2741208299 00007f27379f5db1 00007f2737b35b71 00007f2737b35a22 00007f2740a4ec09 00007f273fba8ee0 00007f273fc8e831 00007f273fc6bac3 00007f273fc1a400 00007f273909faf4 00007f273909fa82 00007f273909f9b1
0709 13:17:23.348639 (+ 23340us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.354046 (+  5407us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.513431 (+159385us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.882502 (+369071us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.883142 (+   640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12070656}
I20260709 13:17:23.903120  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc62241274be438184b329dc0635e9d1" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:23.902418  5124 leader_election.cc:343] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:23.950084  5124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:36057, user_credentials={real_user=slave}} blocked reactor thread for 47916.3us
W20260709 13:17:23.950510  5123 leader_election.cc:343] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.951746  4919 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 34) took 1039 ms. Trace:
I20260709 13:17:23.951882  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:23.952304  4919 rpcz_store.cc:276] 0709 13:17:22.912508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.365476 (+452968us) service_pool.cc:224] Handling call
0709 13:17:23.402616 (+ 37140us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.402742 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.888544 (+485802us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.951013 (+ 62469us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.951575 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:23.953958  5124 leader_election.cc:343] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.954633  5123 leader_election.cc:304] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:23.954783  4998 tablet_service.cc:1511] Processing CreateTablet for tablet 53d5ffde8fa846f7a2031a39ee4129ad (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:17:23.910686  5207 leader_election.cc:290] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:23.948632  4920 tablet_service.cc:1511] Processing CreateTablet for tablet d65fd895041c443299524ba293a442c5 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:23.949105  4927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbedf50a3c84aecb67e73854339d8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.962894  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d5ffde8fa846f7a2031a39ee4129ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.924243  5072 rpcz_store.cc:276] 0709 13:17:22.725110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.089610 (+364500us) service_pool.cc:224] Handling call
0709 13:17:23.216126 (+126516us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.216233 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.463143 (+246910us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.868466 (+405323us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.869056 (+   590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.968276  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65fd895041c443299524ba293a442c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.970067  4918 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 30) took 1224 ms. Trace:
I20260709 13:17:23.925572  4922 rpcz_store.cc:276] 0709 13:17:22.467870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.131676 (+663806us) service_pool.cc:224] Handling call
0709 13:17:23.202646 (+ 70970us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.202764 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.835425 (+632661us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.886079 (+ 50654us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.886581 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.975977  5002 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 31) took 1084 ms. Trace:
I20260709 13:17:23.976728  4922 tablet_service.cc:1511] Processing CreateTablet for tablet ba09625c6e454229af67996d21b2d4dc (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:23.978353  4922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba09625c6e454229af67996d21b2d4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.926966  4993 tablet_service.cc:1511] Processing CreateTablet for tablet f4c75efa2c834642afd84dcbcec453b9 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:17:23.980659  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4c75efa2c834642afd84dcbcec453b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.982995  4994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 24) took 1260 ms. Trace:
W20260709 13:17:23.957542  4975 leader_election.cc:343] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.926110  4926 rpcz_store.cc:276] 0709 13:17:22.866621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.324322 (+457701us) service_pool.cc:224] Handling call
0709 13:17:23.428051 (+103729us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.428151 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.856892 (+428741us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.886507 (+ 29615us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.887017 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:23.984556  4975 leader_election.cc:343] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.984988  4975 leader_election.cc:304] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:23.986123  5212 raft_consensus.cc:2749] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:23.986198  4926 tablet_service.cc:1511] Processing CreateTablet for tablet ac3f70c10d7c4ab0aac5333f93491029 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:23.988231  5203 raft_consensus.cc:359] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:23.989044  5203 raft_consensus.cc:385] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.989357  5203 raft_consensus.cc:740] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.902343  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 80b16d4ddd0e4ca2bc3cc095874dd0eb (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:17:23.997380  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80b16d4ddd0e4ca2bc3cc095874dd0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:23.902943  4925 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 28) took 1259 ms. Trace:
I20260709 13:17:23.954766  4919 tablet_service.cc:1511] Processing CreateTablet for tablet e110c0e66ae646dbba07c2ca28fd5631 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:23.974022  4924 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 29) took 1277 ms. Trace:
I20260709 13:17:23.945739  5201 raft_consensus.cc:385] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:23.974565  4921 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 24) took 1512 ms. Trace:
I20260709 13:17:23.972791  4995 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 25) took 1250 ms. Trace:
I20260709 13:17:23.924584  4999 rpcz_store.cc:276] 0709 13:17:22.721831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.209254 (+487423us) service_pool.cc:224] Handling call
0709 13:17:23.266816 (+ 57562us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.278220 (+ 11404us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.449938 (+171718us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.861937 (+411999us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.862693 (+   756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.010910  5203 consensus_queue.cc:260] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.001813  4924 rpcz_store.cc:276] 0709 13:17:22.696090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.239137 (+543047us) service_pool.cc:224] Handling call
0709 13:17:23.294962 (+ 55825us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.305873 (+ 10911us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.873303 (+567430us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.960570 (+ 87267us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.973857 (+ 13287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.009644  4995 rpcz_store.cc:276] 0709 13:17:22.722379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.483620 (+761241us) service_pool.cc:224] Handling call
0709 13:17:23.485900 (+  2280us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.485988 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.806951 (+320963us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.972112 (+165161us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.972630 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.019104  4926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3f70c10d7c4ab0aac5333f93491029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.036269  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 281e91779b14462aa4fb6af62998cd20 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:24.037438  4919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e110c0e66ae646dbba07c2ca28fd5631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.002584  5201 raft_consensus.cc:740] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:23.983441  4994 rpcz_store.cc:276] 0709 13:17:22.722099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.354726 (+632627us) service_pool.cc:224] Handling call
0709 13:17:23.587847 (+233121us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.587974 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.858338 (+270364us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.982296 (+123958us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.982801 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.006054  4921 rpcz_store.cc:276] 0709 13:17:22.462412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.111024 (+648612us) service_pool.cc:224] Handling call
0709 13:17:23.228346 (+117322us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.228462 (+   116us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.886594 (+658132us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.961484 (+ 74890us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.974369 (+ 12885us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.024384  5001 tablet_service.cc:1511] Processing CreateTablet for tablet d65fd895041c443299524ba293a442c5 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:17:24.025743  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.029968  4998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 32) took 1121 ms. Trace:
I20260709 13:17:24.040913  5201 consensus_queue.cc:260] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.041133  4998 rpcz_store.cc:276] 0709 13:17:22.908297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.891118 (+982821us) service_pool.cc:224] Handling call
0709 13:17:23.962331 (+ 71213us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.962444 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:24.014680 (+ 52236us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.028322 (+ 13642us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.028852 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.042171  5206 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:23.976370  5002 rpcz_store.cc:276] 0709 13:17:22.891706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.614910 (+723204us) service_pool.cc:224] Handling call
0709 13:17:23.628878 (+ 13968us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.628974 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.644268 (+ 15294us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.975158 (+330890us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.975813 (+   655us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:24.042429  5050 leader_election.cc:343] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.040427  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281e91779b14462aa4fb6af62998cd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.043009  5050 leader_election.cc:304] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:24.040961  5074 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55958 (request call id 30) took 1143 ms. Trace:
I20260709 13:17:24.044037  5201 ts_tablet_manager.cc:1434] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.148s	user 0.010s	sys 0.002s
I20260709 13:17:24.044440  5001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65fd895041c443299524ba293a442c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.044298  5074 rpcz_store.cc:276] 0709 13:17:22.889706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.180233 (+290527us) service_pool.cc:224] Handling call
0709 13:17:23.199038 (+ 18805us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.200709 (+  1671us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.664745 (+464036us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.959744 (+294999us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.033442 (+ 73698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.045360  5201 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:24.046113  5207 raft_consensus.cc:2749] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.000648  4925 rpcz_store.cc:276] 0709 13:17:22.643709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.224319 (+580610us) service_pool.cc:224] Handling call
0709 13:17:23.226385 (+  2066us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.226493 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.869954 (+643461us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.902142 (+ 32188us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.902764 (+   622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.049852  5211 raft_consensus.cc:2749] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.050472  5203 ts_tablet_manager.cc:1434] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.002s
I20260709 13:17:24.053171  5002 tablet_service.cc:1511] Processing CreateTablet for tablet e110c0e66ae646dbba07c2ca28fd5631 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:17:24.054831  5142 tablet_service.cc:1511] Processing CreateTablet for tablet ac3f70c10d7c4ab0aac5333f93491029 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:24.055517  4998 tablet_service.cc:1511] Processing CreateTablet for tablet e840ef3c7b6a42b2a98b08ea3eb6b0db (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:24.056317  5072 tablet_service.cc:1511] Processing CreateTablet for tablet e840ef3c7b6a42b2a98b08ea3eb6b0db (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:24.057206  5002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e110c0e66ae646dbba07c2ca28fd5631. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.057790  5072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e840ef3c7b6a42b2a98b08ea3eb6b0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.058599  4998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e840ef3c7b6a42b2a98b08ea3eb6b0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.056348  5142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3f70c10d7c4ab0aac5333f93491029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.065239  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:24.067286  4900 leader_election.cc:343] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:23.998596  4918 rpcz_store.cc:276] 0709 13:17:22.745896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.273115 (+527219us) service_pool.cc:224] Handling call
0709 13:17:23.451257 (+178142us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.458442 (+  7185us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.888926 (+430484us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:23.969276 (+ 80350us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:23.969854 (+   578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.077327  5202 ts_tablet_manager.cc:1434] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.179s	user 0.024s	sys 0.059s
I20260709 13:17:24.077870  5148 tablet_service.cc:1511] Processing CreateTablet for tablet e840ef3c7b6a42b2a98b08ea3eb6b0db (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:17:24.080857  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e840ef3c7b6a42b2a98b08ea3eb6b0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.081666  5068 tablet_service.cc:1511] Processing CreateTablet for tablet ba09625c6e454229af67996d21b2d4dc (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:24.082182  5074 tablet_service.cc:1511] Processing CreateTablet for tablet ac3f70c10d7c4ab0aac5333f93491029 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:17:24.083060  5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba09625c6e454229af67996d21b2d4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.078512  5203 tablet_bootstrap.cc:492] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.077934  4994 tablet_service.cc:1511] Processing CreateTablet for tablet ba09625c6e454229af67996d21b2d4dc (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:17:24.095846  4994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba09625c6e454229af67996d21b2d4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.096982  5202 tablet_bootstrap.cc:492] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:24.086705  5070 tablet_service.cc:1511] Processing CreateTablet for tablet 615c5414ab724457a1049455f559bab4 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:24.088304  5147 tablet_service.cc:1511] Processing CreateTablet for tablet 615c5414ab724457a1049455f559bab4 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:24.105657  5147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615c5414ab724457a1049455f559bab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.088382  5146 tablet_service.cc:1511] Processing CreateTablet for tablet 281e91779b14462aa4fb6af62998cd20 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:24.108915  5146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281e91779b14462aa4fb6af62998cd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.089555  5210 raft_consensus.cc:493] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.111064  5210 raft_consensus.cc:515] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.094094  4918 tablet_service.cc:1511] Processing CreateTablet for tablet 615c5414ab724457a1049455f559bab4 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:17:24.098949  4920 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 36) took 1007 ms. Trace:
I20260709 13:17:24.086055  4996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 30) took 1197 ms. Trace:
I20260709 13:17:24.100982  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3f70c10d7c4ab0aac5333f93491029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.101684  4995 tablet_service.cc:1511] Processing CreateTablet for tablet 281e91779b14462aa4fb6af62998cd20 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:17:24.116242  4996 rpcz_store.cc:276] 0709 13:17:22.888934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.597334 (+708400us) service_pool.cc:224] Handling call
0709 13:17:23.599215 (+  1881us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.599315 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.993180 (+393865us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.055629 (+ 62449us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.085860 (+ 30231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.116132  4920 rpcz_store.cc:276] 0709 13:17:23.095351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.944624 (+849273us) service_pool.cc:224] Handling call
0709 13:17:23.962065 (+ 17441us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.962269 (+   204us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:24.030558 (+ 68289us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.098346 (+ 67788us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.098861 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.118153  4995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281e91779b14462aa4fb6af62998cd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.120127  5070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615c5414ab724457a1049455f559bab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.121697  5210 leader_election.cc:290] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:24.119522  5050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:36057, user_credentials={real_user=slave}} blocked reactor thread for 77308.5us
I20260709 13:17:24.125591  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.116700  4918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 615c5414ab724457a1049455f559bab4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:24.140067  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 230563us
W20260709 13:17:24.141315  4900 leader_election.cc:343] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.143466  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.143474  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:24.147591  4900 leader_election.cc:343] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.148105  4900 leader_election.cc:304] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:24.148959  5210 raft_consensus.cc:2749] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.157387  5206 tablet_bootstrap.cc:654] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:24.159584  4900 leader_election.cc:343] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.161376  4900 leader_election.cc:304] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:24.161530  5212 raft_consensus.cc:493] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.162300  5210 raft_consensus.cc:2749] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.162159  5212 raft_consensus.cc:515] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.164635  5212 leader_election.cc:290] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.166698  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.166939  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:24.168282  4975 leader_election.cc:343] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:24.171542  4975 leader_election.cc:343] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.171620  4927 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 35) took 1117 ms. Trace:
I20260709 13:17:24.172015  4975 leader_election.cc:304] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:24.172122  4927 rpcz_store.cc:276] 0709 13:17:23.054014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.873258 (+819244us) service_pool.cc:224] Handling call
0709 13:17:23.939181 (+ 65923us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.939363 (+   182us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:24.017013 (+ 77650us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.171129 (+154116us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.171564 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.172750  4920 tablet_service.cc:1511] Processing CreateTablet for tablet b0550850ae264c03b931a289b670c061 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:24.173347  5212 raft_consensus.cc:2749] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.174160  4920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0550850ae264c03b931a289b670c061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.160423  5201 tablet_bootstrap.cc:654] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.196117  4923 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44742 (request call id 32) took 1301 ms. Trace:
I20260709 13:17:24.196763  4923 rpcz_store.cc:276] 0709 13:17:22.894560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.281654 (+387094us) service_pool.cc:224] Handling call
0709 13:17:23.350989 (+ 69335us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.355724 (+  4735us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.880240 (+524516us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.159381 (+279141us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.195895 (+ 36514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.197388  5237 raft_consensus.cc:493] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.197942  5237 raft_consensus.cc:515] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.202510  5237 leader_election.cc:290] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:24.202965  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.204368  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be904dd9747941818620fdde5b5e8dd8" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.205066  4937 raft_consensus.cc:2468] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:24.206488  5124 leader_election.cc:304] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:24.207417  5237 raft_consensus.cc:2804] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.207813  5237 raft_consensus.cc:493] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.208880  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be904dd9747941818620fdde5b5e8dd8" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:24.209348  5237 raft_consensus.cc:3060] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.213032  4924 tablet_service.cc:1511] Processing CreateTablet for tablet 23abed59564b473b8104457c3f04dbd1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:24.214406  4924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abed59564b473b8104457c3f04dbd1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:24.221140  5123 leader_election.cc:343] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:24.222940  5123 leader_election.cc:343] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.223402  5123 leader_election.cc:304] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:24.224427  5236 raft_consensus.cc:2749] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.223323  4926 tablet_service.cc:1511] Processing CreateTablet for tablet 261bba9d86af4a97a43b900a29cda09e (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:24.225745  4993 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 33) took 1313 ms. Trace:
I20260709 13:17:24.226344  4993 rpcz_store.cc:276] 0709 13:17:22.912022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.894753 (+982731us) service_pool.cc:224] Handling call
0709 13:17:23.980169 (+ 85416us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.980266 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:23.994675 (+ 14409us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.225053 (+230378us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.225667 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.225785  4926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261bba9d86af4a97a43b900a29cda09e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.219635  5237 raft_consensus.cc:515] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.240653  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be904dd9747941818620fdde5b5e8dd8" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:24.199826  5000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 34) took 1203 ms. Trace:
I20260709 13:17:24.235234  5203 tablet_bootstrap.cc:654] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.251267  5001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 36) took 1149 ms. Trace:
I20260709 13:17:24.243920  5000 rpcz_store.cc:276] 0709 13:17:22.996469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.898120 (+901651us) service_pool.cc:224] Handling call
0709 13:17:23.924988 (+ 26868us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.939189 (+ 14201us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:24.074052 (+134863us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.199074 (+125022us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.199720 (+   646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.256037  5202 tablet_bootstrap.cc:654] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:24.242766  5123 leader_election.cc:343] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.263558  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be904dd9747941818620fdde5b5e8dd8" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:24.264206  4937 raft_consensus.cc:3060] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.266382  5206 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:24.266939  5206 ts_tablet_manager.cc:1403] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.225s	user 0.010s	sys 0.019s
I20260709 13:17:24.270323  5206 raft_consensus.cc:359] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.231710  4997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34546 (request call id 35) took 1174 ms. Trace:
I20260709 13:17:24.271078  5206 raft_consensus.cc:385] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.271461  5206 raft_consensus.cc:740] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.271312  4997 rpcz_store.cc:276] 0709 13:17:23.057456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.901202 (+843746us) service_pool.cc:224] Handling call
0709 13:17:23.996627 (+ 95425us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:23.996832 (+   205us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:24.146004 (+149172us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.231061 (+ 85057us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.231651 (+   590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.272569  5206 consensus_queue.cc:260] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.274478  4937 raft_consensus.cc:2468] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:24.275020  5237 leader_election.cc:290] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:24.275236  5206 ts_tablet_manager.cc:1434] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:17:24.258451  5001 rpcz_store.cc:276] 0709 13:17:23.102175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.997661 (+895486us) service_pool.cc:224] Handling call
0709 13:17:24.043950 (+ 46289us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:17:24.044056 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:17:24.163832 (+119776us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:24.250693 (+ 86861us) tablet_replica.cc:206] Creating consensus instance
0709 13:17:24.251183 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.279492  5068 tablet_service.cc:1511] Processing CreateTablet for tablet 1b77438d30f849be8959ef2a5aea7f5b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:24.280858  5201 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:24.281385  5068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77438d30f849be8959ef2a5aea7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.281417  5201 ts_tablet_manager.cc:1403] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.236s	user 0.024s	sys 0.012s
I20260709 13:17:24.281925  4993 tablet_service.cc:1511] Processing CreateTablet for tablet b0550850ae264c03b931a289b670c061 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:24.282297  5071 tablet_service.cc:1511] Processing CreateTablet for tablet 261bba9d86af4a97a43b900a29cda09e (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:24.283872  4993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0550850ae264c03b931a289b670c061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.287032  5124 leader_election.cc:304] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:24.287365  5073 tablet_service.cc:1511] Processing CreateTablet for tablet 23abed59564b473b8104457c3f04dbd1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:24.280906  5142 tablet_service.cc:1511] Processing CreateTablet for tablet b0550850ae264c03b931a289b670c061 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:17:24.288262  5201 raft_consensus.cc:359] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.289074  5201 raft_consensus.cc:385] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.289235  5142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0550850ae264c03b931a289b670c061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.289453  5201 raft_consensus.cc:740] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.289785  5000 tablet_service.cc:1511] Processing CreateTablet for tablet 261bba9d86af4a97a43b900a29cda09e (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:17:24.290397  5201 consensus_queue.cc:260] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.289165  5147 tablet_service.cc:1511] Processing CreateTablet for tablet 23abed59564b473b8104457c3f04dbd1 (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:17:24.288262  5071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261bba9d86af4a97a43b900a29cda09e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.292487  5147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abed59564b473b8104457c3f04dbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.292414  4997 tablet_service.cc:1511] Processing CreateTablet for tablet 1b77438d30f849be8959ef2a5aea7f5b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:24.293126  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23abed59564b473b8104457c3f04dbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.289172  5146 tablet_service.cc:1511] Processing CreateTablet for tablet 1b77438d30f849be8959ef2a5aea7f5b (DEFAULT_TABLE table=test-workload [id=f88420bebeb44fa49a029084b294ff75]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:17:24.295712  5201 ts_tablet_manager.cc:1434] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:17:24.295917  5146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77438d30f849be8959ef2a5aea7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.296868  5201 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:24.297789  5237 raft_consensus.cc:2804] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.303022  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261bba9d86af4a97a43b900a29cda09e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.306607  5206 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:24.310161  4997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77438d30f849be8959ef2a5aea7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:24.317467  5238 raft_consensus.cc:493] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.317667  5212 raft_consensus.cc:493] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.318106  5238 raft_consensus.cc:515] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.318207  5212 raft_consensus.cc:515] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.320680  5212 leader_election.cc:290] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:24.322006  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15cb77576c214fada45083baabff5c2d" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.323897  5206 tablet_bootstrap.cc:654] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.300544  5237 raft_consensus.cc:697] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
W20260709 13:17:24.326174  5050 leader_election.cc:343] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.334966  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494c1d883684e3285f3d2e4ad7c0c97" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:24.324311  5238 leader_election.cc:290] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:24.336555  4975 leader_election.cc:343] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.340660  5237 consensus_queue.cc:237] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.351375  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494c1d883684e3285f3d2e4ad7c0c97" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.352167  4937 raft_consensus.cc:2468] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:24.356266  4976 leader_election.cc:304] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:24.357942  5201 tablet_bootstrap.cc:654] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.357786  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15cb77576c214fada45083baabff5c2d" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.358990  5212 raft_consensus.cc:2804] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.359416  5212 raft_consensus.cc:493] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.359797  5212 raft_consensus.cc:3060] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:24.364456  5049 leader_election.cc:343] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.365003  5049 leader_election.cc:304] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:24.365995  5238 raft_consensus.cc:2749] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.380520  5212 raft_consensus.cc:515] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.402808  4835 catalog_manager.cc:5697] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.419353  5203 tablet_bootstrap.cc:492] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.420147  5203 ts_tablet_manager.cc:1403] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.369s	user 0.010s	sys 0.010s
I20260709 13:17:24.422942  5202 tablet_bootstrap.cc:492] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:24.423684  5202 ts_tablet_manager.cc:1403] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.327s	user 0.017s	sys 0.000s
I20260709 13:17:24.423529  5203 raft_consensus.cc:359] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.424410  5203 raft_consensus.cc:385] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.424739  5203 raft_consensus.cc:740] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.425480  5203 consensus_queue.cc:260] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.427156  5203 ts_tablet_manager.cc:1434] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:24.429735  5203 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.435479  5212 leader_election.cc:290] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:24.439730  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494c1d883684e3285f3d2e4ad7c0c97" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:24.440064  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494c1d883684e3285f3d2e4ad7c0c97" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:24.440469  4937 raft_consensus.cc:3060] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:24.441648  4975 leader_election.cc:343] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.443838  5203 tablet_bootstrap.cc:654] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.446116  5206 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:24.446615  5206 ts_tablet_manager.cc:1403] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.014s
I20260709 13:17:24.427431  5202 raft_consensus.cc:359] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.453325  5202 raft_consensus.cc:385] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.453642  5202 raft_consensus.cc:740] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.454449  5201 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:24.455046  5201 ts_tablet_manager.cc:1403] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.158s	user 0.021s	sys 0.022s
I20260709 13:17:24.455991  5206 raft_consensus.cc:359] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.460623  5201 raft_consensus.cc:359] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.461342  5201 raft_consensus.cc:385] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.461639  5201 raft_consensus.cc:740] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.459268  5206 raft_consensus.cc:385] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.462363  5201 consensus_queue.cc:260] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.465284  5201 ts_tablet_manager.cc:1434] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:17:24.466440  5201 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:24.455049  4937 raft_consensus.cc:2468] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:24.462352  5206 raft_consensus.cc:740] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.468865  4976 leader_election.cc:304] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:24.469054  5206 consensus_queue.cc:260] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.454425  5202 consensus_queue.cc:260] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.474262  5202 ts_tablet_manager.cc:1434] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:17:24.475585  5202 tablet_bootstrap.cc:492] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:24.470012  5212 raft_consensus.cc:2804] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.489307  5203 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.489848  5203 ts_tablet_manager.cc:1403] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.013s
I20260709 13:17:24.492996  5203 raft_consensus.cc:359] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.493340  5201 tablet_bootstrap.cc:654] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.493721  5203 raft_consensus.cc:385] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.496248  5212 raft_consensus.cc:697] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:24.496491  5203 raft_consensus.cc:740] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.497447  5203 consensus_queue.cc:260] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.498200  5238 raft_consensus.cc:493] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.498684  5238 raft_consensus.cc:515] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.501502  5238 leader_election.cc:290] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.497447  5212 consensus_queue.cc:237] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.502842  5203 ts_tablet_manager.cc:1434] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:17:24.504016  5203 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.504233  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc62241274be438184b329dc0635e9d1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.505915  5012 raft_consensus.cc:2468] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:24.506894  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc62241274be438184b329dc0635e9d1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.507499  5160 raft_consensus.cc:2468] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:24.507979  5049 leader_election.cc:304] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:24.509685  5238 raft_consensus.cc:2804] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.510319  5238 raft_consensus.cc:493] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.510731  5238 raft_consensus.cc:3060] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.511405  5206 ts_tablet_manager.cc:1434] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.064s	user 0.022s	sys 0.000s
I20260709 13:17:24.515053  5206 tablet_bootstrap.cc:492] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:24.518916  5238 raft_consensus.cc:515] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.525722  5238 leader_election.cc:290] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.526403  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc62241274be438184b329dc0635e9d1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:24.526676  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc62241274be438184b329dc0635e9d1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:24.527812  5160 raft_consensus.cc:3060] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.527348  5012 raft_consensus.cc:3060] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.532138  5203 tablet_bootstrap.cc:654] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.526727  5206 tablet_bootstrap.cc:654] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.537269  5012 raft_consensus.cc:2468] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:24.539299  5049 leader_election.cc:304] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:24.540241  5238 raft_consensus.cc:2804] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.540798  5238 raft_consensus.cc:697] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:24.541664  5238 consensus_queue.cc:237] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.551083  5201 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:24.552142  5201 ts_tablet_manager.cc:1403] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.001s
I20260709 13:17:24.545214  5160 raft_consensus.cc:2468] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:24.558846  5201 raft_consensus.cc:359] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.560161  5201 raft_consensus.cc:385] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.560400  5206 tablet_bootstrap.cc:492] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:24.561010  5206 ts_tablet_manager.cc:1403] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.004s
I20260709 13:17:24.562433  5203 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.563028  5203 ts_tablet_manager.cc:1403] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.025s
I20260709 13:17:24.564214  5206 raft_consensus.cc:359] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.551226  5202 tablet_bootstrap.cc:654] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.564965  5206 raft_consensus.cc:385] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.565332  5206 raft_consensus.cc:740] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.566134  5206 consensus_queue.cc:260] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.567598  5203 raft_consensus.cc:359] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.573299  5203 raft_consensus.cc:385] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.573766  5203 raft_consensus.cc:740] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.574221  5206 ts_tablet_manager.cc:1434] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:17:24.572042  4832 catalog_manager.cc:5697] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.574936  5203 consensus_queue.cc:260] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.560436  5201 raft_consensus.cc:740] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.578510  5203 ts_tablet_manager.cc:1434] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:17:24.579061  5201 consensus_queue.cc:260] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.579726  5203 tablet_bootstrap.cc:492] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.581905  5201 ts_tablet_manager.cc:1434] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:17:24.583024  5201 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:24.584836  5206 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:24.587595  5202 tablet_bootstrap.cc:492] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:24.588747  5202 ts_tablet_manager.cc:1403] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.113s	user 0.022s	sys 0.008s
I20260709 13:17:24.589614  5203 tablet_bootstrap.cc:654] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.593358  5202 raft_consensus.cc:359] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.598804  5202 raft_consensus.cc:385] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.599817  5202 raft_consensus.cc:740] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.608783  4834 catalog_manager.cc:5697] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.608907  5202 consensus_queue.cc:260] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.613068  5202 ts_tablet_manager.cc:1434] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:17:24.605715  5206 tablet_bootstrap.cc:654] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.614467  5202 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:24.613164  5203 tablet_bootstrap.cc:492] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.616747  5203 ts_tablet_manager.cc:1403] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.037s	user 0.030s	sys 0.002s
I20260709 13:17:24.619004  5201 tablet_bootstrap.cc:654] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.620041  5203 raft_consensus.cc:359] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.620937  5203 raft_consensus.cc:385] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.621243  5203 raft_consensus.cc:740] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.622964  5202 tablet_bootstrap.cc:654] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.623431  5203 consensus_queue.cc:260] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.630898  5203 ts_tablet_manager.cc:1434] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:17:24.632097  5203 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.633188  5212 raft_consensus.cc:493] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.633414  5202 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:24.634008  5202 ts_tablet_manager.cc:1403] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:17:24.633744  5212 raft_consensus.cc:515] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.637744  5212 leader_election.cc:290] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:24.639567  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15cb77576c214fada45083baabff5c2d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:24.640506  5086 raft_consensus.cc:2468] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:24.638492  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15cb77576c214fada45083baabff5c2d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.642280  4975 leader_election.cc:304] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:24.642520  4937 raft_consensus.cc:2468] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:24.643992  5203 tablet_bootstrap.cc:654] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.652405  5212 raft_consensus.cc:2804] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.653083  5212 raft_consensus.cc:493] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.653548  5212 raft_consensus.cc:3060] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.658105  5202 raft_consensus.cc:359] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.659452  5202 raft_consensus.cc:385] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.659785  5202 raft_consensus.cc:740] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.660562  5202 consensus_queue.cc:260] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.662756  5238 raft_consensus.cc:493] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.663242  5238 raft_consensus.cc:515] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.663493  5212 raft_consensus.cc:515] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.665359  5238 leader_election.cc:290] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.666136  5212 leader_election.cc:290] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:24.667928  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15cb77576c214fada45083baabff5c2d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:24.668215  5206 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:24.668545  5086 raft_consensus.cc:3060] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.668700  5206 ts_tablet_manager.cc:1403] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.028s
I20260709 13:17:24.671996  5206 raft_consensus.cc:359] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.672662  5206 raft_consensus.cc:385] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.673030  5206 raft_consensus.cc:740] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.673187  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15cb77576c214fada45083baabff5c2d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:24.673765  4937 raft_consensus.cc:3060] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.676168  5206 consensus_queue.cc:260] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.680778  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.681897  5237 raft_consensus.cc:493] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.682404  5237 raft_consensus.cc:515] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.683393  5206 ts_tablet_manager.cc:1434] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:17:24.689039  5206 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:24.672595  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.692636  5012 raft_consensus.cc:2468] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:24.694110  5211 raft_consensus.cc:493] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.694821  5211 raft_consensus.cc:515] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.697834  5211 leader_election.cc:290] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.698470  5211 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.699020  5211 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.701519  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ee2e2aa9aa4bba9f078425f142e0fc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.702544  5049 leader_election.cc:304] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
W20260709 13:17:24.703061  5050 leader_election.cc:343] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:24.703471  5049 leader_election.cc:343] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.705963  5206 tablet_bootstrap.cc:654] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.706363  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:24.708436  5123 leader_election.cc:343] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.709971  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ee2e2aa9aa4bba9f078425f142e0fc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.710968  5160 raft_consensus.cc:2468] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:24.684423  5237 leader_election.cc:290] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:24.687002  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.716004  5011 raft_consensus.cc:2468] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:24.716732  5203 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.717290  5203 ts_tablet_manager.cc:1403] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.053s
I20260709 13:17:24.718094  5123 leader_election.cc:304] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:24.719779  5237 raft_consensus.cc:2804] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.720245  5237 raft_consensus.cc:493] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.720757  5237 raft_consensus.cc:3060] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.720669  5203 raft_consensus.cc:359] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.721808  5203 raft_consensus.cc:385] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.722115  5203 raft_consensus.cc:740] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.722993  5203 consensus_queue.cc:260] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.725515  5202 ts_tablet_manager.cc:1434] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.001s
I20260709 13:17:24.715178  5238 raft_consensus.cc:2804] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.731138  5238 raft_consensus.cc:493] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.731679  5238 raft_consensus.cc:3060] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.734362  5202 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:24.742470  5202 tablet_bootstrap.cc:654] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.752907  5049 leader_election.cc:304] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:24.758265  5203 ts_tablet_manager.cc:1434] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 13:17:24.759379  5203 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.770478  5203 tablet_bootstrap.cc:654] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.771271  5086 raft_consensus.cc:2468] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:24.772856  5211 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:24.773620  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.773892  5266 raft_consensus.cc:2804] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.774293  5266 raft_consensus.cc:493] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.774616  5266 raft_consensus.cc:3060] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:24.775225  5050 leader_election.cc:343] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.776098  5238 raft_consensus.cc:515] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.778264  5238 leader_election.cc:290] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.784008  4937 raft_consensus.cc:2468] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:24.785398  4976 leader_election.cc:304] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:24.786473  5212 raft_consensus.cc:2804] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.787123  5212 raft_consensus.cc:697] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:24.788221  5212 consensus_queue.cc:237] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.789176  5237 raft_consensus.cc:515] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.759379  5206 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:24.792269  5236 raft_consensus.cc:493] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.792866  5236 raft_consensus.cc:515] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.793071  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:24.793882  5011 raft_consensus.cc:3060] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.795164  5236 leader_election.cc:290] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:24.796815  5206 ts_tablet_manager.cc:1403] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.108s	user 0.020s	sys 0.015s
I20260709 13:17:24.799499  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:24.801630  5123 leader_election.cc:343] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.791564  5237 leader_election.cc:290] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:24.809392  5206 raft_consensus.cc:359] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.810184  5206 raft_consensus.cc:385] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.810313  5201 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:24.810520  5206 raft_consensus.cc:740] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.810863  5201 ts_tablet_manager.cc:1403] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.228s	user 0.043s	sys 0.039s
I20260709 13:17:24.805539  5236 consensus_queue.cc:1048] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:17:24.812105  5206 consensus_queue.cc:260] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.813983  5201 raft_consensus.cc:359] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.814469  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.814761  5201 raft_consensus.cc:385] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.815065  5201 raft_consensus.cc:740] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
W20260709 13:17:24.819195  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 66819.9us
W20260709 13:17:24.820653  5124 leader_election.cc:343] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.821246  5124 leader_election.cc:304] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:24.823833  5236 raft_consensus.cc:2749] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.824623  5201 consensus_queue.cc:260] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.827101  5201 ts_tablet_manager.cc:1434] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:17:24.828197  5201 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:24.831950  5203 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.832489  5203 ts_tablet_manager.cc:1403] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.024s
I20260709 13:17:24.835314  5206 ts_tablet_manager.cc:1434] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:17:24.839782  5251 raft_consensus.cc:493] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.840397  5251 raft_consensus.cc:515] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.841749  5201 tablet_bootstrap.cc:654] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.843238  5251 leader_election.cc:290] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:24.844204  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:24.843592  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.846508  4936 raft_consensus.cc:2468] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:24.849211  5011 raft_consensus.cc:2468] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:24.847838  4976 leader_election.cc:304] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
W20260709 13:17:24.854507  4975 leader_election.cc:343] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.856900  5123 leader_election.cc:304] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:24.857041  5251 raft_consensus.cc:2804] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.861971  5251 raft_consensus.cc:493] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.862342  5251 raft_consensus.cc:3060] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.863632  4831 catalog_manager.cc:5697] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.870051  5251 raft_consensus.cc:515] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.872107  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:24.873371  5270 raft_consensus.cc:2804] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.874152  5270 raft_consensus.cc:697] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:24.875617  5270 consensus_queue.cc:237] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.878407  5202 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:24.879105  5206 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:24.874846  5203 raft_consensus.cc:359] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.882200  5203 raft_consensus.cc:385] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.882463  5203 raft_consensus.cc:740] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.883246  5203 consensus_queue.cc:260] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.883999  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:24.884697  5011 raft_consensus.cc:3060] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.885396  5203 ts_tablet_manager.cc:1434] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:17:24.886027  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:24.886479  5203 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.887616  5210 raft_consensus.cc:493] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.888121  5210 raft_consensus.cc:515] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.881386  5202 ts_tablet_manager.cc:1403] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.152s	user 0.016s	sys 0.011s
I20260709 13:17:24.890250  5210 leader_election.cc:290] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:24.890754  5206 tablet_bootstrap.cc:654] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.893675  5203 tablet_bootstrap.cc:654] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.894012  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
W20260709 13:17:24.895097  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:24.895552  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:24.896202  5160 raft_consensus.cc:2468] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:24.896237  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
W20260709 13:17:24.899576  5049 leader_election.cc:343] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.899658  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:24.900370  5049 leader_election.cc:343] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.900779  5049 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:24.901733  4975 leader_election.cc:343] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.904552  5202 raft_consensus.cc:359] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.905339  5201 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:24.905930  5086 raft_consensus.cc:3060] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.906052  5201 ts_tablet_manager.cc:1403] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.022s
I20260709 13:17:24.906785  5266 raft_consensus.cc:515] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.908968  5266 leader_election.cc:290] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:24.909796  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ee2e2aa9aa4bba9f078425f142e0fc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:24.909703  5201 raft_consensus.cc:359] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.910481  4936 raft_consensus.cc:3060] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.905385  5267 raft_consensus.cc:2749] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:24.910475  5201 raft_consensus.cc:385] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.911746  5201 raft_consensus.cc:740] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.912118  4900 leader_election.cc:304] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:24.912420  5201 consensus_queue.cc:260] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:24.913610  4900 leader_election.cc:343] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:24.914795  5123 leader_election.cc:343] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:24.915903  5210 raft_consensus.cc:2804] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:24.917464  5251 leader_election.cc:290] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:24.918808  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:24.922686  5210 raft_consensus.cc:493] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.922955  4935 raft_consensus.cc:3060] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.923204  5210 raft_consensus.cc:3060] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.929416  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ee2e2aa9aa4bba9f078425f142e0fc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:24.930284  5160 raft_consensus.cc:3060] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:24.905385  5202 raft_consensus.cc:385] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.938369  5202 raft_consensus.cc:740] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.946689  5201 ts_tablet_manager.cc:1434] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.008s
I20260709 13:17:24.950722  5011 raft_consensus.cc:2468] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:24.954540  5201 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:24.953039  5049 leader_election.cc:304] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:24.956276  4935 raft_consensus.cc:2468] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:24.956462  5267 raft_consensus.cc:2804] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.957129  5203 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:24.957695  5203 ts_tablet_manager.cc:1403] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.012s
I20260709 13:17:24.957749  4976 leader_election.cc:304] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:24.958731  5270 consensus_queue.cc:1048] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:24.960724  4936 raft_consensus.cc:2468] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:24.958995  5251 raft_consensus.cc:2804] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.961663  5251 raft_consensus.cc:697] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:24.962522  5251 consensus_queue.cc:237] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:24.963644  5050 leader_election.cc:304] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:24.959470  5202 consensus_queue.cc:260] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:24.964545  5266 raft_consensus.cc:2804] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:24.965014  5266 raft_consensus.cc:697] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:24.965888  5202 ts_tablet_manager.cc:1434] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:17:24.965834  5266 consensus_queue.cc:237] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.967063  5202 tablet_bootstrap.cc:492] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:24.957033  5267 raft_consensus.cc:697] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:24.968422  5267 consensus_queue.cc:237] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:24.969133  5160 raft_consensus.cc:2468] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:24.968741  4831 catalog_manager.cc:5697] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.975672  5203 raft_consensus.cc:359] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.977283  5203 raft_consensus.cc:385] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:24.977563  5203 raft_consensus.cc:740] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:24.980337  5203 consensus_queue.cc:260] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:24.983302  5206 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:24.983816  5203 ts_tablet_manager.cc:1434] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:17:24.983896  5206 ts_tablet_manager.cc:1403] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.131s	user 0.024s	sys 0.004s
I20260709 13:17:24.985159  5203 tablet_bootstrap.cc:492] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:24.997157  5203 tablet_bootstrap.cc:654] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:24.998178  4835 catalog_manager.cc:5697] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.002120  5206 raft_consensus.cc:359] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.002883  5206 raft_consensus.cc:385] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.003165  5206 raft_consensus.cc:740] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.005645  5201 tablet_bootstrap.cc:654] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.012466  5210 raft_consensus.cc:515] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.014277  5206 consensus_queue.cc:260] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.021370  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:25.022163  5160 raft_consensus.cc:3060] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.041740  5206 ts_tablet_manager.cc:1434] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:17:25.043157  5206 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.051757  5160 raft_consensus.cc:2468] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:25.053026  4900 leader_election.cc:304] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:25.053059  5210 leader_election.cc:290] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.048204  4831 catalog_manager.cc:5697] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.054701  5276 raft_consensus.cc:2804] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.055219  5276 raft_consensus.cc:697] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:25.055902  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:25.056387  5206 tablet_bootstrap.cc:654] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.050155  5251 raft_consensus.cc:493] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.056150  5276 consensus_queue.cc:237] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:25.058589  4900 leader_election.cc:343] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.058168  5251 raft_consensus.cc:515] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.062399  5266 consensus_queue.cc:1048] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.063438  5251 leader_election.cc:290] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.064240  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.064936  5160 raft_consensus.cc:2468] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:25.066054  4975 leader_election.cc:304] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:25.066922  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:25.070374  4976 leader_election.cc:343] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.072618  5201 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.073513  5201 ts_tablet_manager.cc:1403] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.119s	user 0.022s	sys 0.027s
I20260709 13:17:25.079504  5201 raft_consensus.cc:359] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.080349  5202 tablet_bootstrap.cc:654] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.080590  5201 raft_consensus.cc:385] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.080992  5201 raft_consensus.cc:740] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.081935  5201 consensus_queue.cc:260] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.084354  5201 ts_tablet_manager.cc:1434] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:25.085752  5201 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.072577  5251 raft_consensus.cc:2804] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.089406  5086 raft_consensus.cc:3060] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.102250  5206 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:25.104683  5203 tablet_bootstrap.cc:492] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.104496  5212 consensus_queue.cc:1048] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.089396  5251 raft_consensus.cc:493] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.107632  5251 raft_consensus.cc:3060] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.109733  4831 catalog_manager.cc:5697] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.106388  5203 ts_tablet_manager.cc:1403] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.000s
I20260709 13:17:25.106995  5206 ts_tablet_manager.cc:1403] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.010s
I20260709 13:17:25.113711  5212 consensus_queue.cc:1048] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.111513  4835 catalog_manager.cc:5697] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.115629  5203 raft_consensus.cc:359] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.119858  5203 raft_consensus.cc:385] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.120162  5203 raft_consensus.cc:740] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.127709  5201 tablet_bootstrap.cc:654] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.137365  5266 consensus_queue.cc:1048] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.131271  5203 consensus_queue.cc:260] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.143402  5203 ts_tablet_manager.cc:1434] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:17:25.139317  5251 raft_consensus.cc:515] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.145951  5203 tablet_bootstrap.cc:492] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.157730  5251 leader_election.cc:290] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.166283  5206 raft_consensus.cc:359] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.166812  5206 raft_consensus.cc:385] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.166980  5206 raft_consensus.cc:740] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.168273  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:25.168998  4936 raft_consensus.cc:3060] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.165519  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:25.170166  5159 raft_consensus.cc:3060] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.172767  5276 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.173326  5276 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.175529  5276 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:25.177742  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.178413  5085 raft_consensus.cc:2468] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:25.181121  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.182586  4900 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.184379  5276 raft_consensus.cc:2804] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.184796  5276 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.185184  5276 raft_consensus.cc:3060] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.186407  5266 raft_consensus.cc:493] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.186941  5266 raft_consensus.cc:515] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.189141  5266 leader_election.cc:290] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:25.189670  5202 tablet_bootstrap.cc:492] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.191006  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.191323  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.191979  5010 raft_consensus.cc:2393] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c70fac7b468a4fa59ccb26ef6e6220f6 in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:25.193064  5202 ts_tablet_manager.cc:1403] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.226s	user 0.028s	sys 0.032s
I20260709 13:17:25.193548  5049 leader_election.cc:304] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.193226  5201 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.194698  5266 raft_consensus.cc:3060] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.195057  5212 raft_consensus.cc:493] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.198531  5203 tablet_bootstrap.cc:654] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.198380  5212 raft_consensus.cc:515] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.199919  5206 consensus_queue.cc:260] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.200564  5212 leader_election.cc:290] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.200670  4936 raft_consensus.cc:2468] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:25.200860  5012 raft_consensus.cc:2468] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:25.202384  5202 raft_consensus.cc:359] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.203125  5202 raft_consensus.cc:385] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.203512  5202 raft_consensus.cc:740] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.201190  5212 consensus_queue.cc:1048] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:17:25.202989  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.206008  5158 raft_consensus.cc:2468] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:25.207247  4975 leader_election.cc:304] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:25.208478  5202 consensus_queue.cc:260] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.208756  4976 leader_election.cc:304] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:25.212325  5266 raft_consensus.cc:2749] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.213040  5201 ts_tablet_manager.cc:1403] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.005s
I20260709 13:17:25.213956  5212 raft_consensus.cc:2804] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.214419  5212 raft_consensus.cc:493] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.214792  5212 raft_consensus.cc:3060] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.216580  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.216882  5206 ts_tablet_manager.cc:1434] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.000s
I20260709 13:17:25.218163  5206 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.197458  5276 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.223639  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:25.216849  5201 raft_consensus.cc:359] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.224231  5011 raft_consensus.cc:3060] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.224289  5201 raft_consensus.cc:385] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.224568  5203 tablet_bootstrap.cc:492] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.224880  5201 raft_consensus.cc:740] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.225201  5203 ts_tablet_manager.cc:1403] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.000s
I20260709 13:17:25.228097  5201 consensus_queue.cc:260] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.226989  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:25.232674  5085 raft_consensus.cc:3060] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.234032  5202 ts_tablet_manager.cc:1434] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:17:25.235131  5202 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.242434  5085 raft_consensus.cc:2468] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:25.230185  5203 raft_consensus.cc:359] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.245617  5203 raft_consensus.cc:385] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.231077  5159 raft_consensus.cc:2468] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:25.245992  5203 raft_consensus.cc:740] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.246641  4900 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.246786  5203 consensus_queue.cc:260] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.247613  5210 raft_consensus.cc:2804] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.248939  5203 ts_tablet_manager.cc:1434] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
I20260709 13:17:25.225728  5251 raft_consensus.cc:2804] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:25.252559  4976 leader_election.cc:343] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.253263  5203 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.232188  5206 tablet_bootstrap.cc:654] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.228865  5276 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:25.245119  5201 ts_tablet_manager.cc:1434] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:17:25.257608  5201 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.260401  5011 raft_consensus.cc:2468] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:25.264578  5210 raft_consensus.cc:697] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:25.265672  5210 consensus_queue.cc:237] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.268306  5251 raft_consensus.cc:697] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:25.269038  5212 raft_consensus.cc:515] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.269315  5251 consensus_queue.cc:237] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.271842  5212 leader_election.cc:290] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.272389  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:25.274405  5203 tablet_bootstrap.cc:654] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.275343  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:25.276047  5159 raft_consensus.cc:3060] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:25.273887  4976 leader_election.cc:343] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.283895  5201 tablet_bootstrap.cc:654] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.287159  5203 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.289718  5299 consensus_queue.cc:1048] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.294193  5203 ts_tablet_manager.cc:1403] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 13:17:25.295610  5270 raft_consensus.cc:493] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.296164  5270 raft_consensus.cc:515] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.293493  5159 raft_consensus.cc:2468] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:25.299069  5202 tablet_bootstrap.cc:654] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.299218  5270 leader_election.cc:290] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:25.299707  5203 raft_consensus.cc:359] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.300575  4975 leader_election.cc:304] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:25.301664  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.302129  5302 raft_consensus.cc:2804] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.302477  5011 raft_consensus.cc:2393] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:25.302839  5302 raft_consensus.cc:697] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:25.300462  5203 raft_consensus.cc:385] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.303975  5302 consensus_queue.cc:237] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.304876  5203 raft_consensus.cc:740] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.305684  5203 consensus_queue.cc:260] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.307638  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8d34906755246e3b3f0d4c435283a5a" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.308552  5206 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:25.309286  5123 leader_election.cc:304] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:25.310209  5206 ts_tablet_manager.cc:1403] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.004s
I20260709 13:17:25.310523  5270 raft_consensus.cc:3060] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.311213  5203 ts_tablet_manager.cc:1434] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:17:25.312418  5203 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.318529  5203 tablet_bootstrap.cc:654] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.318868  4831 catalog_manager.cc:5697] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.330958  5202 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.331419  5203 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.331578  5202 ts_tablet_manager.cc:1403] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.001s
I20260709 13:17:25.331943  5203 ts_tablet_manager.cc:1403] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 13:17:25.334563  5203 raft_consensus.cc:359] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.335731  5270 raft_consensus.cc:2749] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.336998  5203 raft_consensus.cc:385] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.336337  5202 raft_consensus.cc:359] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.337328  5203 raft_consensus.cc:740] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.337466  5202 raft_consensus.cc:385] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.337764  5202 raft_consensus.cc:740] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.338097  5203 consensus_queue.cc:260] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.338567  5202 consensus_queue.cc:260] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.340068  5202 ts_tablet_manager.cc:1434] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:25.340292  5203 ts_tablet_manager.cc:1434] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:17:25.341094  5202 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.341271  5203 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.334560  5206 raft_consensus.cc:359] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.344472  5206 raft_consensus.cc:385] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.344759  5206 raft_consensus.cc:740] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.345503  5206 consensus_queue.cc:260] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.347731  5206 ts_tablet_manager.cc:1434] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:17:25.348423  5202 tablet_bootstrap.cc:654] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.349081  5206 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.351445  5201 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.352011  5201 ts_tablet_manager.cc:1403] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.095s	user 0.006s	sys 0.007s
I20260709 13:17:25.354924  5201 raft_consensus.cc:359] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.355597  5206 tablet_bootstrap.cc:654] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.355747  5201 raft_consensus.cc:385] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.356257  5201 raft_consensus.cc:740] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.357080  5201 consensus_queue.cc:260] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.359404  5201 ts_tablet_manager.cc:1434] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:17:25.360507  5201 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.362814  5203 tablet_bootstrap.cc:654] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.366344  5266 consensus_queue.cc:1048] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.367921  5236 consensus_queue.cc:1048] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.373914  5202 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.374540  5202 ts_tablet_manager.cc:1403] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.004s
I20260709 13:17:25.339428  4835 catalog_manager.cc:5697] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.376046  5210 raft_consensus.cc:493] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.376538  5210 raft_consensus.cc:515] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.377413  4835 catalog_manager.cc:5697] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.378072  5202 raft_consensus.cc:359] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.378542  5210 leader_election.cc:290] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:25.379148  5202 raft_consensus.cc:385] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.379490  5202 raft_consensus.cc:740] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.380430  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.380314  5202 consensus_queue.cc:260] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.381090  5085 raft_consensus.cc:2468] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:25.382534  5202 ts_tablet_manager.cc:1434] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:17:25.382457  4900 leader_election.cc:304] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.383471  5210 raft_consensus.cc:2804] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.383963  5210 raft_consensus.cc:493] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.384379  5210 raft_consensus.cc:3060] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.384456  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.385238  5159 raft_consensus.cc:2468] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:25.389938  5201 tablet_bootstrap.cc:654] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.391480  5266 raft_consensus.cc:493] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.394722  5266 raft_consensus.cc:515] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.396773  5202 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.396874  5266 leader_election.cc:290] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.398368  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.398874  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.399147  5012 raft_consensus.cc:2468] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:25.399544  4935 raft_consensus.cc:2468] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:25.395649  5210 raft_consensus.cc:515] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.400831  5049 leader_election.cc:304] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.402340  5266 raft_consensus.cc:2804] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.402724  5266 raft_consensus.cc:493] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.403126  5266 raft_consensus.cc:3060] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.403831  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:25.404592  5085 raft_consensus.cc:3060] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.412217  5238 consensus_queue.cc:1048] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.418774  5158 raft_consensus.cc:3060] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.419305  5210 leader_election.cc:290] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:25.417724  5202 tablet_bootstrap.cc:654] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.423063  5201 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.423609  5201 ts_tablet_manager.cc:1403] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.006s
I20260709 13:17:25.425241  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:25.425892  5160 raft_consensus.cc:3060] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.426765  5201 raft_consensus.cc:359] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.427500  5201 raft_consensus.cc:385] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.427842  5201 raft_consensus.cc:740] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.428828  5201 consensus_queue.cc:260] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.435819  5202 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.436460  5202 ts_tablet_manager.cc:1403] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.009s
I20260709 13:17:25.436901  5201 ts_tablet_manager.cc:1434] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:17:25.439123  5237 consensus_queue.cc:1048] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.439913  5202 raft_consensus.cc:359] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.440357  5201 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.440657  5202 raft_consensus.cc:385] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.441015  5202 raft_consensus.cc:740] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.441551  5160 raft_consensus.cc:2468] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:25.441841  5202 consensus_queue.cc:260] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.445238  5202 ts_tablet_manager.cc:1434] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:25.446710  5202 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.447074  5238 raft_consensus.cc:493] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.447597  5238 raft_consensus.cc:515] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.448089  5201 tablet_bootstrap.cc:654] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.449016  5302 consensus_queue.cc:1048] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.450994  5238 leader_election.cc:290] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.451278  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.452946  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.453406  5202 tablet_bootstrap.cc:654] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:25.455010  5050 leader_election.cc:343] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:25.456017  5049 leader_election.cc:343] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.456462  4900 leader_election.cc:304] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:25.456557  5049 leader_election.cc:304] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:25.457473  5210 raft_consensus.cc:2804] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.457911  5238 raft_consensus.cc:2749] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.457973  5210 raft_consensus.cc:697] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:25.458523  5266 raft_consensus.cc:515] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.458877  5085 raft_consensus.cc:2468] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:25.459111  5210 consensus_queue.cc:237] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.463282  5266 leader_election.cc:290] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.464164  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:25.464983  4936 raft_consensus.cc:3060] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.467161  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:25.467872  5011 raft_consensus.cc:3060] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.472786  4936 raft_consensus.cc:2468] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:25.474242  5050 leader_election.cc:304] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.475050  5266 raft_consensus.cc:2804] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.475553  5266 raft_consensus.cc:697] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:25.476600  5266 consensus_queue.cc:237] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.477661  5011 raft_consensus.cc:2468] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:25.482476  5238 consensus_queue.cc:1048] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.489485  5202 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.489490  5203 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.490294  5202 ts_tablet_manager.cc:1403] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.004s
I20260709 13:17:25.490685  5203 ts_tablet_manager.cc:1403] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.150s	user 0.014s	sys 0.023s
I20260709 13:17:25.494110  5206 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:25.494592  5206 ts_tablet_manager.cc:1403] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.146s	user 0.023s	sys 0.010s
I20260709 13:17:25.495608  4834 catalog_manager.cc:5697] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.503356  5202 raft_consensus.cc:359] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.504143  5202 raft_consensus.cc:385] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.504431  5202 raft_consensus.cc:740] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.505108  5202 consensus_queue.cc:260] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.507263  5202 ts_tablet_manager.cc:1434] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:17:25.506949  5206 raft_consensus.cc:359] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.508913  5206 raft_consensus.cc:385] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.509284  5206 raft_consensus.cc:740] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.510797  5206 consensus_queue.cc:260] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.515367  5206 ts_tablet_manager.cc:1434] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:17:25.509298  5203 raft_consensus.cc:359] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.517010  5302 consensus_queue.cc:1048] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.517081  5267 consensus_queue.cc:1048] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.510036  5202 tablet_bootstrap.cc:492] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.520277  5203 raft_consensus.cc:385] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.520686  5203 raft_consensus.cc:740] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.521487  5203 consensus_queue.cc:260] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.520685  5206 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.531327  5203 ts_tablet_manager.cc:1434] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:17:25.532279  5206 tablet_bootstrap.cc:654] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.533387  5203 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.539733  5202 tablet_bootstrap.cc:654] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.540024  5201 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.540521  5201 ts_tablet_manager.cc:1403] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.002s
I20260709 13:17:25.540412  5210 consensus_queue.cc:1048] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:25.541572  5301 raft_consensus.cc:493] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.542084  5301 raft_consensus.cc:515] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.544688  5301 leader_election.cc:290] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.546721  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.547510  5157 raft_consensus.cc:2393] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e2c2c6ff9224614b4b24e53c472d346 in current term 1: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:25.547346  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.555893  5202 tablet_bootstrap.cc:492] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.556438  5202 ts_tablet_manager.cc:1403] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.009s
I20260709 13:17:25.556197  4900 leader_election.cc:304] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.559108  5202 raft_consensus.cc:359] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.559804  5202 raft_consensus.cc:385] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.560058  5202 raft_consensus.cc:740] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.561538  5201 raft_consensus.cc:359] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.562263  5301 raft_consensus.cc:3060] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.562515  5201 raft_consensus.cc:385] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.562951  5201 raft_consensus.cc:740] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.567677  5202 consensus_queue.cc:260] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.570883  5201 consensus_queue.cc:260] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.573148  5202 ts_tablet_manager.cc:1434] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:17:25.574215  5202 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.577471  5201 ts_tablet_manager.cc:1434] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:17:25.577594  5301 raft_consensus.cc:2749] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.578969  5201 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.580700  5301 raft_consensus.cc:493] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.581221  5301 raft_consensus.cc:515] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.584304  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:25.585814  4900 leader_election.cc:343] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.587978  5301 leader_election.cc:290] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:25.588235  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.588889  5086 raft_consensus.cc:2468] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:25.590137  4900 leader_election.cc:304] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.590865  5202 tablet_bootstrap.cc:654] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.591482  5301 raft_consensus.cc:2804] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.591995  5301 raft_consensus.cc:493] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.600003  5301 raft_consensus.cc:3060] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.602314  5267 raft_consensus.cc:493] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.607815  5202 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.607306  5267 raft_consensus.cc:515] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.608301  5202 ts_tablet_manager.cc:1403] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.006s
I20260709 13:17:25.608748  5203 tablet_bootstrap.cc:654] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.610025  5267 leader_election.cc:290] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:25.602031  5201 tablet_bootstrap.cc:654] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.610785  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0db5a1497e4b73b5f7090a3e9bbf54" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.612998  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0db5a1497e4b73b5f7090a3e9bbf54" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:25.613261  5049 leader_election.cc:343] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.613634  5157 raft_consensus.cc:2468] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:25.614722  5049 leader_election.cc:304] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.611286  5202 raft_consensus.cc:359] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.615895  5202 raft_consensus.cc:385] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.616209  5202 raft_consensus.cc:740] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.616950  5267 raft_consensus.cc:2804] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.617990  5202 consensus_queue.cc:260] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.618216  5267 raft_consensus.cc:493] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.619285  5267 raft_consensus.cc:3060] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.625120  4833 catalog_manager.cc:5697] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.632874  5301 raft_consensus.cc:515] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.634375  5012 raft_consensus.cc:3060] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.635716  5301 leader_election.cc:290] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:25.639309  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:25.639916  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:25.646579  5086 raft_consensus.cc:3060] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.647257  5267 raft_consensus.cc:515] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.647464  5202 ts_tablet_manager.cc:1434] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:17:25.654726  5206 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
W20260709 13:17:25.647886  4900 leader_election.cc:343] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.655128  5201 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.655233  5206 ts_tablet_manager.cc:1403] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.136s	user 0.023s	sys 0.007s
I20260709 13:17:25.655627  5201 ts_tablet_manager.cc:1403] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.000s
I20260709 13:17:25.656078  5276 consensus_queue.cc:1048] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.658146  5206 raft_consensus.cc:359] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.660312  5206 raft_consensus.cc:385] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.661209  5206 raft_consensus.cc:740] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.661772  5236 raft_consensus.cc:493] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.658488  5201 raft_consensus.cc:359] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.664759  5201 raft_consensus.cc:385] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.664863  5206 consensus_queue.cc:260] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.665210  5201 raft_consensus.cc:740] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.662712  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0db5a1497e4b73b5f7090a3e9bbf54" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:25.663904  5267 leader_election.cc:290] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:25.667464  5203 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.671710  5203 ts_tablet_manager.cc:1403] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.139s	user 0.025s	sys 0.012s
I20260709 13:17:25.676887  5202 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
W20260709 13:17:25.680868  5049 leader_election.cc:343] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.676684  5236 raft_consensus.cc:515] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.683046  5236 leader_election.cc:290] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.683754  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0db5a1497e4b73b5f7090a3e9bbf54" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:25.683223  5086 raft_consensus.cc:2468] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:25.683179  5203 raft_consensus.cc:359] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.686429  5201 consensus_queue.cc:260] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.691476  5203 raft_consensus.cc:385] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.685051  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.692008  5203 raft_consensus.cc:740] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.684448  5159 raft_consensus.cc:3060] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.692864  5203 consensus_queue.cc:260] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.695161  4900 leader_election.cc:304] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.696225  5203 ts_tablet_manager.cc:1434] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:17:25.696444  5301 raft_consensus.cc:2804] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.687736  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.696918  5301 raft_consensus.cc:697] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:25.697424  5302 raft_consensus.cc:493] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.697926  5302 raft_consensus.cc:515] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.697839  5301 consensus_queue.cc:237] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.701115  5302 leader_election.cc:290] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:25.701772  5123 leader_election.cc:343] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.702891  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.704746  5206 ts_tablet_manager.cc:1434] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.003s
I20260709 13:17:25.705330  5203 tablet_bootstrap.cc:492] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.705778  5206 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.706657  5202 tablet_bootstrap.cc:654] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.707887  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.708662  5086 raft_consensus.cc:2393] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate 7e2c2c6ff9224614b4b24e53c472d346 in this term.
I20260709 13:17:25.710705  4975 leader_election.cc:304] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:25.711912  5302 raft_consensus.cc:3060] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:25.712499  5124 leader_election.cc:343] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.713433  5159 raft_consensus.cc:2468] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:25.714104  5201 ts_tablet_manager.cc:1434] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.002s
I20260709 13:17:25.722667  5201 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.718516  5124 leader_election.cc:304] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:25.719125  5206 tablet_bootstrap.cc:654] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.719748  5302 raft_consensus.cc:2749] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.721324  5202 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.725728  5202 ts_tablet_manager.cc:1403] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.005s
I20260709 13:17:25.727594  5236 raft_consensus.cc:2749] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.727495  5203 tablet_bootstrap.cc:654] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.730485  5202 raft_consensus.cc:359] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.731813  5202 raft_consensus.cc:385] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.729077  5201 tablet_bootstrap.cc:654] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.732188  5202 raft_consensus.cc:740] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.731827  5049 leader_election.cc:304] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.733355  5202 consensus_queue.cc:260] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.734647  5267 raft_consensus.cc:2804] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:25.735133  5267 raft_consensus.cc:697] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:25.735183  5251 consensus_queue.cc:1048] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.736068  5267 consensus_queue.cc:237] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.737977  5202 ts_tablet_manager.cc:1434] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:25.739984  5202 tablet_bootstrap.cc:492] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.747493  5236 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.748133  5236 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.751322  5236 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.751780  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.753151  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:25.753264  5123 leader_election.cc:343] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:25.755594  5124 leader_election.cc:343] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.756052  5124 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:25.756762  5236 raft_consensus.cc:2749] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.758891  5206 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:25.759531  5206 ts_tablet_manager.cc:1403] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.003s
I20260709 13:17:25.764883  5201 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.764178  4832 catalog_manager.cc:5697] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.765358  5201 ts_tablet_manager.cc:1403] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.013s
I20260709 13:17:25.768242  5201 raft_consensus.cc:359] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.768868  5201 raft_consensus.cc:385] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.771096  5203 tablet_bootstrap.cc:492] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.771652  5203 ts_tablet_manager.cc:1403] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.014s
I20260709 13:17:25.774513  5203 raft_consensus.cc:359] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.775139  5203 raft_consensus.cc:385] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.775408  5203 raft_consensus.cc:740] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.776018  5201 raft_consensus.cc:740] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.776862  5201 consensus_queue.cc:260] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.777997  5302 consensus_queue.cc:1048] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.777849  5203 consensus_queue.cc:260] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.779448  4833 catalog_manager.cc:5697] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.779639  5206 raft_consensus.cc:359] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.781656  5206 raft_consensus.cc:385] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.781951  5206 raft_consensus.cc:740] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.782542  5203 ts_tablet_manager.cc:1434] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:25.783614  5203 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.784897  5202 tablet_bootstrap.cc:654] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.782581  5206 consensus_queue.cc:260] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.788489  5206 ts_tablet_manager.cc:1434] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:17:25.789779  5206 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.780025  5201 ts_tablet_manager.cc:1434] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:17:25.793141  5201 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.804059  5203 tablet_bootstrap.cc:654] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.809417  5201 tablet_bootstrap.cc:654] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.811237  5206 tablet_bootstrap.cc:654] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.816406  5203 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.816906  5203 ts_tablet_manager.cc:1403] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:17:25.819809  5203 raft_consensus.cc:359] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.820472  5203 raft_consensus.cc:385] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.820747  5203 raft_consensus.cc:740] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.821380  5203 consensus_queue.cc:260] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.822077  5202 tablet_bootstrap.cc:492] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.822597  5202 ts_tablet_manager.cc:1403] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.017s
I20260709 13:17:25.823601  5301 consensus_queue.cc:1048] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.825399  5202 raft_consensus.cc:359] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.826117  5202 raft_consensus.cc:385] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.826435  5202 raft_consensus.cc:740] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.827287  5202 consensus_queue.cc:260] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:25.831487  5301 consensus_queue.cc:1048] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.832243  5203 ts_tablet_manager.cc:1434] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:25.837999  5267 raft_consensus.cc:493] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.838465  5267 raft_consensus.cc:515] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.839620  5201 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.840184  5201 ts_tablet_manager.cc:1403] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 13:17:25.840517  5267 leader_election.cc:290] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.843716  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b74d3e9edb492b8818ba89bf9d7ff7" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.844393  4936 raft_consensus.cc:2468] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:25.845005  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b74d3e9edb492b8818ba89bf9d7ff7" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.843281  5201 raft_consensus.cc:359] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.845741  5201 raft_consensus.cc:385] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.846197  5201 raft_consensus.cc:740] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.845700  5159 raft_consensus.cc:2468] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:25.847469  5201 consensus_queue.cc:260] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.847792  5236 raft_consensus.cc:493] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.848385  5236 raft_consensus.cc:515] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.850392  5201 ts_tablet_manager.cc:1434] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:25.850438  5236 leader_election.cc:290] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.851578  5201 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.853135  5203 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.854368  5049 leader_election.cc:304] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.854907  5202 ts_tablet_manager.cc:1434] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:17:25.856351  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:25.856997  5084 raft_consensus.cc:2468] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:25.859656  5202 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:25.862170  5123 leader_election.cc:304] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:25.865698  5201 tablet_bootstrap.cc:654] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.868324  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.870361  5237 raft_consensus.cc:2804] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.870921  5237 raft_consensus.cc:493] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.871367  5237 raft_consensus.cc:3060] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:25.873149  5124 leader_election.cc:343] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.875936  5211 raft_consensus.cc:2804] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.876502  5211 raft_consensus.cc:493] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.876926  5211 raft_consensus.cc:3060] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.878232  5203 tablet_bootstrap.cc:654] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.895592  5202 tablet_bootstrap.cc:654] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:25.896528  5302 consensus_queue.cc:1048] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.897991  5302 consensus_queue.cc:1048] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.920717  5203 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:25.921358  5203 ts_tablet_manager.cc:1403] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.004s
I20260709 13:17:25.924837  5201 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:25.925467  5201 ts_tablet_manager.cc:1403] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.022s
I20260709 13:17:25.928797  5276 raft_consensus.cc:493] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.929368  5276 raft_consensus.cc:515] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.931353  5276 leader_election.cc:290] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:25.931430  5201 raft_consensus.cc:359] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.932338  5201 raft_consensus.cc:385] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.932653  5201 raft_consensus.cc:740] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.933329  5201 consensus_queue.cc:260] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.938724  5206 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:25.938656  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.939342  5206 ts_tablet_manager.cc:1403] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.015s
I20260709 13:17:25.939880  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:25.940263  4900 leader_election.cc:343] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.942088  5206 raft_consensus.cc:359] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.942808  5206 raft_consensus.cc:385] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.943032  5206 raft_consensus.cc:740] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.939095  5267 consensus_queue.cc:1048] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:25.943632  5206 consensus_queue.cc:260] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.947430  5203 raft_consensus.cc:359] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.948014  5203 raft_consensus.cc:385] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:25.948302  5203 raft_consensus.cc:740] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:25.946026  5266 raft_consensus.cc:493] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.949008  5203 consensus_queue.cc:260] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:25.942118  4900 leader_election.cc:343] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.950939  5206 ts_tablet_manager.cc:1434] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:17:25.952121  5201 ts_tablet_manager.cc:1434] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:17:25.949210  5266 raft_consensus.cc:515] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:25.953917  5203 ts_tablet_manager.cc:1434] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:17:25.952077  4900 leader_election.cc:304] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:25.955287  5301 raft_consensus.cc:2749] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.958118  5201 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:25.961707  5266 leader_election.cc:290] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.962435  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:25.962754  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.963871  5011 raft_consensus.cc:2468] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
W20260709 13:17:25.964057  5050 leader_election.cc:343] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.965339  5049 leader_election.cc:304] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:25.965909  5301 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.966404  5301 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.966777  5276 raft_consensus.cc:493] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.966425  5266 raft_consensus.cc:2804] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.967612  5266 raft_consensus.cc:493] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.967969  5266 raft_consensus.cc:3060] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.968438  5301 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:25.969324  5237 raft_consensus.cc:515] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:25.971498  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.967238  5276 raft_consensus.cc:515] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:25.972497  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:25.973975  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:25.974468  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:25.974552  5276 leader_election.cc:290] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
W20260709 13:17:25.974936  5124 leader_election.cc:343] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.974601  5160 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:25.975045  5086 raft_consensus.cc:3060] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:25.976742  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a7f2f432e4b6d83de031143ba6238" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:25.979521  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a7f2f432e4b6d83de031143ba6238" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:25.981019  4900 leader_election.cc:343] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:25.982549  4900 leader_election.cc:343] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.983285  4900 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.984098  5301 raft_consensus.cc:2804] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:25.984479  5301 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.985001  5301 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:25.984509  4900 leader_election.cc:343] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:25.986496  5206 tablet_bootstrap.cc:492] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:25.986352  4900 leader_election.cc:304] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:25.988924  5210 raft_consensus.cc:2749] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:25.975267  5276 consensus_queue.cc:1048] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:17:25.985961  5237 leader_election.cc:290] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:25.994719  5203 tablet_bootstrap.cc:492] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:25.996774  5202 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:25.997291  5202 ts_tablet_manager.cc:1403] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.138s	user 0.025s	sys 0.008s
I20260709 13:17:25.998577  5211 raft_consensus.cc:515] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.003319  5301 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.007339  5201 tablet_bootstrap.cc:654] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.007660  5086 raft_consensus.cc:2468] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:26.008489  5308 raft_consensus.cc:493] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.013703  5203 tablet_bootstrap.cc:654] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.015658  5211 leader_election.cc:290] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.041494  5211 consensus_queue.cc:1048] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.017036  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b74d3e9edb492b8818ba89bf9d7ff7" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:26.043375  4934 raft_consensus.cc:3060] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.044317  5206 tablet_bootstrap.cc:654] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:26.045836  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:26.018038  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b74d3e9edb492b8818ba89bf9d7ff7" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:26.048902  5160 raft_consensus.cc:3060] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.017266  5301 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:26.019060  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:26.019282  5308 raft_consensus.cc:515] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.055032  5308 leader_election.cc:290] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:26.021497  5123 leader_election.cc:304] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:26.057585  5236 raft_consensus.cc:2804] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.058043  5236 raft_consensus.cc:697] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:26.058836  5236 consensus_queue.cc:237] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.063611  4934 raft_consensus.cc:2468] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:26.063498  5276 consensus_queue.cc:1048] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.065165  5050 leader_election.cc:304] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
W20260709 13:17:26.065503  4900 leader_election.cc:343] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.066077  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.066359  5211 raft_consensus.cc:2804] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.067013  5211 raft_consensus.cc:697] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:26.068132  5211 consensus_queue.cc:237] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.069903  5267 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.017897  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:26.070392  5267 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.071069  5157 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.071168  5160 raft_consensus.cc:2468] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:26.072834  5267 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:26.074496  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:26.075963  5049 leader_election.cc:343] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.078689  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.067029  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:26.080503  5050 leader_election.cc:343] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.081106  5050 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:26.081557  4975 leader_election.cc:343] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.082221  5267 raft_consensus.cc:2749] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:26.086047  4976 leader_election.cc:343] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.086609  4976 leader_election.cc:304] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:26.087656  5302 raft_consensus.cc:2749] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.014139  5202 raft_consensus.cc:359] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.091554  5202 raft_consensus.cc:385] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.092875  5202 raft_consensus.cc:740] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.039907  5266 raft_consensus.cc:515] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.096582  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:26.096766  5157 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
W20260709 13:17:26.097915  5050 leader_election.cc:343] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.098505  4900 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:26.099668  5210 raft_consensus.cc:2804] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.100325  5210 raft_consensus.cc:697] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:26.101517  5210 consensus_queue.cc:237] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.102329  5206 tablet_bootstrap.cc:492] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:26.103953  5206 ts_tablet_manager.cc:1403] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.005s
I20260709 13:17:26.105930  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:26.106537  5012 raft_consensus.cc:3060] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.106767  5206 raft_consensus.cc:359] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.107470  5206 raft_consensus.cc:385] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.107723  5206 raft_consensus.cc:740] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.108419  5206 consensus_queue.cc:260] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.110430  5206 ts_tablet_manager.cc:1434] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:26.111433  5206 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:26.113835  5203 tablet_bootstrap.cc:492] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:26.114352  5203 ts_tablet_manager.cc:1403] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.002s
I20260709 13:17:26.115007  5012 raft_consensus.cc:2468] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:26.116407  5049 leader_election.cc:304] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:26.117357  5211 raft_consensus.cc:2804] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.117515  5203 raft_consensus.cc:359] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.117949  5211 raft_consensus.cc:697] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:26.118278  5203 raft_consensus.cc:385] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.118618  5203 raft_consensus.cc:740] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.118943  5211 consensus_queue.cc:237] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.119457  5203 consensus_queue.cc:260] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.121788  5203 ts_tablet_manager.cc:1434] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:26.122802  5203 tablet_bootstrap.cc:492] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:26.137758  5206 tablet_bootstrap.cc:654] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.137513  5267 consensus_queue.cc:1048] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.142163  5203 tablet_bootstrap.cc:654] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.143429  5266 leader_election.cc:290] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:26.098371  5202 consensus_queue.cc:260] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.144765  5236 raft_consensus.cc:493] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.145219  5236 raft_consensus.cc:515] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.146275  5202 ts_tablet_manager.cc:1434] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.149s	user 0.006s	sys 0.002s
I20260709 13:17:26.147347  5202 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:26.150884  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b3651a051845f49844d453fa92f074" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.151592  4934 raft_consensus.cc:2468] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:26.152927  5124 leader_election.cc:304] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:26.153821  5237 raft_consensus.cc:2804] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.154211  5237 raft_consensus.cc:493] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.154532  5237 raft_consensus.cc:3060] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:26.156795  5049 consensus_peers.cc:597] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.158032  5211 raft_consensus.cc:493] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.158983  5211 raft_consensus.cc:515] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.161913  5211 leader_election.cc:290] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.157346  5266 raft_consensus.cc:493] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.162245  5237 raft_consensus.cc:515] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.162731  5266 raft_consensus.cc:515] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.163866  5236 leader_election.cc:290] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:26.165453  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b3651a051845f49844d453fa92f074" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.166827  5266 leader_election.cc:290] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.167148  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:26.166829  5123 leader_election.cc:343] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:26.168850  5050 leader_election.cc:343] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.170217  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.171008  5159 raft_consensus.cc:2468] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:26.170274  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.171571  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.171962  5160 raft_consensus.cc:2468] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:26.175961  5203 tablet_bootstrap.cc:492] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
W20260709 13:17:26.176127  5049 leader_election.cc:343] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.176452  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b3651a051845f49844d453fa92f074" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:26.176816  5203 ts_tablet_manager.cc:1403] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:17:26.177039  4934 raft_consensus.cc:3060] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.177903  5049 leader_election.cc:304] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:26.178719  5211 raft_consensus.cc:2804] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.179071  5211 raft_consensus.cc:493] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.179399  5211 raft_consensus.cc:3060] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.181409  5203 raft_consensus.cc:359] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.182426  5203 raft_consensus.cc:385] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.182847  5203 raft_consensus.cc:740] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.183523  5210 consensus_queue.cc:1048] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.183998  4832 catalog_manager.cc:5697] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.185979  4832 catalog_manager.cc:5697] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.191581  5211 raft_consensus.cc:515] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.193081  4934 raft_consensus.cc:2468] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:26.193897  5211 leader_election.cc:290] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.194331  5124 leader_election.cc:304] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:26.194988  5049 leader_election.cc:304] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:26.195188  5236 raft_consensus.cc:2804] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.195571  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:26.184190  5203 consensus_queue.cc:260] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.196987  5266 raft_consensus.cc:2804] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.197400  5266 raft_consensus.cc:493] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.197710  5266 raft_consensus.cc:3060] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.197947  5203 ts_tablet_manager.cc:1434] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
W20260709 13:17:26.198035  5050 leader_election.cc:343] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.198923  5203 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:26.204857  5266 raft_consensus.cc:515] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.207085  5266 leader_election.cc:290] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.196959  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:26.208348  5160 raft_consensus.cc:3060] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.195874  5236 raft_consensus.cc:697] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:26.217095  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b3651a051845f49844d453fa92f074" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:26.217262  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:26.218493  5202 tablet_bootstrap.cc:654] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.219007  5237 leader_election.cc:290] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:26.220059  5203 tablet_bootstrap.cc:654] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.228091  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:26.229008  5157 raft_consensus.cc:3060] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:26.232823  5123 leader_election.cc:343] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.234347  5301 consensus_queue.cc:1048] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.245882  5236 consensus_queue.cc:237] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:26.249490  5049 leader_election.cc:343] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.251513  5201 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:26.254251  5201 ts_tablet_manager.cc:1403] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.300s	user 0.079s	sys 0.106s
I20260709 13:17:26.249766  4833 catalog_manager.cc:5697] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.250938  5160 raft_consensus.cc:2468] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:26.258280  5049 leader_election.cc:304] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:26.262841  5157 raft_consensus.cc:2468] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:26.263341  5201 raft_consensus.cc:359] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.265507  5206 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:26.264097  5267 raft_consensus.cc:493] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.266435  5201 raft_consensus.cc:385] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.264099  5359 raft_consensus.cc:2804] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.266921  5206 ts_tablet_manager.cc:1403] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.156s	user 0.024s	sys 0.016s
I20260709 13:17:26.267331  5201 raft_consensus.cc:740] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.268610  5201 consensus_queue.cc:260] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.267508  5267 raft_consensus.cc:515] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.268795  5359 raft_consensus.cc:697] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:26.273233  5359 consensus_queue.cc:237] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.273960  5203 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:26.274638  5203 ts_tablet_manager.cc:1403] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 13:17:26.276942  5267 leader_election.cc:290] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.278369  5049 leader_election.cc:304] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:26.279342  5267 raft_consensus.cc:2804] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.279870  5267 raft_consensus.cc:697] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:26.280892  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2ed27eb764c4c8a356d249940b43a" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.280758  5267 consensus_queue.cc:237] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.283493  5206 raft_consensus.cc:359] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.285179  5206 raft_consensus.cc:385] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.285526  5206 raft_consensus.cc:740] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
W20260709 13:17:26.283674  5049 leader_election.cc:343] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.286650  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2ed27eb764c4c8a356d249940b43a" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.283866  5203 raft_consensus.cc:359] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.286167  5206 consensus_queue.cc:260] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.288300  5203 raft_consensus.cc:385] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.288630  5203 raft_consensus.cc:740] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.290024  5203 consensus_queue.cc:260] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.291626  5201 ts_tablet_manager.cc:1434] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:17:26.292980  5201 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:26.299523  5206 ts_tablet_manager.cc:1434] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:17:26.300212  5203 ts_tablet_manager.cc:1434] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:17:26.303397  5206 tablet_bootstrap.cc:492] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:26.304571  5203 tablet_bootstrap.cc:492] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
W20260709 13:17:26.296730  5049 leader_election.cc:343] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.308419  5049 leader_election.cc:304] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:26.310039  5211 raft_consensus.cc:2749] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.298482  5267 raft_consensus.cc:493] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.310951  5267 raft_consensus.cc:515] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.312493  5206 tablet_bootstrap.cc:654] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.313545  5202 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:26.314075  5202 ts_tablet_manager.cc:1403] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.004s
I20260709 13:17:26.318848  5203 tablet_bootstrap.cc:654] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.323067  5202 raft_consensus.cc:359] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.324169  5202 raft_consensus.cc:385] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.324615  5202 raft_consensus.cc:740] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.325997  5201 tablet_bootstrap.cc:654] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.325659  5202 consensus_queue.cc:260] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.331239  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:26.333366  5049 leader_election.cc:343] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.334707  5202 ts_tablet_manager.cc:1434] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:17:26.335718  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.337117  5202 tablet_bootstrap.cc:492] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:26.333501  5267 leader_election.cc:290] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:26.341125  5050 leader_election.cc:343] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.341773  5050 leader_election.cc:304] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:26.349614  5202 tablet_bootstrap.cc:654] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.358342  5212 raft_consensus.cc:493] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.358948  5212 raft_consensus.cc:515] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.361290  5212 leader_election.cc:290] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.363695  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56ea8740b747e0b6ee12d6e2333b6b" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.363809  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56ea8740b747e0b6ee12d6e2333b6b" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.364831  5086 raft_consensus.cc:2468] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
W20260709 13:17:26.365469  4975 leader_election.cc:343] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.370304  4835 catalog_manager.cc:5697] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.372431  4835 catalog_manager.cc:5697] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.367942  5267 raft_consensus.cc:2749] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.375914  4975 leader_election.cc:304] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:26.380205  5201 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:26.380793  5308 raft_consensus.cc:2804] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.380932  5201 ts_tablet_manager.cc:1403] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.088s	user 0.026s	sys 0.002s
I20260709 13:17:26.381347  5308 raft_consensus.cc:493] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.382094  5308 raft_consensus.cc:3060] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.385370  5201 raft_consensus.cc:359] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.386436  5201 raft_consensus.cc:385] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.386788  5201 raft_consensus.cc:740] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
W20260709 13:17:26.395886  5050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:36057, user_credentials={real_user=slave}} blocked reactor thread for 54808.4us
I20260709 13:17:26.396893  4834 catalog_manager.cc:5697] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.390812  5201 consensus_queue.cc:260] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.402659  5201 ts_tablet_manager.cc:1434] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:17:26.404021  5201 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:26.406831  5236 raft_consensus.cc:493] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.407397  5236 raft_consensus.cc:515] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.411979  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:26.413697  5123 leader_election.cc:343] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.416627  5236 leader_election.cc:290] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.424078  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.427495  5203 tablet_bootstrap.cc:492] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:26.428074  5203 ts_tablet_manager.cc:1403] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.004s
W20260709 13:17:26.428957  5124 leader_election.cc:343] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.429644  5124 leader_election.cc:304] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:26.431155  5236 raft_consensus.cc:2749] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.425060  5201 tablet_bootstrap.cc:654] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.432477  5308 raft_consensus.cc:515] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.435628  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56ea8740b747e0b6ee12d6e2333b6b" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:26.436317  5085 raft_consensus.cc:3060] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.442919  5201 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:26.443591  5201 ts_tablet_manager.cc:1403] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.008s
I20260709 13:17:26.444881  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56ea8740b747e0b6ee12d6e2333b6b" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
W20260709 13:17:26.446416  4975 leader_election.cc:343] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.447013  5308 leader_election.cc:290] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.431190  5203 raft_consensus.cc:359] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.448465  5203 raft_consensus.cc:385] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.447228  5201 raft_consensus.cc:359] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.452322  5201 raft_consensus.cc:385] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.452574  5201 raft_consensus.cc:740] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.453116  5201 consensus_queue.cc:260] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.454663  5202 tablet_bootstrap.cc:492] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:26.455101  5201 ts_tablet_manager.cc:1434] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:17:26.455137  5202 ts_tablet_manager.cc:1403] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.021s
I20260709 13:17:26.456780  5206 tablet_bootstrap.cc:492] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:26.457239  5206 ts_tablet_manager.cc:1403] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.154s	user 0.045s	sys 0.075s
I20260709 13:17:26.458165  5202 raft_consensus.cc:359] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.458842  5202 raft_consensus.cc:385] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.459096  5202 raft_consensus.cc:740] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.459946  5206 raft_consensus.cc:359] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.459887  5202 consensus_queue.cc:260] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.460634  5206 raft_consensus.cc:385] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.460942  5206 raft_consensus.cc:740] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.461578  5206 consensus_queue.cc:260] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.462317  5202 ts_tablet_manager.cc:1434] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:26.463315  5202 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:26.463503  5206 ts_tablet_manager.cc:1434] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:26.464493  5201 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:26.469054  5202 tablet_bootstrap.cc:654] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.470806  5201 tablet_bootstrap.cc:654] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.448787  5203 raft_consensus.cc:740] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.473358  5203 consensus_queue.cc:260] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.475458  5085 raft_consensus.cc:2468] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:26.477219  4975 leader_election.cc:304] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:26.479586  5203 ts_tablet_manager.cc:1434] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:17:26.481003  5203 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:26.483160  5212 raft_consensus.cc:2804] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:26.483719  5212 raft_consensus.cc:697] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:26.484642  5212 consensus_queue.cc:237] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.481405  4832 catalog_manager.cc:5697] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.491102  5206 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:26.494635  5236 consensus_queue.cc:1048] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.497915  5206 tablet_bootstrap.cc:654] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.501345  5203 tablet_bootstrap.cc:654] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.514472  5203 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:26.515010  5203 ts_tablet_manager.cc:1403] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 13:17:26.518163  5203 raft_consensus.cc:359] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.526809  5203 raft_consensus.cc:385] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.527108  5203 raft_consensus.cc:740] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.527667  4934 raft_consensus.cc:3060] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.527911  5203 consensus_queue.cc:260] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.522195  5206 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:26.529636  5206 ts_tablet_manager.cc:1403] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 13:17:26.532712  5206 raft_consensus.cc:359] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.533357  5206 raft_consensus.cc:385] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.533618  5206 raft_consensus.cc:740] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.535393  5202 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:26.535883  5202 ts_tablet_manager.cc:1403] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.018s
I20260709 13:17:26.535913  5201 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:26.536454  5201 ts_tablet_manager.cc:1403] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.010s
I20260709 13:17:26.536384  5206 consensus_queue.cc:260] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.538532  5206 ts_tablet_manager.cc:1434] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:26.539535  5206 tablet_bootstrap.cc:492] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:26.541392  5201 raft_consensus.cc:359] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.542032  5201 raft_consensus.cc:385] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.542336  5201 raft_consensus.cc:740] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.545498  5202 raft_consensus.cc:359] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.546160  5202 raft_consensus.cc:385] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.546435  5202 raft_consensus.cc:740] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.547151  5201 consensus_queue.cc:260] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.549654  5270 consensus_queue.cc:1048] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.549937  5202 consensus_queue.cc:260] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.549693  5201 ts_tablet_manager.cc:1434] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:26.551883  5201 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:26.552511  5359 consensus_queue.cc:1048] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.563344  5202 ts_tablet_manager.cc:1434] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:17:26.563643  5203 ts_tablet_manager.cc:1434] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
W20260709 13:17:26.563845  5050 consensus_peers.cc:597] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.564589  5202 tablet_bootstrap.cc:492] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:26.564225  4835 catalog_manager.cc:5697] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.564664  5203 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:26.572413  5201 tablet_bootstrap.cc:654] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.575492  5202 tablet_bootstrap.cc:654] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.579955  5206 tablet_bootstrap.cc:654] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.583487  5202 tablet_bootstrap.cc:492] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:26.583870  5203 tablet_bootstrap.cc:654] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.588042  5202 ts_tablet_manager.cc:1403] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 13:17:26.588169  5238 consensus_queue.cc:1048] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.594494  5201 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:26.595165  5201 ts_tablet_manager.cc:1403] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.007s
I20260709 13:17:26.595221  5212 raft_consensus.cc:493] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.595929  5212 raft_consensus.cc:515] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.591281  5202 raft_consensus.cc:359] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.599917  5202 raft_consensus.cc:385] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.600317  5202 raft_consensus.cc:740] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.601574  5202 consensus_queue.cc:260] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.610782  5202 ts_tablet_manager.cc:1434] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:17:26.616683  5201 raft_consensus.cc:359] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.617353  5201 raft_consensus.cc:385] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.617698  5201 raft_consensus.cc:740] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.619028  5201 consensus_queue.cc:260] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.621670  5201 ts_tablet_manager.cc:1434] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 13:17:26.622756  5201 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:26.623111  5276 consensus_queue.cc:1048] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.624328  5202 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:26.625083  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.629446  5238 consensus_queue.cc:1048] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.631788  5203 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:26.638665  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.643599  5159 raft_consensus.cc:2393] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:26.645479  5203 ts_tablet_manager.cc:1403] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.011s
I20260709 13:17:26.646140  4975 leader_election.cc:304] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:26.647698  5308 raft_consensus.cc:3060] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.650673  5010 raft_consensus.cc:3060] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.654248  5301 raft_consensus.cc:493] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.654507  5012 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.654891  5301 raft_consensus.cc:515] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.656219  5308 raft_consensus.cc:2749] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.639293  5212 leader_election.cc:290] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.662539  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.662600  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.669932  5206 tablet_bootstrap.cc:492] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:26.670523  5206 ts_tablet_manager.cc:1403] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.007s
I20260709 13:17:26.670797  5159 raft_consensus.cc:2393] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e2c2c6ff9224614b4b24e53c472d346 in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:26.673468  4900 leader_election.cc:304] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:26.674341  5206 raft_consensus.cc:359] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.676667  5206 raft_consensus.cc:385] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.677117  5206 raft_consensus.cc:740] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.678856  5206 consensus_queue.cc:260] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.681806  5206 ts_tablet_manager.cc:1434] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:17:26.683075  5206 tablet_bootstrap.cc:492] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:26.684520  5276 raft_consensus.cc:3060] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.658917  5301 leader_election.cc:290] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.692320  5359 raft_consensus.cc:493] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.692936  5359 raft_consensus.cc:515] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.695214  5359 leader_election.cc:290] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:26.696760  5206 tablet_bootstrap.cc:654] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.697315  5203 raft_consensus.cc:359] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.698051  5203 raft_consensus.cc:385] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.698468  5203 raft_consensus.cc:740] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.698611  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.699229  5203 consensus_queue.cc:260] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
W20260709 13:17:26.700387  5050 leader_election.cc:343] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.698984  5201 tablet_bootstrap.cc:654] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.701680  5203 ts_tablet_manager.cc:1434] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:17:26.702852  5203 tablet_bootstrap.cc:492] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:26.704463  5308 raft_consensus.cc:493] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.705057  5308 raft_consensus.cc:515] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.711222  5202 tablet_bootstrap.cc:654] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.720654  5308 leader_election.cc:290] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.725209  5301 consensus_queue.cc:1048] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.725800  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0db5a1497e4b73b5f7090a3e9bbf54" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:26.727304  5203 tablet_bootstrap.cc:654] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.733850  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0db5a1497e4b73b5f7090a3e9bbf54" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.733965  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.731549  5276 raft_consensus.cc:2749] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.740386  5270 raft_consensus.cc:493] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.739655  5206 tablet_bootstrap.cc:492] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:26.743489  5270 raft_consensus.cc:515] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.744561  5206 ts_tablet_manager.cc:1403] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.012s
I20260709 13:17:26.746721  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.747282  5270 leader_election.cc:290] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:26.741115  5201 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:26.747913  5206 raft_consensus.cc:359] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.748840  5201 ts_tablet_manager.cc:1403] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.009s
W20260709 13:17:26.748258  5123 leader_election.cc:343] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.749010  5206 raft_consensus.cc:385] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.749498  5206 raft_consensus.cc:740] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.749948  5237 consensus_queue.cc:1048] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.750228  5206 consensus_queue.cc:260] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.751698  5201 raft_consensus.cc:359] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.752430  5201 raft_consensus.cc:385] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.743083  5202 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:26.752537  5206 ts_tablet_manager.cc:1434] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:26.753039  5202 ts_tablet_manager.cc:1403] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.006s
I20260709 13:17:26.753594  5201 raft_consensus.cc:740] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.756078  5206 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:26.756628  5201 consensus_queue.cc:260] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:26.758312  4975 leader_election.cc:304] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:26.759902  5308 raft_consensus.cc:2749] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:26.764168  5049 leader_election.cc:343] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.772341  5202 raft_consensus.cc:359] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.773229  5201 ts_tablet_manager.cc:1434] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
I20260709 13:17:26.773370  5202 raft_consensus.cc:385] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.773823  5202 raft_consensus.cc:740] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.774363  5201 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:26.765830  5049 leader_election.cc:304] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:26.778360  5238 raft_consensus.cc:2749] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.774617  5202 consensus_queue.cc:260] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.780982  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.787200  5266 raft_consensus.cc:493] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.787740  5266 raft_consensus.cc:515] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.789647  5266 leader_election.cc:290] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.795008  5266 consensus_queue.cc:1048] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:26.796954  5201 tablet_bootstrap.cc:654] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.809877  5202 ts_tablet_manager.cc:1434] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:17:26.813515  5206 tablet_bootstrap.cc:654] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:26.816399  5123 leader_election.cc:343] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.817198  5123 leader_election.cc:304] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:26.800762  5266 consensus_queue.cc:1048] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:17:26.821529  5203 tablet_bootstrap.cc:492] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:26.820173  5270 raft_consensus.cc:2749] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:26.822340  5203 ts_tablet_manager.cc:1403] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.120s	user 0.023s	sys 0.006s
I20260709 13:17:26.824892  5237 raft_consensus.cc:493] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.825460  5237 raft_consensus.cc:515] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.826126  5301 raft_consensus.cc:493] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.826577  5301 raft_consensus.cc:515] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.827620  5202 tablet_bootstrap.cc:492] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:26.830549  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb728a4f28ed48c082e7f2d65155bd4c" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.835421  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd62f735924d4523b0a0b4061cb40814" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.836098  5008 raft_consensus.cc:2468] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:26.837195  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd62f735924d4523b0a0b4061cb40814" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:26.850900  4900 leader_election.cc:343] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.851656  5301 leader_election.cc:290] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:26.853873  5237 leader_election.cc:290] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.855473  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.856200  4934 raft_consensus.cc:2468] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:26.857424  5124 leader_election.cc:304] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:26.867336  5202 tablet_bootstrap.cc:654] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:26.867491  5270 raft_consensus.cc:2804] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.868108  5270 raft_consensus.cc:493] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.868515  5270 raft_consensus.cc:3060] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.890908  5267 raft_consensus.cc:493] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.891637  5267 raft_consensus.cc:515] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.895944  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.896803  4935 raft_consensus.cc:2468] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:26.898379  5050 leader_election.cc:304] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:26.899539  5238 raft_consensus.cc:2804] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.900054  5238 raft_consensus.cc:493] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.900497  5238 raft_consensus.cc:3060] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.903924  5267 leader_election.cc:290] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.905038  5236 raft_consensus.cc:493] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.905716  5236 raft_consensus.cc:515] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.908550  5236 leader_election.cc:290] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.909147  5236 raft_consensus.cc:493] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.909694  5236 raft_consensus.cc:515] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.913618  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb728a4f28ed48c082e7f2d65155bd4c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:26.914538  4935 raft_consensus.cc:2468] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:26.917511  5124 leader_election.cc:304] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
W20260709 13:17:26.924105  4975 consensus_peers.cc:597] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Couldn't send request to peer 546aee349d8547699b9d86b3640f5aae. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:26.926803  5237 raft_consensus.cc:2804] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.927363  5237 raft_consensus.cc:493] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.927819  5237 raft_consensus.cc:3060] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:26.886049  5049 leader_election.cc:343] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:26.934262  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 48283.6us
I20260709 13:17:26.935531  5049 leader_election.cc:304] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:26.936573  5359 consensus_queue.cc:1048] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:26.938288  5359 raft_consensus.cc:2804] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:26.938721  5359 raft_consensus.cc:493] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.939141  5359 raft_consensus.cc:3060] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:26.945580  5301 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.875219  5203 raft_consensus.cc:359] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.952316  5203 raft_consensus.cc:385] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:26.953646  5301 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.945571  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.958578  5210 raft_consensus.cc:493] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.958874  5301 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:26.959270  5210 raft_consensus.cc:515] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:26.961757  5210 leader_election.cc:290] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:26.964435  5236 leader_election.cc:290] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:26.967940  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795eacb4ba194dc8a9811b3471aae575" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:26.970009  4900 leader_election.cc:343] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:26.971840  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:26.972640  5086 raft_consensus.cc:2468] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:26.952692  5203 raft_consensus.cc:740] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:26.982980  5203 consensus_queue.cc:260] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:26.991504  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:26.994014  5270 raft_consensus.cc:515] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:26.979950  5236 consensus_queue.cc:1048] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:17:27.000208  5266 consensus_queue.cc:1048] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.001199  5270 leader_election.cc:290] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:26.985265  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795eacb4ba194dc8a9811b3471aae575" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.006198  5201 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:27.006630  5201 ts_tablet_manager.cc:1403] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.232s	user 0.011s	sys 0.014s
I20260709 13:17:26.988742  4900 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:27.009361  5203 ts_tablet_manager.cc:1434] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.185s	user 0.008s	sys 0.000s
I20260709 13:17:27.015332  5203 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.013231  5301 raft_consensus.cc:2804] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.031684  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:27.032567  4936 raft_consensus.cc:3060] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.025815  5301 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.016963  5238 raft_consensus.cc:515] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
W20260709 13:17:27.029304  4900 leader_election.cc:343] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.038125  5301 raft_consensus.cc:3060] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.062546  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.063841  5085 raft_consensus.cc:2393] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:27.054571  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:27.073506  5159 raft_consensus.cc:2393] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c70fac7b468a4fa59ccb26ef6e6220f6 in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:27.078272  5276 raft_consensus.cc:493] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.078998  5276 raft_consensus.cc:515] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.081506  5276 leader_election.cc:290] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:27.085307  5203 tablet_bootstrap.cc:654] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.088007  5206 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.147385  5206 ts_tablet_manager.cc:1403] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.392s	user 0.016s	sys 0.010s
I20260709 13:17:27.088479  5201 raft_consensus.cc:359] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.151302  5201 raft_consensus.cc:385] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.151609  5201 raft_consensus.cc:740] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.152351  5201 consensus_queue.cc:260] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.154383  5414 raft_consensus.cc:493] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.093971  4936 raft_consensus.cc:2468] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:27.154917  5414 raft_consensus.cc:515] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.155416  4935 raft_consensus.cc:3060] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.150393  5206 raft_consensus.cc:359] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.156276  5206 raft_consensus.cc:385] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:17:27.095618  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 67889.4us
I20260709 13:17:27.156587  5206 raft_consensus.cc:740] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.157217  5414 leader_election.cc:290] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
W20260709 13:17:27.157311  4900 leader_election.cc:343] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.157507  5206 consensus_queue.cc:260] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.157920  4900 leader_election.cc:304] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:27.098603  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:27.159734  5206 ts_tablet_manager.cc:1434] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:17:27.160228  4934 raft_consensus.cc:2393] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c70fac7b468a4fa59ccb26ef6e6220f6 in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:27.160780  5206 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.161501  5210 raft_consensus.cc:2749] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.099159  5238 leader_election.cc:290] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:27.100993  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb728a4f28ed48c082e7f2d65155bd4c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.166813  5206 tablet_bootstrap.cc:654] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.166986  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:27.104156  5011 raft_consensus.cc:3060] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.110419  5301 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.169621  5301 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:27.111743  5404 log.cc:927] Time spent T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:27.170564  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:27.114459  5359 raft_consensus.cc:515] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.171283  5160 raft_consensus.cc:2468] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:27.171648  5124 leader_election.cc:304] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:27.172807  5359 leader_election.cc:290] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:27.173348  5413 raft_consensus.cc:2804] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.173934  5413 raft_consensus.cc:697] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:27.174791  5413 consensus_queue.cc:237] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.117776  5202 tablet_bootstrap.cc:492] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.176311  5203 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.176427  5202 ts_tablet_manager.cc:1403] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.361s	user 0.016s	sys 0.009s
I20260709 13:17:27.176870  5203 ts_tablet_manager.cc:1403] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.000s
I20260709 13:17:27.123608  5212 consensus_queue.cc:1048] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:27.154395  5201 ts_tablet_manager.cc:1434] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.147s	user 0.002s	sys 0.005s
I20260709 13:17:27.180109  5203 raft_consensus.cc:359] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.180795  5203 raft_consensus.cc:385] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.181066  5203 raft_consensus.cc:740] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.182024  5201 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:27.128324  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb728a4f28ed48c082e7f2d65155bd4c" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:27.130334  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:27.171217  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:27.132887  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:27.136304  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5844863880a54fe9a4194162d5c8f72c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:27.185972  5083 raft_consensus.cc:2393] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
W20260709 13:17:27.145169  5123 leader_election.cc:343] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:27.188349  5123 leader_election.cc:343] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.095111  5237 raft_consensus.cc:515] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.196535  5237 leader_election.cc:290] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:27.198222  5159 raft_consensus.cc:2393] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e2c2c6ff9224614b4b24e53c472d346 in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:27.199117  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb728a4f28ed48c082e7f2d65155bd4c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:27.199777  4934 raft_consensus.cc:3060] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.199785  5201 tablet_bootstrap.cc:654] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.201980  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd62f735924d4523b0a0b4061cb40814" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:27.202558  5010 raft_consensus.cc:3060] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.210726  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:27.179283  5202 raft_consensus.cc:359] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.214625  5202 raft_consensus.cc:385] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.215021  5202 raft_consensus.cc:740] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.216353  5202 consensus_queue.cc:260] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.227360  5212 raft_consensus.cc:493] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.228130  5212 raft_consensus.cc:515] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.191103  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:27.181998  5203 consensus_queue.cc:260] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.235169  5203 ts_tablet_manager.cc:1434] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
W20260709 13:17:27.176064  4900 leader_election.cc:343] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:27.236414  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 60378.6us
I20260709 13:17:27.239097  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:27.239887  5083 raft_consensus.cc:3060] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.255447  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:27.260898  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd62f735924d4523b0a0b4061cb40814" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:27.262645  5202 ts_tablet_manager.cc:1434] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 13:17:27.262755  5203 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.264817  4900 leader_election.cc:304] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
W20260709 13:17:27.272807  4900 leader_election.cc:343] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.273932  5212 leader_election.cc:290] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:27.276656  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795eacb4ba194dc8a9811b3471aae575" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:27.277464  4936 raft_consensus.cc:2468] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:27.264791  4934 raft_consensus.cc:2468] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:27.278784  5083 raft_consensus.cc:2468] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:27.279021  5276 raft_consensus.cc:2749] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.279385  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb728a4f28ed48c082e7f2d65155bd4c" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:27.278988  4976 leader_election.cc:304] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:27.280032  5085 raft_consensus.cc:3060] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.281247  5124 leader_election.cc:304] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:27.282102  5236 raft_consensus.cc:2804] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.282694  5236 raft_consensus.cc:697] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:27.283742  5236 consensus_queue.cc:237] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.285742  4900 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:27.286859  5276 raft_consensus.cc:2804] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.287281  5085 raft_consensus.cc:2468] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:27.287426  5276 raft_consensus.cc:697] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:27.288587  5276 consensus_queue.cc:237] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.290071  5416 raft_consensus.cc:2804] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.290598  5416 raft_consensus.cc:493] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.290940  5416 raft_consensus.cc:3060] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:27.294070  4900 leader_election.cc:343] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.295568  4900 leader_election.cc:304] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:27.297744  5301 raft_consensus.cc:2749] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.297912  5416 raft_consensus.cc:515] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.300683  5416 leader_election.cc:290] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:27.300957  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795eacb4ba194dc8a9811b3471aae575" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:27.301529  4934 raft_consensus.cc:3060] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.304821  5202 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
W20260709 13:17:27.307983  5123 leader_election.cc:343] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.308495  5123 leader_election.cc:304] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:27.309412  5411 raft_consensus.cc:2749] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.309991  4934 raft_consensus.cc:2468] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:27.311333  4976 leader_election.cc:304] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:27.312608  5212 raft_consensus.cc:2804] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.313271  5212 raft_consensus.cc:697] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:27.314266  5203 tablet_bootstrap.cc:654] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.314105  5212 consensus_queue.cc:237] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.289994  5049 leader_election.cc:304] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:27.319911  5414 raft_consensus.cc:2804] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.319954  5049 leader_election.cc:304] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:27.320690  5414 raft_consensus.cc:493] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.321381  5206 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.322008  5206 ts_tablet_manager.cc:1403] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.161s	user 0.006s	sys 0.003s
I20260709 13:17:27.325063  5415 raft_consensus.cc:2749] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:17:27.326275  5049 leader_election.cc:343] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.326826  5201 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:27.327066  5202 tablet_bootstrap.cc:654] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.321331  5414 raft_consensus.cc:3060] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.327292  5201 ts_tablet_manager.cc:1403] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.145s	user 0.025s	sys 0.020s
I20260709 13:17:27.328104  5010 raft_consensus.cc:2468] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
W20260709 13:17:27.339273  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 45229.2us
W20260709 13:17:27.341971  5049 leader_election.cc:343] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.343240  5049 leader_election.cc:304] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:27.347359  5206 raft_consensus.cc:359] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.347534  5201 raft_consensus.cc:359] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.348152  5206 raft_consensus.cc:385] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.348381  5201 raft_consensus.cc:385] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.348815  5201 raft_consensus.cc:740] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.349509  5201 consensus_queue.cc:260] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.351388  5415 raft_consensus.cc:2804] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.351914  5415 raft_consensus.cc:697] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:27.352742  5415 consensus_queue.cc:237] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.348482  5206 raft_consensus.cc:740] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.355201  5203 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.351699  5201 ts_tablet_manager.cc:1434] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:17:27.358134  5201 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:27.357818  5206 consensus_queue.cc:260] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.359431  5206 ts_tablet_manager.cc:1434] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:17:27.360492  5206 tablet_bootstrap.cc:492] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.355674  5203 ts_tablet_manager.cc:1403] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.000s
I20260709 13:17:27.362646  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795eacb4ba194dc8a9811b3471aae575" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.364918  5203 raft_consensus.cc:359] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.366372  5203 raft_consensus.cc:385] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.366698  5203 raft_consensus.cc:740] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.367697  5203 consensus_queue.cc:260] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.369799  5203 ts_tablet_manager.cc:1434] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:17:27.370643  5203 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.380920  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795eacb4ba194dc8a9811b3471aae575" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:27.381587  5085 raft_consensus.cc:3060] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:27.383085  4975 leader_election.cc:343] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.385143  5202 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.385658  5202 ts_tablet_manager.cc:1403] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.081s	user 0.003s	sys 0.013s
I20260709 13:17:27.372534  5414 raft_consensus.cc:515] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.389672  5202 raft_consensus.cc:359] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.391098  5202 raft_consensus.cc:385] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.391377  5202 raft_consensus.cc:740] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.393455  5206 tablet_bootstrap.cc:654] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.393134  5202 consensus_queue.cc:260] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.395154  5414 leader_election.cc:290] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:27.395812  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:27.397444  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:27.399605  5159 raft_consensus.cc:3060] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.398981  5203 tablet_bootstrap.cc:654] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.402887  5085 raft_consensus.cc:2468] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
W20260709 13:17:27.407282  5049 leader_election.cc:343] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.409976  5159 raft_consensus.cc:2468] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:27.412242  5201 tablet_bootstrap.cc:654] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.413261  4834 catalog_manager.cc:5697] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.415050  5049 leader_election.cc:304] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:27.415967  4833 catalog_manager.cc:5697] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.419320  5236 raft_consensus.cc:493] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.419979  5414 raft_consensus.cc:2804] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.420032  5236 raft_consensus.cc:515] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.420969  5414 raft_consensus.cc:697] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:27.413895  5202 ts_tablet_manager.cc:1434] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:17:27.422400  5202 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:27.422485  5236 leader_election.cc:290] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:27.422144  5414 consensus_queue.cc:237] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.424162  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:27.425575  5124 leader_election.cc:343] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.427287  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:27.429006  5123 leader_election.cc:343] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.429311  5202 tablet_bootstrap.cc:654] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.429490  5123 leader_election.cc:304] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:27.430930  5236 raft_consensus.cc:2749] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.439023  5203 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.439411  5201 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:27.439724  5203 ts_tablet_manager.cc:1403] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.010s
I20260709 13:17:27.440081  5201 ts_tablet_manager.cc:1403] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.002s
I20260709 13:17:27.442765  5203 raft_consensus.cc:359] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.443488  5203 raft_consensus.cc:385] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.443735  5203 raft_consensus.cc:740] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.443928  5201 raft_consensus.cc:359] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.445930  5201 raft_consensus.cc:385] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.446332  5201 raft_consensus.cc:740] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.448051  5201 consensus_queue.cc:260] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.449569  5203 consensus_queue.cc:260] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.451279  5201 ts_tablet_manager.cc:1434] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:27.452571  5201 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:27.453073  5203 ts_tablet_manager.cc:1434] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:17:27.454025  5203 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.459605  5201 tablet_bootstrap.cc:654] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.459548  5202 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.460311  5202 ts_tablet_manager.cc:1403] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.003s
I20260709 13:17:27.461768  5206 tablet_bootstrap.cc:492] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.462065  5203 tablet_bootstrap.cc:654] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.462251  5206 ts_tablet_manager.cc:1403] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.008s
I20260709 13:17:27.462117  5236 raft_consensus.cc:493] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.462960  5236 raft_consensus.cc:515] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.466760  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56ea8740b747e0b6ee12d6e2333b6b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:27.469677  5236 leader_election.cc:290] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:27.471568  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56ea8740b747e0b6ee12d6e2333b6b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.473914  5123 leader_election.cc:304] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:27.475030  5411 raft_consensus.cc:2749] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.482146  5202 raft_consensus.cc:359] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.482815  5201 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:27.483086  5202 raft_consensus.cc:385] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.483417  5201 ts_tablet_manager.cc:1403] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
I20260709 13:17:27.483528  5202 raft_consensus.cc:740] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.486155  5202 consensus_queue.cc:260] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.488301  5202 ts_tablet_manager.cc:1434] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 13:17:27.489091  5202 tablet_bootstrap.cc:492] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:27.494794  5202 tablet_bootstrap.cc:654] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.495796  5206 raft_consensus.cc:359] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.486129  5201 raft_consensus.cc:359] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.497788  5201 raft_consensus.cc:385] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.498139  5201 raft_consensus.cc:740] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.498845  5201 consensus_queue.cc:260] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.497571  5206 raft_consensus.cc:385] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.499709  5206 raft_consensus.cc:740] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.500792  5201 ts_tablet_manager.cc:1434] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:17:27.500640  5206 consensus_queue.cc:260] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.501701  5201 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:27.503372  5206 ts_tablet_manager.cc:1434] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:17:27.507818  5159 raft_consensus.cc:3060] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.509843  5201 tablet_bootstrap.cc:654] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.510746  5301 raft_consensus.cc:493] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.511255  5301 raft_consensus.cc:515] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.511646  4835 catalog_manager.cc:5697] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.513434  5301 leader_election.cc:290] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:27.511221  5203 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.515466  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.516291  5203 ts_tablet_manager.cc:1403] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.024s
I20260709 13:17:27.516594  5085 raft_consensus.cc:2468] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:27.517917  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:27.518743  5010 raft_consensus.cc:2468] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:27.519423  5203 raft_consensus.cc:359] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.520437  5203 raft_consensus.cc:385] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.520733  5203 raft_consensus.cc:740] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.520535  4900 leader_election.cc:304] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:27.522466  5301 raft_consensus.cc:2804] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.522858  5301 raft_consensus.cc:493] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.523262  5301 raft_consensus.cc:3060] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.532358  5206 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.533808  5301 raft_consensus.cc:515] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.536755  5203 consensus_queue.cc:260] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.539129  5203 ts_tablet_manager.cc:1434] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:27.540220  5203 tablet_bootstrap.cc:492] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.546285  5203 tablet_bootstrap.cc:654] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.548821  5206 tablet_bootstrap.cc:654] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.551278  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:27.552143  5086 raft_consensus.cc:3060] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.566049  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:27.567061  5086 raft_consensus.cc:2468] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:27.568522  4900 leader_election.cc:304] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:27.569392  5276 raft_consensus.cc:2804] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:27.570046  5276 raft_consensus.cc:697] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:27.570880  5276 consensus_queue.cc:237] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.567124  5010 raft_consensus.cc:3060] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.576783  5301 leader_election.cc:290] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:27.585069  5413 consensus_queue.cc:1048] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.589987  5206 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.591348  5206 ts_tablet_manager.cc:1403] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.001s
I20260709 13:17:27.594416  5203 tablet_bootstrap.cc:492] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.594303  5206 raft_consensus.cc:359] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.601152  5206 raft_consensus.cc:385] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.601471  5206 raft_consensus.cc:740] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.602195  5206 consensus_queue.cc:260] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.594925  5203 ts_tablet_manager.cc:1403] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.007s
I20260709 13:17:27.604485  5206 ts_tablet_manager.cc:1434] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:17:27.605688  5206 tablet_bootstrap.cc:492] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.606355  5203 raft_consensus.cc:359] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.607017  5203 raft_consensus.cc:385] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.607270  5203 raft_consensus.cc:740] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.608983  5430 raft_consensus.cc:493] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.609594  5430 raft_consensus.cc:515] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.613534  5206 tablet_bootstrap.cc:654] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.616065  5276 raft_consensus.cc:493] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.616556  5276 raft_consensus.cc:515] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.619189  5276 leader_election.cc:290] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:27.621884  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:27.622149  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:27.623452  4900 leader_election.cc:343] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.624043  5430 leader_election.cc:290] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:27.624187  4900 leader_election.cc:343] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.624619  4900 leader_election.cc:304] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:27.626425  5236 consensus_queue.cc:1048] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.626332  5276 raft_consensus.cc:2749] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:27.608980  4832 catalog_manager.cc:5697] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.634649  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a7f2f432e4b6d83de031143ba6238" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:27.635506  4934 raft_consensus.cc:2468] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:27.638546  4976 leader_election.cc:304] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:27.639779  5212 raft_consensus.cc:2804] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.640367  5212 raft_consensus.cc:493] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.640892  5212 raft_consensus.cc:3060] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.627009  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a7f2f432e4b6d83de031143ba6238" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:27.646032  5159 raft_consensus.cc:2468] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:27.649181  4832 catalog_manager.cc:5697] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.650880  5203 consensus_queue.cc:260] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.676720  5203 ts_tablet_manager.cc:1434] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.002s
I20260709 13:17:27.677647  5202 tablet_bootstrap.cc:492] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.680673  5202 ts_tablet_manager.cc:1403] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.009s
I20260709 13:17:27.681275  5203 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.683532  5202 raft_consensus.cc:359] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.684237  5202 raft_consensus.cc:385] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.684516  5202 raft_consensus.cc:740] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.685292  5202 consensus_queue.cc:260] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.687418  5202 ts_tablet_manager.cc:1434] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:17:27.688544  5202 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:27.690974  5236 consensus_queue.cc:1048] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.693269  5203 tablet_bootstrap.cc:654] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:27.701350  4900 consensus_peers.cc:597] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:27.704022  5212 raft_consensus.cc:515] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.708534  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a7f2f432e4b6d83de031143ba6238" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:27.709363  5159 raft_consensus.cc:3060] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.712679  5203 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.713243  5203 ts_tablet_manager.cc:1403] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.001s
I20260709 13:17:27.713668  5202 tablet_bootstrap.cc:654] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.716034  5203 raft_consensus.cc:359] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.716804  5203 raft_consensus.cc:385] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.717147  5203 raft_consensus.cc:740] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.717018  4833 catalog_manager.cc:5697] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.717993  5203 consensus_queue.cc:260] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:27.720713  5203 ts_tablet_manager.cc:1434] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:27.721647  5203 tablet_bootstrap.cc:492] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.721561  5411 consensus_queue.cc:1048] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.728277  5203 tablet_bootstrap.cc:654] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.745723  5206 tablet_bootstrap.cc:492] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.748247  5206 ts_tablet_manager.cc:1403] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.143s	user 0.026s	sys 0.041s
I20260709 13:17:27.747807  4832 catalog_manager.cc:5697] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:27.751181  5359 consensus_queue.cc:1048] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.752735  5206 raft_consensus.cc:359] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.753575  5206 raft_consensus.cc:385] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.753825  5206 raft_consensus.cc:740] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.754496  5206 consensus_queue.cc:260] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.758963  5308 consensus_queue.cc:1048] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.760607  5206 ts_tablet_manager.cc:1434] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:17:27.761885  5206 tablet_bootstrap.cc:492] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.767887  5206 tablet_bootstrap.cc:654] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.779044  5202 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.779673  5202 ts_tablet_manager.cc:1403] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.004s
I20260709 13:17:27.785816  5206 tablet_bootstrap.cc:492] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.786528  5206 ts_tablet_manager.cc:1403] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 13:17:27.788241  5203 tablet_bootstrap.cc:492] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.788735  5203 ts_tablet_manager.cc:1403] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.000s
I20260709 13:17:27.789202  5206 raft_consensus.cc:359] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.789937  5206 raft_consensus.cc:385] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.790184  5206 raft_consensus.cc:740] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.791066  5206 consensus_queue.cc:260] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.791448  5203 raft_consensus.cc:359] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.793907  5206 ts_tablet_manager.cc:1434] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:17:27.794837  5206 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.792229  5203 raft_consensus.cc:385] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.800783  5203 raft_consensus.cc:740] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.802776  5203 consensus_queue.cc:260] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.810456  5203 ts_tablet_manager.cc:1434] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:17:27.811725  5203 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.810518  5206 tablet_bootstrap.cc:654] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.818348  5202 raft_consensus.cc:359] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.819005  5202 raft_consensus.cc:385] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.819269  5202 raft_consensus.cc:740] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.819989  5202 consensus_queue.cc:260] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.823359  5202 ts_tablet_manager.cc:1434] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.007s
I20260709 13:17:27.824326  5202 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:27.826407  5411 raft_consensus.cc:493] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.826894  5411 raft_consensus.cc:515] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.828987  5411 leader_election.cc:290] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:27.831370  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:27.833621  5123 leader_election.cc:343] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:27.836130  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:27.837181  4935 raft_consensus.cc:2468] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:27.839238  5124 leader_election.cc:304] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:27.840888  5411 raft_consensus.cc:2804] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.841390  5411 raft_consensus.cc:493] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.841800  5411 raft_consensus.cc:3060] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.841933  5206 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:27.842648  5206 ts_tablet_manager.cc:1403] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.006s
I20260709 13:17:27.844934  5203 tablet_bootstrap.cc:654] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.846407  5202 tablet_bootstrap.cc:654] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.845453  5206 raft_consensus.cc:359] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.850978  5206 raft_consensus.cc:385] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.851253  5206 raft_consensus.cc:740] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.851382  5203 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.852000  5203 ts_tablet_manager.cc:1403] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.004s
I20260709 13:17:27.851972  5206 consensus_queue.cc:260] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.855278  5206 ts_tablet_manager.cc:1434] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:27.855211  5203 raft_consensus.cc:359] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.855923  5203 raft_consensus.cc:385] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.856189  5203 raft_consensus.cc:740] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.856276  5206 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:27.856895  5203 consensus_queue.cc:260] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.859817  5203 ts_tablet_manager.cc:1434] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:27.860636  5203 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.865021  5206 tablet_bootstrap.cc:654] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.865618  5202 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.866124  5202 ts_tablet_manager.cc:1403] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:17:27.870580  5202 raft_consensus.cc:359] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:27.871529  5202 raft_consensus.cc:385] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.871907  5202 raft_consensus.cc:740] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.872699  5202 consensus_queue.cc:260] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:27.873399  5049 consensus_peers.cc:597] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Couldn't send request to peer 546aee349d8547699b9d86b3640f5aae. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:27.875593  5202 ts_tablet_manager.cc:1434] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:17:27.876920  5202 tablet_bootstrap.cc:492] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:27.879117  5236 raft_consensus.cc:493] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.879889  5236 raft_consensus.cc:515] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.885202  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2ed27eb764c4c8a356d249940b43a" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:27.886096  5007 raft_consensus.cc:2468] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:27.888492  5203 tablet_bootstrap.cc:654] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.888332  5123 leader_election.cc:304] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:27.891532  5413 raft_consensus.cc:2804] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.892058  5202 tablet_bootstrap.cc:654] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.892063  5413 raft_consensus.cc:493] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.892882  5413 raft_consensus.cc:3060] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.897859  5203 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.898557  5203 ts_tablet_manager.cc:1403] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.004s
I20260709 13:17:27.902495  5203 raft_consensus.cc:359] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.903455  5203 raft_consensus.cc:385] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.903921  5203 raft_consensus.cc:740] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.906208  5202 tablet_bootstrap.cc:492] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.907034  5202 ts_tablet_manager.cc:1403] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:17:27.910868  5202 raft_consensus.cc:359] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.911702  5202 raft_consensus.cc:385] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.912320  5301 consensus_queue.cc:1048] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:27.912323  5203 consensus_queue.cc:260] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.916803  5203 ts_tablet_manager.cc:1434] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 13:17:27.912799  5202 raft_consensus.cc:740] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.918217  5301 raft_consensus.cc:493] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.919838  5301 raft_consensus.cc:515] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:27.922259  5301 leader_election.cc:290] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:27.919005  5202 consensus_queue.cc:260] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.918010  5203 tablet_bootstrap.cc:492] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.924103  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:27.925001  5083 raft_consensus.cc:2468] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:27.926738  4900 leader_election.cc:304] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:27.928529  5301 raft_consensus.cc:2804] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:27.929157  5301 raft_consensus.cc:493] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.929608  5301 raft_consensus.cc:3060] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:27.947692  5203 tablet_bootstrap.cc:654] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.956116  5203 tablet_bootstrap.cc:492] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:27.956609  5203 ts_tablet_manager.cc:1403] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
W20260709 13:17:27.957937  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 69751.5us
I20260709 13:17:27.959676  5203 raft_consensus.cc:359] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.960538  5203 raft_consensus.cc:385] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:27.960901  5203 raft_consensus.cc:740] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:27.675282  5010 raft_consensus.cc:2468] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:27.962850  5202 ts_tablet_manager.cc:1434] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.008s
I20260709 13:17:27.964237  5202 tablet_bootstrap.cc:492] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:27.971774  5203 consensus_queue.cc:260] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.976797  5203 ts_tablet_manager.cc:1434] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:17:27.978062  5203 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:27.982878  5359 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.984881  5202 tablet_bootstrap.cc:654] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.984017  5359 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.991299  5308 raft_consensus.cc:493] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.991992  5308 raft_consensus.cc:515] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:27.993801  5203 tablet_bootstrap.cc:654] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:27.999302  5202 tablet_bootstrap.cc:492] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:27.999970  5202 ts_tablet_manager.cc:1403] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.006s
I20260709 13:17:28.001117  5308 leader_election.cc:290] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.003756  5202 raft_consensus.cc:359] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.005156  5202 raft_consensus.cc:385] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.004810  5276 consensus_queue.cc:1048] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:28.005556  5202 raft_consensus.cc:740] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.008663  5202 consensus_queue.cc:260] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.011468  5202 ts_tablet_manager.cc:1434] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:28.012743  5202 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:28.020217  5414 raft_consensus.cc:493] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.021142  5414 raft_consensus.cc:515] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.024205  5414 leader_election.cc:290] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.030571  5202 tablet_bootstrap.cc:654] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.032025  5359 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.033452  5203 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:28.037770  5203 ts_tablet_manager.cc:1403] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.001s
I20260709 13:17:28.039455  5082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:28.041283  5203 raft_consensus.cc:359] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.042248  5203 raft_consensus.cc:385] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.042593  5203 raft_consensus.cc:740] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.043537  5203 consensus_queue.cc:260] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.047302  5236 leader_election.cc:290] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:28.049047  5203 ts_tablet_manager.cc:1434] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:17:28.050460  5203 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:28.055418  5236 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.056044  5236 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.058552  5236 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:28.060956  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.114292  5160 raft_consensus.cc:2468] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:28.114900  5411 raft_consensus.cc:515] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.120998  5411 leader_election.cc:290] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.066629  5202 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
W20260709 13:17:28.067854  5201 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.173s	sys 0.341s
W20260709 13:17:28.123135  5201 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.174s	sys 0.341s
I20260709 13:17:28.080986  5414 raft_consensus.cc:493] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.123651  5414 raft_consensus.cc:515] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.124503  5206 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:28.125003  5206 ts_tablet_manager.cc:1403] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.269s	user 0.088s	sys 0.126s
I20260709 13:17:28.125206  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.125869  5414 leader_election.cc:290] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.083628  5430 raft_consensus.cc:493] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.126718  5430 raft_consensus.cc:515] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.127857  5206 raft_consensus.cc:359] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.128547  5206 raft_consensus.cc:385] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.086858  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "084dd96ef5764ccc9fa9d83933389f62" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.128811  5206 raft_consensus.cc:740] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.129271  5157 raft_consensus.cc:2393] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:28.098726  5212 leader_election.cc:290] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.129748  5206 consensus_queue.cc:260] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:28.130079  5123 leader_election.cc:343] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.062386  5203 tablet_bootstrap.cc:654] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:28.106035  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 94253.3us
I20260709 13:17:28.099620  5159 raft_consensus.cc:2468] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:28.111017  5301 raft_consensus.cc:515] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.133710  5301 leader_election.cc:290] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.111886  5308 raft_consensus.cc:493] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.110360  5276 consensus_queue.cc:1048] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:28.113307  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 67255.8us
I20260709 13:17:28.134495  5308 raft_consensus.cc:515] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.111967  5359 raft_consensus.cc:493] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.136554  5308 leader_election.cc:290] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.136750  5359 raft_consensus.cc:515] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.119956  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:28.138114  4935 raft_consensus.cc:3060] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.138643  5308 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.139148  5308 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.140226  5477 raft_consensus.cc:493] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.140722  5477 raft_consensus.cc:515] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.141127  5308 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:28.131847  5206 ts_tablet_manager.cc:1434] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:17:28.142408  5206 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:28.145195  5415 raft_consensus.cc:493] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.145787  5415 raft_consensus.cc:515] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.146840  5155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.148521  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.149199  5158 raft_consensus.cc:2468] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:28.128820  5430 leader_election.cc:290] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.150245  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.150913  5157 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:28.154021  5359 leader_election.cc:290] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.154757  5415 leader_election.cc:290] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.155596  5202 ts_tablet_manager.cc:1403] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.003s
I20260709 13:17:28.157246  5206 tablet_bootstrap.cc:654] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.158488  5202 raft_consensus.cc:359] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.161157  5477 leader_election.cc:290] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.183593  5202 raft_consensus.cc:385] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.185900  5202 raft_consensus.cc:740] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.187333  5202 consensus_queue.cc:260] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.189626  5202 ts_tablet_manager.cc:1434] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:17:28.166391  5201 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:28.203707  5201 ts_tablet_manager.cc:1403] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.702s	user 0.184s	sys 0.343s
I20260709 13:17:28.168331  4934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.206437  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.207392  5010 raft_consensus.cc:3060] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.207536  5201 raft_consensus.cc:359] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.208487  5201 raft_consensus.cc:385] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.210568  5201 raft_consensus.cc:740] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.211274  5201 consensus_queue.cc:260] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:28.214043  5050 leader_election.cc:343] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.121146  5413 raft_consensus.cc:515] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.173420  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.218518  4936 raft_consensus.cc:2468] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:28.175040  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbedf50a3c84aecb67e73854339d8e3" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.175431  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2ed27eb764c4c8a356d249940b43a" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:28.175719  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:28.179553  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5421978302744408a4763ff08b738c2d" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.219658  5083 raft_consensus.cc:2468] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:28.219820  5086 raft_consensus.cc:2468] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:28.162880  4935 raft_consensus.cc:2468] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:28.222208  5050 leader_election.cc:304] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:28.222551  5124 leader_election.cc:304] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:28.227733  5477 raft_consensus.cc:2804] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.228014  5471 raft_consensus.cc:2804] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.228309  5477 raft_consensus.cc:493] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.229094  5477 raft_consensus.cc:3060] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.229404  5471 raft_consensus.cc:697] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:28.231053  5471 consensus_queue.cc:237] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:28.218544  4900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 85218.6us
I20260709 13:17:28.224655  5413 leader_election.cc:290] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:28.226621  5201 ts_tablet_manager.cc:1434] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:17:28.236523  5202 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:28.239008  5201 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:28.232669  5050 leader_election.cc:343] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.243548  5481 raft_consensus.cc:493] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.247100  5481 raft_consensus.cc:515] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.243397  5415 raft_consensus.cc:493] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.248726  5415 raft_consensus.cc:515] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.249125  5481 leader_election.cc:290] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.254745  5212 raft_consensus.cc:493] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.254869  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf3fbfd93384fd8ba4351d1330239ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.255326  5212 raft_consensus.cc:515] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.255568  5160 raft_consensus.cc:2468] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:28.260505  5212 leader_election.cc:290] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.261548  5415 leader_election.cc:290] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.263422  5203 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:28.271586  5203 ts_tablet_manager.cc:1403] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.221s	user 0.011s	sys 0.008s
I20260709 13:17:28.274554  5203 raft_consensus.cc:359] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.275305  5203 raft_consensus.cc:385] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.275640  5203 raft_consensus.cc:740] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.267925  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.265821  5477 raft_consensus.cc:515] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.278817  5203 consensus_queue.cc:260] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:28.281698  5049 leader_election.cc:343] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.282330  5049 leader_election.cc:304] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:28.275553  5050 leader_election.cc:343] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.279354  4975 leader_election.cc:304] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:28.287158  5049 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:28.288765  5203 ts_tablet_manager.cc:1434] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:17:28.289840  5203 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:28.292977  5201 tablet_bootstrap.cc:654] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.295560  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf3fbfd93384fd8ba4351d1330239ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.290514  5359 raft_consensus.cc:2804] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.297580  5359 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.298025  5359 raft_consensus.cc:3060] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.299299  5202 tablet_bootstrap.cc:654] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.292145  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a7f2f432e4b6d83de031143ba6238" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:28.300712  4935 raft_consensus.cc:3060] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.287947  5414 raft_consensus.cc:2749] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.304661  5414 consensus_queue.cc:1048] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:28.306777  5478 raft_consensus.cc:2804] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.307569  5478 raft_consensus.cc:697] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:28.308724  5478 consensus_queue.cc:237] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.328609  5203 tablet_bootstrap.cc:654] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.327966  5049 leader_election.cc:304] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
W20260709 13:17:28.318471  4975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 65209.6us
I20260709 13:17:28.339103  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.333287  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2ed27eb764c4c8a356d249940b43a" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.339912  5012 raft_consensus.cc:3060] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.341071  5206 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:28.341748  5206 ts_tablet_manager.cc:1403] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.200s	user 0.051s	sys 0.049s
I20260709 13:17:28.334404  5415 raft_consensus.cc:2804] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.345393  5415 raft_consensus.cc:493] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.356376  5206 raft_consensus.cc:359] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.356927  5206 raft_consensus.cc:385] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.357234  5206 raft_consensus.cc:740] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.357818  5206 consensus_queue.cc:260] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.353968  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:28.352875  5415 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.359530  5086 raft_consensus.cc:3060] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.369335  5206 ts_tablet_manager.cc:1434] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:17:28.371098  5206 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:28.355240  4975 leader_election.cc:304] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:28.376191  5085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:28.373443  5477 leader_election.cc:290] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.389561  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:28.385842  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b2ed27eb764c4c8a356d249940b43a" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:28.392113  5212 raft_consensus.cc:3060] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.394797  5012 raft_consensus.cc:2468] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:28.394943  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbedf50a3c84aecb67e73854339d8e3" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.396610  5155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5421978302744408a4763ff08b738c2d" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.397434  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.392200  5084 raft_consensus.cc:3060] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:28.400353  4975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 48144.4us
I20260709 13:17:28.405467  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.406198  5008 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:28.390623  5160 raft_consensus.cc:3060] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.402426  5479 consensus_queue.cc:1048] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:17:28.416705  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.419188  5159 raft_consensus.cc:3060] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.419632  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.422040  5008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.419646  5479 raft_consensus.cc:493] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.424399  5479 raft_consensus.cc:515] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.424851  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.424973  5415 raft_consensus.cc:515] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.426257  5009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.426542  5479 leader_election.cc:290] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.428308  5005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.432397  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:28.420179  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:28.433073  5157 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.433320  4937 raft_consensus.cc:3060] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.410735  5010 raft_consensus.cc:2468] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:28.439574  5212 raft_consensus.cc:2749] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.440815  5359 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.442943  5359 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.443536  4935 raft_consensus.cc:2468] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:28.443642  5084 raft_consensus.cc:2468] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:28.435473  5086 raft_consensus.cc:2468] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:28.446424  5206 tablet_bootstrap.cc:654] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.415690  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184945b6c18c46b4b5a242903e4df7ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:28.456442  5049 leader_election.cc:343] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.458920  5049 leader_election.cc:304] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:28.460085  5049 leader_election.cc:343] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.460481  5049 leader_election.cc:304] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.447847  5415 leader_election.cc:290] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:28.464109  5477 raft_consensus.cc:2749] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.468652  5486 raft_consensus.cc:2749] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:28.472247  4976 leader_election.cc:343] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.466897  5157 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:28.488646  4933 raft_consensus.cc:2393] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
W20260709 13:17:28.492853  5049 leader_election.cc:343] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.508117  4833 catalog_manager.cc:5697] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:28.500667  5050 leader_election.cc:343] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.516793  5049 leader_election.cc:304] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:28.512454  5413 raft_consensus.cc:493] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.525245  5487 raft_consensus.cc:493] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.525331  5481 raft_consensus.cc:2804] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.525936  5011 raft_consensus.cc:3060] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.522819  5155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.529534  5276 raft_consensus.cc:493] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.547477  4900 leader_election.cc:304] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:28.531981  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:28.548673  5049 leader_election.cc:343] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.552613  5203 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
W20260709 13:17:28.553128  5049 leader_election.cc:343] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.553272  5203 ts_tablet_manager.cc:1403] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.264s	user 0.010s	sys 0.008s
I20260709 13:17:28.521521  5123 leader_election.cc:304] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
W20260709 13:17:28.570411  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 54497.8us
I20260709 13:17:28.556206  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.572157  5411 raft_consensus.cc:2804] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.544739  5481 raft_consensus.cc:697] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:28.554559  5276 raft_consensus.cc:515] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.573429  5481 consensus_queue.cc:237] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.575143  5276 leader_election.cc:290] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.575717  4935 raft_consensus.cc:2468] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:28.559166  5480 raft_consensus.cc:2804] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.576885  5480 raft_consensus.cc:697] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:28.577922  5480 consensus_queue.cc:237] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
W20260709 13:17:28.579306  5484 log.cc:927] Time spent T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:17:28.564190  5160 raft_consensus.cc:2468] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:28.540707  5487 raft_consensus.cc:515] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.581640  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.584031  5411 raft_consensus.cc:697] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:28.584244  5010 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.569010  5155 raft_consensus.cc:2393] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:28.584964  5411 consensus_queue.cc:237] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.533545  5413 raft_consensus.cc:515] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.587607  5413 leader_election.cc:290] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.583709  5202 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:28.588490  5202 ts_tablet_manager.cc:1403] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.355s	user 0.024s	sys 0.006s
I20260709 13:17:28.584971  5123 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:28.566285  4975 leader_election.cc:304] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.590675  5471 raft_consensus.cc:2804] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.591037  5471 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.591485  5308 raft_consensus.cc:2804] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.591643  5471 raft_consensus.cc:3060] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.592006  5308 raft_consensus.cc:493] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.592500  5308 raft_consensus.cc:3060] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.582568  5487 leader_election.cc:290] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.591111  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.591619  4975 leader_election.cc:304] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.569479  4937 raft_consensus.cc:2468] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:28.600945  5050 leader_election.cc:304] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:28.601058  5430 raft_consensus.cc:2749] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.602437  5494 raft_consensus.cc:2804] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.602929  5494 raft_consensus.cc:697] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:28.606438  5471 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:28.606988  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.607671  5158 raft_consensus.cc:2468] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:28.606478  5157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:28.609995  5157 raft_consensus.cc:2393] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c70fac7b468a4fa59ccb26ef6e6220f6 in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:28.610383  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:28.611100  5158 raft_consensus.cc:2468] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:28.595489  5203 raft_consensus.cc:359] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.598176  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.614053  5203 raft_consensus.cc:385] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.617799  4900 leader_election.cc:304] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:28.615512  4975 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:28.621246  5203 raft_consensus.cc:740] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.626186  5201 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:28.626904  5201 ts_tablet_manager.cc:1403] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.388s	user 0.019s	sys 0.007s
I20260709 13:17:28.607105  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.637512  4975 leader_election.cc:304] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:28.640661  5210 raft_consensus.cc:2804] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.641111  5210 raft_consensus.cc:493] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.641429  5210 raft_consensus.cc:3060] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.641548  5004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.638532  5203 consensus_queue.cc:260] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:28.644057  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 90943us
W20260709 13:17:28.645569  5049 leader_election.cc:343] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.645857  5049 leader_election.cc:304] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
W20260709 13:17:28.647665  5049 leader_election.cc:343] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.648083  5049 leader_election.cc:304] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:28.652637  5050 leader_election.cc:343] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.653416  5477 raft_consensus.cc:2749] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:28.654819  5049 leader_election.cc:343] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.656117  5203 ts_tablet_manager.cc:1434] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.001s
I20260709 13:17:28.657312  5203 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:28.658130  5494 consensus_queue.cc:237] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.664342  5202 raft_consensus.cc:359] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.665062  5202 raft_consensus.cc:385] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.665321  5202 raft_consensus.cc:740] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.665912  5202 consensus_queue.cc:260] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:28.666826  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:28.642661  5479 raft_consensus.cc:2804] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.668740  5479 raft_consensus.cc:493] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.669080  5479 raft_consensus.cc:3060] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.670190  5202 ts_tablet_manager.cc:1434] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 13:17:28.670985  5471 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:28.671063  5124 leader_election.cc:343] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.671756  5202 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:28.672569  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.673367  5485 raft_consensus.cc:2749] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.695369  5206 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:28.696053  5206 ts_tablet_manager.cc:1403] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.326s	user 0.026s	sys 0.016s
I20260709 13:17:28.658491  5308 raft_consensus.cc:515] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:28.699887  5049 leader_election.cc:343] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:28.729468  5123 leader_election.cc:343] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.718945  5481 raft_consensus.cc:493] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.716034  5010 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
W20260709 13:17:28.733188  4975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 54445.7us
I20260709 13:17:28.744133  5495 consensus_queue.cc:1048] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:17:28.747982  5308 leader_election.cc:290] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.744233  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:28.759655  5206 raft_consensus.cc:359] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.760793  5206 raft_consensus.cc:385] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.761176  5206 raft_consensus.cc:740] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.754274  5049 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:28.762068  5206 consensus_queue.cc:260] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.773443  5206 ts_tablet_manager.cc:1434] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.001s
I20260709 13:17:28.738767  5481 raft_consensus.cc:515] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:28.782413  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf3fbfd93384fd8ba4351d1330239ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:28.787853  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:28.774957  5203 tablet_bootstrap.cc:654] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.788574  5158 raft_consensus.cc:3060] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:28.786793  5503 log.cc:927] Time spent T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:17:28.788477  5083 raft_consensus.cc:2468] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:28.776585  5495 raft_consensus.cc:2749] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.800081  5202 tablet_bootstrap.cc:654] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.801967  5479 raft_consensus.cc:515] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.804136  5004 raft_consensus.cc:2393] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e2c2c6ff9224614b4b24e53c472d346 in current term 1: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:28.805120  5158 raft_consensus.cc:2468] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:28.787364  5481 leader_election.cc:290] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.816782  4975 leader_election.cc:304] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:28.817544  5201 raft_consensus.cc:359] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.818534  5201 raft_consensus.cc:385] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.818745  4975 leader_election.cc:304] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:28.819164  5201 raft_consensus.cc:740] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.821570  5201 consensus_queue.cc:260] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.816875  5123 leader_election.cc:304] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.831534  5206 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:28.832340  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf3fbfd93384fd8ba4351d1330239ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:28.833961  5203 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:28.834451  5203 ts_tablet_manager.cc:1403] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.000s
I20260709 13:17:28.837374  5203 raft_consensus.cc:359] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.838019  5203 raft_consensus.cc:385] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:28.838161  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.838349  5203 raft_consensus.cc:740] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:28.826363  5212 raft_consensus.cc:2749] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.847925  5511 raft_consensus.cc:2804] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.849431  5411 raft_consensus.cc:2804] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:28.849974  5411 raft_consensus.cc:493] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.849735  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:28.850430  5411 raft_consensus.cc:3060] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:28.850735  5156 raft_consensus.cc:3060] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:28.854106  4976 leader_election.cc:343] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:28.855293  5508 log.cc:927] Time spent T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:17:28.856364  5479 leader_election.cc:290] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.856805  5511 raft_consensus.cc:697] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:28.858342  5511 consensus_queue.cc:237] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:28.860111  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 47276.8us
I20260709 13:17:28.828960  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:28.849601  5505 log.cc:927] Time spent T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:28.868047  5468 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.868558  5468 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.870752  5468 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.874576  5206 tablet_bootstrap.cc:654] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.874946  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:28.886171  5236 consensus_queue.cc:1048] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:28.870004  5210 raft_consensus.cc:515] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:28.876984  5203 consensus_queue.cc:260] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.879122  5411 raft_consensus.cc:515] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:28.882721  5430 raft_consensus.cc:2749] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.883267  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:28.896365  5049 leader_election.cc:343] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.897099  5049 leader_election.cc:304] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.902755  5201 ts_tablet_manager.cc:1434] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.275s	user 0.010s	sys 0.000s
I20260709 13:17:28.904065  5203 ts_tablet_manager.cc:1434] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.002s
I20260709 13:17:28.905912  5203 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
W20260709 13:17:28.902987  5049 leader_election.cc:343] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.908370  5201 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:28.909977  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:28.901391  5414 raft_consensus.cc:2749] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.910830  5083 raft_consensus.cc:2393] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
W20260709 13:17:28.912302  5123 leader_election.cc:343] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.907668  5236 consensus_queue.cc:1048] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:17:28.927132  5210 leader_election.cc:290] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:28.928678  5513 consensus_queue.cc:1048] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:17:28.915964  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:28.941020  4933 raft_consensus.cc:2393] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate 7e2c2c6ff9224614b4b24e53c472d346 in this term.
W20260709 13:17:28.941673  5050 leader_election.cc:343] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.942294  5050 leader_election.cc:304] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.943251  5494 raft_consensus.cc:2749] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.947835  5513 consensus_queue.cc:1048] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:28.948377  5124 leader_election.cc:343] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:28.948865  5124 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:28.948926  5123 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:28.950106  5236 raft_consensus.cc:2749] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.950074  5468 raft_consensus.cc:2749] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:28.961863  5203 tablet_bootstrap.cc:654] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:28.980938  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
W20260709 13:17:28.989491  5520 log.cc:927] Time spent T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:17:28.990541  5007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:28.991500  5007 raft_consensus.cc:2393] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e2c2c6ff9224614b4b24e53c472d346 in current term 1: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:28.991966  5411 leader_election.cc:290] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:28.995428  4936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:28.996299  5156 raft_consensus.cc:2468] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:28.997543  4975 leader_election.cc:304] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:28.998412  5513 raft_consensus.cc:2804] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:28.998880  5513 raft_consensus.cc:697] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:29.000219  4900 leader_election.cc:304] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:28.999693  5513 consensus_queue.cc:237] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.001539  5301 raft_consensus.cc:2749] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.002583  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:29.003229  5086 raft_consensus.cc:3060] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:29.012600  5124 leader_election.cc:343] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.017786  5212 raft_consensus.cc:493] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.018283  5212 raft_consensus.cc:515] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.019613  5494 raft_consensus.cc:493] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.020380  5212 leader_election.cc:290] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.021385  5202 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:29.022380  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.023242  5202 ts_tablet_manager.cc:1403] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.352s	user 0.014s	sys 0.017s
I20260709 13:17:29.020167  5494 raft_consensus.cc:515] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.037288  5494 leader_election.cc:290] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:29.033586  4832 catalog_manager.cc:5697] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.039156  4832 catalog_manager.cc:5697] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.033547  4835 catalog_manager.cc:5697] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:29.024469  4975 leader_election.cc:343] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.051482  5201 tablet_bootstrap.cc:654] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.057118  5485 consensus_queue.cc:1048] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:17:29.058811  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.059541  4933 raft_consensus.cc:2468] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:29.066141  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.072161  5210 consensus_queue.cc:1048] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:29.053524  5202 raft_consensus.cc:359] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.074893  5202 raft_consensus.cc:385] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.075193  5202 raft_consensus.cc:740] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.075917  5202 consensus_queue.cc:260] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.077502  5202 ts_tablet_manager.cc:1434] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 13:17:29.078524  5202 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:29.082057  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:29.084370  5050 leader_election.cc:343] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.094728  5485 consensus_queue.cc:1048] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:29.112493  4976 leader_election.cc:304] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:29.113471  5511 raft_consensus.cc:2804] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.113853  5511 raft_consensus.cc:493] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.114195  5511 raft_consensus.cc:3060] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.113862  5206 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:29.115511  5206 ts_tablet_manager.cc:1403] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.284s	user 0.010s	sys 0.005s
I20260709 13:17:29.104862  4834 catalog_manager.cc:5697] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:29.117794  5049 leader_election.cc:343] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.120849  5049 leader_election.cc:304] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.122913  5485 raft_consensus.cc:2749] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.128034  5086 raft_consensus.cc:2468] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:29.133008  5210 consensus_queue.cc:1048] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.148106  4835 catalog_manager.cc:5697] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.144594  5206 raft_consensus.cc:359] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.153388  5206 raft_consensus.cc:385] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.153792  5206 raft_consensus.cc:740] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.154611  5206 consensus_queue.cc:260] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.157546  5123 leader_election.cc:304] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.160964  5471 raft_consensus.cc:2804] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:29.161434  5471 raft_consensus.cc:697] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:29.162257  5471 consensus_queue.cc:237] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.168449  5206 ts_tablet_manager.cc:1434] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:17:29.170004  5206 tablet_bootstrap.cc:492] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:29.171139  5201 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:29.171821  5201 ts_tablet_manager.cc:1403] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.268s	user 0.016s	sys 0.000s
I20260709 13:17:29.186165  5201 raft_consensus.cc:359] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.186856  5201 raft_consensus.cc:385] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.187129  5201 raft_consensus.cc:740] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.192514  5201 consensus_queue.cc:260] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.194862  5201 ts_tablet_manager.cc:1434] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:17:29.195864  5201 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:29.201035  5202 tablet_bootstrap.cc:654] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.201391  5203 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:29.201902  5203 ts_tablet_manager.cc:1403] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.296s	user 0.008s	sys 0.010s
I20260709 13:17:29.207899  5203 raft_consensus.cc:359] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.209115  5203 raft_consensus.cc:385] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.209483  5203 raft_consensus.cc:740] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.208021  5236 consensus_queue.cc:1048] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.214613  5485 consensus_queue.cc:1048] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.217303  5411 consensus_queue.cc:1048] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:29.227567  5049 consensus_peers.cc:597] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.227960  5206 tablet_bootstrap.cc:654] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.210384  5203 consensus_queue.cc:260] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.233386  5511 raft_consensus.cc:515] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.236193  5411 raft_consensus.cc:493] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.236672  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:29.236939  5411 raft_consensus.cc:515] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.237716  5201 tablet_bootstrap.cc:654] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.240985  5203 ts_tablet_manager.cc:1434] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:17:29.242060  5203 tablet_bootstrap.cc:492] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:29.242121  5202 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:29.242548  5202 ts_tablet_manager.cc:1403] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.164s	user 0.010s	sys 0.000s
I20260709 13:17:29.245000  5202 raft_consensus.cc:359] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.245595  5202 raft_consensus.cc:385] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.245838  5202 raft_consensus.cc:740] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.246531  5202 consensus_queue.cc:260] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.250454  5411 leader_election.cc:290] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:29.252267  5206 tablet_bootstrap.cc:492] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:29.252753  5206 ts_tablet_manager.cc:1403] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.083s	user 0.002s	sys 0.008s
I20260709 13:17:29.252830  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.253530  4931 raft_consensus.cc:2468] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:29.256700  5124 leader_election.cc:304] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:29.257529  4833 catalog_manager.cc:5697] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.261765  5236 raft_consensus.cc:2804] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.262166  5236 raft_consensus.cc:493] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.259198  4833 catalog_manager.cc:5697] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.262491  5236 raft_consensus.cc:3060] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.266770  5202 ts_tablet_manager.cc:1434] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
I20260709 13:17:29.273608  5206 raft_consensus.cc:359] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.274348  5206 raft_consensus.cc:385] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.274614  5206 raft_consensus.cc:740] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.275274  5206 consensus_queue.cc:260] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.276516  5511 leader_election.cc:290] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.276894  5206 ts_tablet_manager.cc:1434] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:17:29.277130  5511 consensus_queue.cc:1048] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.277879  5206 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:29.280529  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:29.281176  4932 raft_consensus.cc:3060] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.298261  5206 tablet_bootstrap.cc:654] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.301813  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:29.302623  5011 raft_consensus.cc:2393] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 1: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:29.306361  4932 raft_consensus.cc:2468] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:29.314590  4931 raft_consensus.cc:3060] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.321034  5206 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:29.323433  5202 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:29.328591  5485 raft_consensus.cc:493] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.333591  5206 ts_tablet_manager.cc:1403] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.000s
I20260709 13:17:29.334647  5485 raft_consensus.cc:515] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.336736  5485 leader_election.cc:290] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.337811  5206 raft_consensus.cc:359] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.338546  5206 raft_consensus.cc:385] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.338824  5206 raft_consensus.cc:740] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.341922  5206 consensus_queue.cc:260] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.299507  5203 tablet_bootstrap.cc:654] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.339895  5236 raft_consensus.cc:515] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.358912  5495 raft_consensus.cc:493] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.359089  4976 leader_election.cc:304] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:29.359719  5495 raft_consensus.cc:515] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.360795  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.361819  5495 leader_election.cc:290] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.362255  5212 raft_consensus.cc:2804] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:17:29.362599  5050 leader_election.cc:343] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.362962  5212 raft_consensus.cc:697] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:29.364336  5212 consensus_queue.cc:237] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.367106  5513 consensus_queue.cc:1048] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.370208  5206 ts_tablet_manager.cc:1434] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:17:29.371575  5206 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:29.372385  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.372792  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.374003  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:29.378702  5050 leader_election.cc:343] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.387863  5158 raft_consensus.cc:2393] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
W20260709 13:17:29.402594  5049 leader_election.cc:343] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.403111  5049 leader_election.cc:304] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:29.412319  5049 leader_election.cc:343] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.412839  5049 leader_election.cc:304] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.411661  5494 raft_consensus.cc:2749] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.414904  5487 raft_consensus.cc:2749] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.429626  5202 tablet_bootstrap.cc:654] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.434844  5203 tablet_bootstrap.cc:492] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:29.435420  5203 ts_tablet_manager.cc:1403] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.014s
I20260709 13:17:29.438176  5203 raft_consensus.cc:359] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.438848  5203 raft_consensus.cc:385] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.439136  5203 raft_consensus.cc:740] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.441099  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:29.420202  5236 leader_election.cc:290] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:29.451797  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:29.452515  5201 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:29.452668  4933 raft_consensus.cc:2393] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 1: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:29.453056  5201 ts_tablet_manager.cc:1403] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.257s	user 0.043s	sys 0.021s
I20260709 13:17:29.454402  5124 leader_election.cc:304] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.456630  5206 tablet_bootstrap.cc:654] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.463707  5201 raft_consensus.cc:359] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.464850  5201 raft_consensus.cc:385] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.465117  5201 raft_consensus.cc:740] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.466666  5236 raft_consensus.cc:2749] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.469508  5201 consensus_queue.cc:260] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.472966  5511 consensus_queue.cc:1048] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.478178  4834 catalog_manager.cc:5697] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.482293  5201 ts_tablet_manager.cc:1434] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:17:29.483616  5201 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:29.480388  5511 raft_consensus.cc:493] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.501927  5203 consensus_queue.cc:260] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.508010  5511 raft_consensus.cc:515] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.518190  4835 catalog_manager.cc:5697] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.519881  5511 leader_election.cc:290] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:29.525575  5203 ts_tablet_manager.cc:1434] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 13:17:29.527173  5203 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:29.534438  5509 raft_consensus.cc:493] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.535121  5509 raft_consensus.cc:515] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.537503  5509 leader_election.cc:290] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:29.538798  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:29.539649  5084 raft_consensus.cc:2468] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:29.540560  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.543934  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.546345  5513 consensus_queue.cc:1048] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:29.548689  4975 leader_election.cc:304] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:29.553289  5276 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.557282  5276 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.559213  5276 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:29.561427  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.553687  5430 raft_consensus.cc:2804] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.562235  5156 raft_consensus.cc:2468] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:29.562630  5430 raft_consensus.cc:493] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.563133  5430 raft_consensus.cc:3060] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.565728  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:29.568629  4900 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:29.569463  5276 raft_consensus.cc:2804] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.569835  5276 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.570170  5276 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:29.571879  4976 leader_election.cc:343] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:29.573268  4976 leader_election.cc:343] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.574715  5236 consensus_queue.cc:1048] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.563608  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:29.576531  5084 raft_consensus.cc:2468] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:29.579416  4975 leader_election.cc:304] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:29.579282  4900 leader_election.cc:343] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.580744  5212 raft_consensus.cc:2804] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.581100  5212 raft_consensus.cc:493] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.581439  5212 raft_consensus.cc:3060] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.584784  5202 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:29.584610  5276 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.585289  5202 ts_tablet_manager.cc:1403] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.262s	user 0.044s	sys 0.025s
I20260709 13:17:29.586849  5276 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:29.588392  5202 raft_consensus.cc:359] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.589185  5202 raft_consensus.cc:385] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.589455  5202 raft_consensus.cc:740] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.590123  5202 consensus_queue.cc:260] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.590833  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:29.591504  5156 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.592617  5202 ts_tablet_manager.cc:1434] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:17:29.593554  5202 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:29.601354  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:29.602631  5236 raft_consensus.cc:493] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.603190  5236 raft_consensus.cc:515] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.605392  5236 leader_election.cc:290] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.606071  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5421978302744408a4763ff08b738c2d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:29.606765  5081 raft_consensus.cc:2468] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:29.607878  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5421978302744408a4763ff08b738c2d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:29.608989  4900 leader_election.cc:343] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.609217  5123 leader_election.cc:304] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:29.610320  5236 raft_consensus.cc:2804] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.610692  5236 raft_consensus.cc:493] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.611014  5236 raft_consensus.cc:3060] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.611932  5206 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:29.612474  5206 ts_tablet_manager.cc:1403] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.241s	user 0.030s	sys 0.048s
I20260709 13:17:29.613730  5202 tablet_bootstrap.cc:654] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.612353  5212 raft_consensus.cc:515] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.591257  5430 raft_consensus.cc:515] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.616125  5212 leader_election.cc:290] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:29.617449  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:29.619076  5081 raft_consensus.cc:3060] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.619194  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:29.619995  5086 raft_consensus.cc:3060] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:29.620958  5124 leader_election.cc:343] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.623644  5236 raft_consensus.cc:515] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.627351  5206 raft_consensus.cc:359] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:29.629420  5124 consensus_peers.cc:597] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:29.629781  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5421978302744408a4763ff08b738c2d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
W20260709 13:17:29.631108  5124 leader_election.cc:343] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.631482  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5421978302744408a4763ff08b738c2d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:29.632125  5083 raft_consensus.cc:3060] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.633569  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:29.635622  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:29.617808  5156 raft_consensus.cc:2468] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:29.628069  5206 raft_consensus.cc:385] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.640565  5206 raft_consensus.cc:740] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.641366  5206 consensus_queue.cc:260] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.643545  5206 ts_tablet_manager.cc:1434] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:17:29.645349  5206 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:29.629920  5236 leader_election.cc:290] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:29.640584  4976 leader_election.cc:343] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.644224  5086 raft_consensus.cc:2468] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:29.617722  5430 leader_election.cc:290] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:29.647656  4975 leader_election.cc:304] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:29.651432  5203 tablet_bootstrap.cc:654] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.651955  5548 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.652155  4900 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:29.652544  5548 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.654577  5548 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:29.655293  5201 tablet_bootstrap.cc:654] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.656985  5083 raft_consensus.cc:2468] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:29.657446  5212 raft_consensus.cc:2804] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:29.657498  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:29.658118  5212 raft_consensus.cc:697] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:29.658461  5080 raft_consensus.cc:2393] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
W20260709 13:17:29.659382  4976 leader_election.cc:343] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.658885  5212 consensus_queue.cc:237] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.660756  5123 leader_election.cc:304] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.655166  5504 raft_consensus.cc:2804] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:29.645802  5081 raft_consensus.cc:2468] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:29.670558  5504 raft_consensus.cc:697] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:29.684962  4975 leader_election.cc:304] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.674367  5411 raft_consensus.cc:2804] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:29.692020  5203 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:29.692317  5411 raft_consensus.cc:697] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:29.692582  5203 ts_tablet_manager.cc:1403] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.166s	user 0.010s	sys 0.004s
I20260709 13:17:29.693272  5411 consensus_queue.cc:237] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.696697  5203 raft_consensus.cc:359] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.697515  5203 raft_consensus.cc:385] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.697770  5203 raft_consensus.cc:740] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.700940  5203 consensus_queue.cc:260] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.671728  5504 consensus_queue.cc:237] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.708484  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.709362  5156 raft_consensus.cc:2393] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:29.715291  5430 raft_consensus.cc:2804] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:29.715899  4975 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:29.715940  5206 tablet_bootstrap.cc:654] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.732002  5509 raft_consensus.cc:3060] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.717358  5430 raft_consensus.cc:697] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:29.739399  5430 consensus_queue.cc:237] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.745235  5203 ts_tablet_manager.cc:1434] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 13:17:29.751627  5203 tablet_bootstrap.cc:492] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:29.757429  5202 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:29.758749  5555 raft_consensus.cc:493] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.759326  5555 raft_consensus.cc:515] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.758072  5202 ts_tablet_manager.cc:1403] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.016s
I20260709 13:17:29.761571  5555 leader_election.cc:290] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.764101  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.777273  5202 raft_consensus.cc:359] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.778275  5202 raft_consensus.cc:385] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.778600  5202 raft_consensus.cc:740] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.787922  5202 consensus_queue.cc:260] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.790474  5509 raft_consensus.cc:2749] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.793141  4931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.793464  5202 ts_tablet_manager.cc:1434] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:17:29.794829  5202 tablet_bootstrap.cc:492] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
W20260709 13:17:29.798431  4975 leader_election.cc:343] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.800874  5202 tablet_bootstrap.cc:654] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.806852  5511 consensus_queue.cc:1048] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:29.812656  5201 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:29.813225  5201 ts_tablet_manager.cc:1403] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.330s	user 0.015s	sys 0.007s
I20260709 13:17:29.810710  5485 raft_consensus.cc:493] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.832773  5206 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:29.833287  5206 ts_tablet_manager.cc:1403] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.022s
W20260709 13:17:29.841449  4976 leader_election.cc:343] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.841952  4976 leader_election.cc:304] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.843514  5509 raft_consensus.cc:2749] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.831629  5485 raft_consensus.cc:515] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.846213  5485 leader_election.cc:290] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:29.846036  4834 catalog_manager.cc:5697] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.851866  5203 tablet_bootstrap.cc:654] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.847605  4834 catalog_manager.cc:5697] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.856026  5468 raft_consensus.cc:493] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.856541  5468 raft_consensus.cc:515] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.873870  4832 catalog_manager.cc:5697] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.876039  5201 raft_consensus.cc:359] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.886052  5201 raft_consensus.cc:385] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.886431  5201 raft_consensus.cc:740] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.887005  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbedf50a3c84aecb67e73854339d8e3" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:29.883733  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:29.887630  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:29.887128  5201 consensus_queue.cc:260] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:29.877007  5468 leader_election.cc:290] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:29.893702  5049 leader_election.cc:343] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.890513  5201 ts_tablet_manager.cc:1434] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
W20260709 13:17:29.900205  5124 leader_election.cc:343] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.902599  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbedf50a3c84aecb67e73854339d8e3" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:29.905295  5084 raft_consensus.cc:2468] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:29.907944  5206 raft_consensus.cc:359] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.908649  5206 raft_consensus.cc:385] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.908915  5206 raft_consensus.cc:740] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.909560  5206 consensus_queue.cc:260] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:29.911638  5206 ts_tablet_manager.cc:1434] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.078s	user 0.000s	sys 0.004s
I20260709 13:17:29.903033  4833 catalog_manager.cc:5697] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.913527  5206 tablet_bootstrap.cc:492] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:29.915270  5201 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:29.920621  5049 leader_election.cc:343] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:29.921093  5049 leader_election.cc:304] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:29.921744  5485 raft_consensus.cc:2749] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:29.925050  5123 leader_election.cc:304] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:29.927558  5468 raft_consensus.cc:2804] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:29.927951  5468 raft_consensus.cc:493] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.928277  5468 raft_consensus.cc:3060] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.931363  5202 tablet_bootstrap.cc:492] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:29.931916  5202 ts_tablet_manager.cc:1403] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.021s
I20260709 13:17:29.936738  5202 raft_consensus.cc:359] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.937594  5202 raft_consensus.cc:385] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.937881  5202 raft_consensus.cc:740] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.938550  5202 consensus_queue.cc:260] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.940696  5202 ts_tablet_manager.cc:1434] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:17:29.941633  5202 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:29.950336  5202 tablet_bootstrap.cc:654] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:29.958737  5203 tablet_bootstrap.cc:492] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:29.959694  5203 ts_tablet_manager.cc:1403] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.209s	user 0.027s	sys 0.018s
I20260709 13:17:29.964685  5203 raft_consensus.cc:359] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.965610  5203 raft_consensus.cc:385] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:29.965951  5203 raft_consensus.cc:740] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:29.943500  5468 raft_consensus.cc:515] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:29.966995  5203 consensus_queue.cc:260] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.968113  5468 leader_election.cc:290] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:29.969647  5203 ts_tablet_manager.cc:1434] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:29.971259  5411 raft_consensus.cc:493] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.971984  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbedf50a3c84aecb67e73854339d8e3" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:29.973541  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbedf50a3c84aecb67e73854339d8e3" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:29.991271  5081 raft_consensus.cc:3060] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:29.991199  5411 raft_consensus.cc:515] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:29.992007  5203 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6: Bootstrap starting.
I20260709 13:17:29.993594  5411 leader_election.cc:290] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:29.975963  5511 consensus_queue.cc:1048] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:29.997126  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:30.001163  5123 leader_election.cc:343] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:30.001986  5124 leader_election.cc:343] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.003931  5203 tablet_bootstrap.cc:654] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.005921  5206 tablet_bootstrap.cc:654] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.007054  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.007784  5084 raft_consensus.cc:2468] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:30.016222  5123 leader_election.cc:304] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:30.017304  5411 raft_consensus.cc:2804] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.018574  5411 raft_consensus.cc:493] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.019042  5411 raft_consensus.cc:3060] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.031553  5202 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:30.032358  5202 ts_tablet_manager.cc:1403] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.091s	user 0.033s	sys 0.021s
I20260709 13:17:30.035713  5202 raft_consensus.cc:359] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.044142  5411 raft_consensus.cc:515] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.045581  5202 raft_consensus.cc:385] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.045931  5202 raft_consensus.cc:740] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.052114  5201 tablet_bootstrap.cc:654] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.055615  5202 consensus_queue.cc:260] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.059064  5206 tablet_bootstrap.cc:492] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:30.059921  5206 ts_tablet_manager.cc:1403] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.034s
I20260709 13:17:30.062583  5206 raft_consensus.cc:359] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.063297  5206 raft_consensus.cc:385] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.063624  5206 raft_consensus.cc:740] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.064396  5206 consensus_queue.cc:260] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.064749  5081 raft_consensus.cc:2468] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:30.065912  5206 ts_tablet_manager.cc:1434] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:30.073137  5202 ts_tablet_manager.cc:1434] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:17:30.076236  5202 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:30.076309  5206 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:30.082789  5123 leader_election.cc:304] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.083626  5562 raft_consensus.cc:2804] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.084159  5562 raft_consensus.cc:697] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:30.085388  5562 consensus_queue.cc:237] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.089735  5203 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6: No bootstrap required, opened a new log
I20260709 13:17:30.090368  5203 ts_tablet_manager.cc:1403] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.025s
I20260709 13:17:30.091972  5511 raft_consensus.cc:493] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.092074  5206 tablet_bootstrap.cc:654] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.093124  5511 raft_consensus.cc:515] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:30.099048  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
W20260709 13:17:30.100659  5123 leader_election.cc:343] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.100701  5203 raft_consensus.cc:359] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.101512  5203 raft_consensus.cc:385] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.101771  5203 raft_consensus.cc:740] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.102341  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:30.102984  5156 raft_consensus.cc:2468] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:30.104219  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:30.105783  4975 leader_election.cc:304] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:30.106865  5212 raft_consensus.cc:2804] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.107230  5212 raft_consensus.cc:493] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.107053  5203 consensus_queue.cc:260] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.107609  5212 raft_consensus.cc:3060] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.115671  5212 raft_consensus.cc:515] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:30.120476  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:30.124883  5203 ts_tablet_manager.cc:1434] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:17:30.132097  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:30.132809  5156 raft_consensus.cc:3060] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.135931  4932 raft_consensus.cc:3060] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.099108  5511 leader_election.cc:290] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:30.141909  5124 consensus_peers.cc:597] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.113209  4976 leader_election.cc:343] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.147414  5212 leader_election.cc:290] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:30.151753  5201 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:30.152278  5201 ts_tablet_manager.cc:1403] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.237s	user 0.011s	sys 0.003s
I20260709 13:17:30.156728  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:30.157135  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:30.157404  5084 raft_consensus.cc:3060] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:30.158411  4976 leader_election.cc:343] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.162678  5201 raft_consensus.cc:359] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.163519  5201 raft_consensus.cc:385] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.163812  5201 raft_consensus.cc:740] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.153316  5411 leader_election.cc:290] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:30.166363  5487 raft_consensus.cc:493] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.166963  5487 raft_consensus.cc:515] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.169392  5487 leader_election.cc:290] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:30.170435  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:30.171489  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:30.173069  5050 leader_election.cc:343] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:30.173887  5049 leader_election.cc:343] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.174293  5049 leader_election.cc:304] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.176589  5212 consensus_queue.cc:1048] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.176409  5487 raft_consensus.cc:2749] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.178908  5301 raft_consensus.cc:493] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.179458  5301 raft_consensus.cc:515] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.182782  5301 leader_election.cc:290] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:30.183801  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.196525  5511 raft_consensus.cc:493] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.183311  5212 consensus_queue.cc:1048] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:17:30.183728  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36a37190f2bf45f0bdf40239c84eb18c" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:30.204975  4900 consensus_peers.cc:597] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.206553  5202 tablet_bootstrap.cc:654] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.188160  5201 consensus_queue.cc:260] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.187067  5156 raft_consensus.cc:2468] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:30.211834  5511 raft_consensus.cc:515] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.211913  4900 leader_election.cc:304] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:30.233520  5201 ts_tablet_manager.cc:1434] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:17:30.211938  4975 leader_election.cc:304] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.237891  5509 raft_consensus.cc:2804] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.238519  5509 raft_consensus.cc:697] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:30.239481  5509 consensus_queue.cc:237] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:30.247581  5201 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:30.210117  4832 catalog_manager.cc:5697] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.252068  5301 consensus_queue.cc:1048] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:30.250557  5485 raft_consensus.cc:493] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.261473  5485 raft_consensus.cc:515] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.263998  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.264788  5086 raft_consensus.cc:2468] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:30.267275  4975 leader_election.cc:304] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:30.251253  5430 consensus_queue.cc:1048] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:17:30.254302  5084 raft_consensus.cc:2468] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:30.278211  5206 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:30.270334  5555 raft_consensus.cc:2804] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.269712  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:30.266218  5511 leader_election.cc:290] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:30.284312  5206 ts_tablet_manager.cc:1403] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.005s
I20260709 13:17:30.268390  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:30.294649  5201 tablet_bootstrap.cc:654] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.286036  5555 raft_consensus.cc:493] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.300277  5555 raft_consensus.cc:3060] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:30.305384  5049 leader_election.cc:343] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:30.307034  4975 leader_election.cc:343] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.311605  5210 raft_consensus.cc:2749] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.313102  5301 raft_consensus.cc:493] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.313505  5301 raft_consensus.cc:515] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.315256  5301 leader_election.cc:290] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:30.306509  5477 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.316157  5477 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.369107  5123 leader_election.cc:304] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:30.374780  5477 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:30.370110  5485 leader_election.cc:290] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:30.375751  5206 raft_consensus.cc:359] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:30.383740  5206 raft_consensus.cc:385] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.384120  5206 raft_consensus.cc:740] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.384861  5206 consensus_queue.cc:260] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:30.376176  5468 raft_consensus.cc:2804] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.386632  5468 raft_consensus.cc:697] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:30.342903  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:30.387627  5468 consensus_queue.cc:237] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.382145  4832 catalog_manager.cc:5697] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.395934  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:30.398941  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebed353d692f4b5390b659b83f88dc16" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.399000  5555 raft_consensus.cc:515] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.400954  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:30.403393  5411 consensus_queue.cc:1048] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:17:30.406003  4976 consensus_peers.cc:597] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.407086  5202 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:30.416494  5202 ts_tablet_manager.cc:1403] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.340s	user 0.013s	sys 0.014s
I20260709 13:17:30.419428  4900 leader_election.cc:304] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:30.420985  5301 raft_consensus.cc:2749] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:30.419755  5049 leader_election.cc:343] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.423437  5206 ts_tablet_manager.cc:1434] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.003s
I20260709 13:17:30.428259  5049 leader_election.cc:304] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:30.424523  5206 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:30.399974  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:30.420490  5050 leader_election.cc:343] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.443161  5487 raft_consensus.cc:2749] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.442436  5555 leader_election.cc:290] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:30.463418  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:30.464274  5086 raft_consensus.cc:3060] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.500303  5201 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:30.500898  5201 ts_tablet_manager.cc:1403] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.265s	user 0.027s	sys 0.000s
I20260709 13:17:30.506150  5201 raft_consensus.cc:359] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.506868  5201 raft_consensus.cc:385] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.507135  5201 raft_consensus.cc:740] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.507972  5201 consensus_queue.cc:260] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.511013  5201 ts_tablet_manager.cc:1434] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:30.512435  5201 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:30.516520  5206 tablet_bootstrap.cc:654] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.520753  5202 raft_consensus.cc:359] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.521687  5202 raft_consensus.cc:385] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.522017  5202 raft_consensus.cc:740] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.522737  5202 consensus_queue.cc:260] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.523228  5201 tablet_bootstrap.cc:654] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:30.465782  5050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.129:36057, user_credentials={real_user=slave}} blocked reactor thread for 45330.4us
I20260709 13:17:30.534922  5086 raft_consensus.cc:2468] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:30.552817  5202 ts_tablet_manager.cc:1434] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.000s
I20260709 13:17:30.554219  5202 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:30.561273  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:30.545835  5468 raft_consensus.cc:493] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.564291  5468 raft_consensus.cc:515] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.566470  5468 leader_election.cc:290] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:30.567198  4975 leader_election.cc:343] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.570518  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:30.574493  5124 consensus_peers.cc:597] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:30.575206  5124 leader_election.cc:343] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:30.577123  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:36371, user_credentials={real_user=slave}} blocked reactor thread for 91881us
I20260709 13:17:30.578918  4832 catalog_manager.cc:5697] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.581682  4975 leader_election.cc:304] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:30.583935  5584 raft_consensus.cc:2804] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.584471  5584 raft_consensus.cc:697] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:30.595870  5580 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.596464  5580 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:30.587399  5049 leader_election.cc:343] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.603899  5049 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.607002  5477 raft_consensus.cc:2749] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.607187  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:30.610245  5201 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:30.610790  5201 ts_tablet_manager.cc:1403] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.000s
I20260709 13:17:30.611197  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:30.585372  5584 consensus_queue.cc:237] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.613621  5201 raft_consensus.cc:359] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.617761  5201 raft_consensus.cc:385] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.618063  5201 raft_consensus.cc:740] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.619155  5202 tablet_bootstrap.cc:654] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.619028  5201 consensus_queue.cc:260] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.620217  4937 raft_consensus.cc:3060] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.600735  5580 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:30.625948  4975 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.638691  5206 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:30.639422  5206 ts_tablet_manager.cc:1403] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.215s	user 0.023s	sys 0.004s
I20260709 13:17:30.643733  5201 ts_tablet_manager.cc:1434] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:17:30.645334  5201 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:30.636276  5580 raft_consensus.cc:2749] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.648672  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.649873  5086 raft_consensus.cc:2468] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:30.656404  5123 leader_election.cc:304] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.665850  5585 raft_consensus.cc:2804] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.666393  5585 raft_consensus.cc:493] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.666805  5585 raft_consensus.cc:3060] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.656056  5411 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:30.685606  5592 log.cc:927] Time spent T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:17:30.674360  5590 raft_consensus.cc:493] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.687399  5590 raft_consensus.cc:515] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.689589  5590 leader_election.cc:290] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:30.690595  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:30.692793  5049 leader_election.cc:343] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.695210  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:30.695984  4933 raft_consensus.cc:2468] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 0.
I20260709 13:17:30.704047  5050 leader_election.cc:304] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
W20260709 13:17:30.723133  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 66790.7us
I20260709 13:17:30.722729  5485 raft_consensus.cc:2804] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:30.724469  5485 raft_consensus.cc:493] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.724862  5485 raft_consensus.cc:3060] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.717944  5411 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.729321  5411 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:30.735121  5585 raft_consensus.cc:515] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.739410  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
W20260709 13:17:30.741526  5124 leader_election.cc:343] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.752480  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:30.753263  5006 raft_consensus.cc:2468] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:30.755340  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.755652  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:30.756052  5083 raft_consensus.cc:2468] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:30.756331  5084 raft_consensus.cc:3060] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.757637  5123 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:30.758437  5411 raft_consensus.cc:2804] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.758795  5411 raft_consensus.cc:493] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.759095  5411 raft_consensus.cc:3060] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.766685  5468 consensus_queue.cc:1048] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:30.768361  5411 raft_consensus.cc:515] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.770494  5411 leader_election.cc:290] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:30.771124  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:30.771787  5006 raft_consensus.cc:3060] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.772372  4832 catalog_manager.cc:5697] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:30.785583  5206 raft_consensus.cc:359] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.786180  5206 raft_consensus.cc:385] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.786419  5206 raft_consensus.cc:740] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.786927  5206 consensus_queue.cc:260] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.776758  5585 leader_election.cc:290] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:30.775629  5084 raft_consensus.cc:2468] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:30.789680  5206 ts_tablet_manager.cc:1434] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
I20260709 13:17:30.790000  5123 leader_election.cc:304] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:30.791356  5585 raft_consensus.cc:2804] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:30.791932  5585 raft_consensus.cc:697] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:30.793023  5585 consensus_queue.cc:237] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.799292  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d5ffde8fa846f7a2031a39ee4129ad" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:30.806384  5081 raft_consensus.cc:3060] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.810194  5006 raft_consensus.cc:2468] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:30.811003  5301 raft_consensus.cc:493] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.813084  5301 raft_consensus.cc:515] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.815523  5206 tablet_bootstrap.cc:492] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:30.763847  5485 raft_consensus.cc:515] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.829424  5123 leader_election.cc:304] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:30.841645  5555 consensus_queue.cc:1048] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:30.842092  5301 leader_election.cc:290] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:30.846172  5206 tablet_bootstrap.cc:654] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.851051  5202 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:30.850868  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:30.851547  5202 ts_tablet_manager.cc:1403] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.298s	user 0.022s	sys 0.043s
I20260709 13:17:30.852509  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d1ce843f5a4a4d82a4c35768da1639" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:30.854089  4900 leader_election.cc:304] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:30.854871  5594 raft_consensus.cc:2804] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:30.855544  5301 raft_consensus.cc:2749] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:30.855854  5006 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.862339  4935 raft_consensus.cc:3060] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.823221  5411 raft_consensus.cc:493] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:30.873493  4976 consensus_peers.cc:597] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.872189  5411 raft_consensus.cc:515] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:30.878114  5202 raft_consensus.cc:359] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:30.875888  5594 raft_consensus.cc:697] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:30.878893  5202 raft_consensus.cc:385] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.879184  5202 raft_consensus.cc:740] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:30.879483  5594 consensus_queue.cc:237] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.881001  5202 consensus_queue.cc:260] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:30.894884  5485 leader_election.cc:290] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:30.897641  5081 raft_consensus.cc:2468] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
W20260709 13:17:30.905687  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 55853.8us
I20260709 13:17:30.907253  5202 ts_tablet_manager.cc:1434] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:17:30.908699  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
W20260709 13:17:30.910334  5049 leader_election.cc:343] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:30.904764  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:30.912557  4932 raft_consensus.cc:3060] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:30.918579  5202 tablet_bootstrap.cc:492] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:30.926061  4832 catalog_manager.cc:5697] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:30.917860  5596 log.cc:927] Time spent T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:17:30.938207  5599 consensus_queue.cc:1048] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:30.945696  5201 tablet_bootstrap.cc:654] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.947322  5202 tablet_bootstrap.cc:654] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:30.975414  4832 catalog_manager.cc:5697] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 2, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:30.984012  5206 tablet_bootstrap.cc:492] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:30.984800  5206 ts_tablet_manager.cc:1403] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.194s	user 0.017s	sys 0.006s
W20260709 13:17:30.988113  5123 consensus_peers.cc:597] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:30.992302  5206 raft_consensus.cc:359] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:30.993716  5555 raft_consensus.cc:493] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.994675  5555 raft_consensus.cc:515] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:30.998554  5206 raft_consensus.cc:385] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:30.999095  5206 raft_consensus.cc:740] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.001124  5206 consensus_queue.cc:260] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.004796  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.005519  5081 raft_consensus.cc:2468] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:31.008082  5123 leader_election.cc:304] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:31.010946  5201 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.011449  5201 ts_tablet_manager.cc:1403] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.366s	user 0.026s	sys 0.011s
I20260709 13:17:31.012042  5599 raft_consensus.cc:2804] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.012468  5599 raft_consensus.cc:493] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.013564  5206 ts_tablet_manager.cc:1434] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:17:31.014586  5206 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:31.025997  5555 leader_election.cc:290] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.028290  5411 leader_election.cc:290] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:31.028993  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:31.025319  4932 raft_consensus.cc:2468] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:31.012820  5599 raft_consensus.cc:3060] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.036479  5050 leader_election.cc:304] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:31.037638  5487 raft_consensus.cc:2804] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.038105  5487 raft_consensus.cc:697] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:31.038885  5487 consensus_queue.cc:237] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.040057  5509 raft_consensus.cc:493] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.043651  5201 raft_consensus.cc:359] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.044150  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:31.047196  5206 tablet_bootstrap.cc:654] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.040376  5471 raft_consensus.cc:493] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.048308  5471 raft_consensus.cc:515] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.050338  5471 leader_election.cc:290] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:31.051949  5509 raft_consensus.cc:515] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.054008  5509 leader_election.cc:290] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:31.054774  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:31.054625  5599 raft_consensus.cc:515] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.055469  5011 raft_consensus.cc:2468] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:31.056540  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4c75efa2c834642afd84dcbcec453b9" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.057758  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:31.061151  4975 leader_election.cc:304] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:31.062568  5123 leader_election.cc:304] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:31.063850  5586 raft_consensus.cc:2804] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.064226  5586 raft_consensus.cc:493] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.064621  5586 raft_consensus.cc:3060] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.064178  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:31.069382  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80b16d4ddd0e4ca2bc3cc095874dd0eb" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:31.071376  5124 leader_election.cc:343] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.064142  5509 raft_consensus.cc:2749] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:31.073838  4975 leader_election.cc:304] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:31.081537  5580 raft_consensus.cc:2749] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:31.085786  5590 raft_consensus.cc:493] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.086342  5590 raft_consensus.cc:515] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.088408  5590 leader_election.cc:290] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:31.099494  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
W20260709 13:17:31.103924  5050 leader_election.cc:343] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.107477  5599 leader_election.cc:290] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:31.110282  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:31.112598  5586 raft_consensus.cc:515] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.099720  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:31.113575  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:31.114326  5084 raft_consensus.cc:3060] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:31.115634  5049 leader_election.cc:343] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.116189  5049 leader_election.cc:304] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:31.116472  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:31.117210  5590 raft_consensus.cc:2749] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:17:31.118075  5124 leader_election.cc:343] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.119539  5586 leader_election.cc:290] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:31.122605  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:31.144215  5006 raft_consensus.cc:3060] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.123651  5202 tablet_bootstrap.cc:492] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:31.044414  5201 raft_consensus.cc:385] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.152153  5201 raft_consensus.cc:740] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.130385  5010 raft_consensus.cc:3060] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.153406  5201 consensus_queue.cc:260] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.154470  4933 raft_consensus.cc:2468] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:31.154695  4833 catalog_manager.cc:5697] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.139603  5084 raft_consensus.cc:2468] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:31.126159  5206 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:31.161810  5206 ts_tablet_manager.cc:1403] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.147s	user 0.026s	sys 0.012s
W20260709 13:17:31.163297  4975 consensus_peers.cc:597] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111): Couldn't send request to peer 546aee349d8547699b9d86b3640f5aae. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:31.165164  5206 raft_consensus.cc:359] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.166225  5206 raft_consensus.cc:385] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.167024  5206 raft_consensus.cc:740] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.167974  5206 consensus_queue.cc:260] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.169251  5123 leader_election.cc:304] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:31.170620  5206 ts_tablet_manager.cc:1434] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:31.173079  5206 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:31.171944  5599 raft_consensus.cc:2804] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.174510  5599 raft_consensus.cc:697] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:31.184939  5206 tablet_bootstrap.cc:654] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.175442  5599 consensus_queue.cc:237] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.207794  5206 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:31.208323  5206 ts_tablet_manager.cc:1403] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.007s
I20260709 13:17:31.211012  5206 raft_consensus.cc:359] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.211686  5206 raft_consensus.cc:385] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.211994  5206 raft_consensus.cc:740] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.212144  5580 consensus_queue.cc:1048] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.212669  5206 consensus_queue.cc:260] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.214051  5202 ts_tablet_manager.cc:1403] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.296s	user 0.027s	sys 0.016s
I20260709 13:17:31.217485  5201 ts_tablet_manager.cc:1434] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.206s	user 0.009s	sys 0.000s
I20260709 13:17:31.222198  5206 ts_tablet_manager.cc:1434] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:17:31.227320  5206 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
W20260709 13:17:31.228609  4883 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:31.248287  5202 raft_consensus.cc:359] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.249038  5202 raft_consensus.cc:385] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.249307  5202 raft_consensus.cc:740] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.246384  5201 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.250568  5202 consensus_queue.cc:260] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.251834  5006 raft_consensus.cc:2468] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:31.252772  5202 ts_tablet_manager.cc:1434] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:17:31.253775  5202 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:31.255033  5123 leader_election.cc:304] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:31.255863  5585 raft_consensus.cc:493] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.256305  5585 raft_consensus.cc:515] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.258487  5585 leader_election.cc:290] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.258986  5585 raft_consensus.cc:2804] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.260900  5202 tablet_bootstrap.cc:654] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.263810  5585 raft_consensus.cc:697] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:31.265034  5585 consensus_queue.cc:237] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.265789  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.267041  5206 tablet_bootstrap.cc:654] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.284443  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:31.287750  5123 leader_election.cc:304] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:31.289484  5411 raft_consensus.cc:2749] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:31.305255  5202 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:31.305982  5202 ts_tablet_manager.cc:1403] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.008s
I20260709 13:17:31.305078  4832 catalog_manager.cc:5697] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.309351  5202 raft_consensus.cc:359] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.310185  5202 raft_consensus.cc:385] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.310487  5202 raft_consensus.cc:740] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.312458  5201 tablet_bootstrap.cc:654] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.320427  5202 consensus_queue.cc:260] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.321615  5206 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:31.322088  5206 ts_tablet_manager.cc:1403] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.027s
I20260709 13:17:31.322625  5202 ts_tablet_manager.cc:1434] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:17:31.323587  5202 tablet_bootstrap.cc:492] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:31.327618  5201 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.328421  5201 ts_tablet_manager.cc:1403] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.004s
I20260709 13:17:31.328303  5206 raft_consensus.cc:359] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.331677  5206 raft_consensus.cc:385] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.332011  5206 raft_consensus.cc:740] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.332773  5206 consensus_queue.cc:260] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.336361  5202 tablet_bootstrap.cc:654] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.336370  5206 ts_tablet_manager.cc:1434] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:17:31.338158  5206 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:31.341599  5201 raft_consensus.cc:359] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.342406  5201 raft_consensus.cc:385] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.342747  5201 raft_consensus.cc:740] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.343411  5201 consensus_queue.cc:260] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.344472  5206 tablet_bootstrap.cc:654] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.351850  5201 ts_tablet_manager.cc:1434] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:17:31.358477  5201 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.361992  5411 consensus_queue.cc:1048] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.367065  4832 catalog_manager.cc:5697] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.368953  5201 tablet_bootstrap.cc:654] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.385560  5202 tablet_bootstrap.cc:492] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:31.386590  5202 ts_tablet_manager.cc:1403] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.008s
I20260709 13:17:31.388378  5206 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:31.388983  5206 ts_tablet_manager.cc:1403] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.001s
I20260709 13:17:31.389798  5202 raft_consensus.cc:359] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.391011  5202 raft_consensus.cc:385] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.391304  5202 raft_consensus.cc:740] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.400861  5206 raft_consensus.cc:359] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.401512  5083 raft_consensus.cc:1275] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:31.403208  5585 consensus_queue.cc:1048] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:31.408149  5124 consensus_peers.cc:597] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:31.415607  4933 raft_consensus.cc:3060] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.418251  5201 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.418864  5201 ts_tablet_manager.cc:1403] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.005s
I20260709 13:17:31.420702  5202 consensus_queue.cc:260] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.421671  5201 raft_consensus.cc:359] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.422407  5201 raft_consensus.cc:385] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.422663  5201 raft_consensus.cc:740] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.401626  5206 raft_consensus.cc:385] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.423063  5202 ts_tablet_manager.cc:1434] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:17:31.425333  5485 consensus_queue.cc:1048] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.424371  5206 raft_consensus.cc:740] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.427806  5206 consensus_queue.cc:260] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.423321  5201 consensus_queue.cc:260] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.434142  5202 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: Bootstrap starting.
I20260709 13:17:31.441335  5202 tablet_bootstrap.cc:654] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.446516  5201 ts_tablet_manager.cc:1434] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:17:31.453454  5206 ts_tablet_manager.cc:1434] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:17:31.454517  5206 tablet_bootstrap.cc:492] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc: Bootstrap starting.
I20260709 13:17:31.456284  5006 raft_consensus.cc:3060] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.460345  5206 tablet_bootstrap.cc:654] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.463694  5010 raft_consensus.cc:1275] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:17:31.463940  5201 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.465693  5594 consensus_queue.cc:1048] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.470458  5201 tablet_bootstrap.cc:654] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.476172  5485 consensus_queue.cc:1048] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.499145  5201 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.499933  5201 ts_tablet_manager.cc:1403] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.004s
I20260709 13:17:31.504884  5586 raft_consensus.cc:493] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.505403  5586 raft_consensus.cc:515] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.507385  5586 leader_election.cc:290] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.510680  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.511286  5084 raft_consensus.cc:2468] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 0.
I20260709 13:17:31.513994  5206 tablet_bootstrap.cc:492] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc: No bootstrap required, opened a new log
I20260709 13:17:31.514560  5206 ts_tablet_manager.cc:1403] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.002s
I20260709 13:17:31.517050  5123 leader_election.cc:304] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:31.503206  5201 raft_consensus.cc:359] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.518528  5201 raft_consensus.cc:385] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.519114  5201 raft_consensus.cc:740] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.518466  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:31.519973  5201 consensus_queue.cc:260] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.520380  5599 raft_consensus.cc:2804] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.520843  5599 raft_consensus.cc:493] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.521163  5599 raft_consensus.cc:3060] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.521914  5201 ts_tablet_manager.cc:1434] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:17:31.532392  5599 raft_consensus.cc:515] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.522924  5201 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.536226  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:31.536458  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:31.536804  5083 raft_consensus.cc:3060] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.547667  5201 tablet_bootstrap.cc:654] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.548123  5202 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: No bootstrap required, opened a new log
I20260709 13:17:31.548693  5202 ts_tablet_manager.cc:1403] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.004s
I20260709 13:17:31.549714  5012 raft_consensus.cc:3060] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.555344  5202 raft_consensus.cc:359] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
W20260709 13:17:31.559257  5123 leader_election.cc:343] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.561154  5201 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.561714  5201 ts_tablet_manager.cc:1403] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.009s
I20260709 13:17:31.563920  4933 raft_consensus.cc:3060] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.567713  5201 raft_consensus.cc:359] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.567881  5599 leader_election.cc:290] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.568565  5201 raft_consensus.cc:385] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.569006  5201 raft_consensus.cc:740] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.569861  5201 consensus_queue.cc:260] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.571159  5083 raft_consensus.cc:2468] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:31.572177  5201 ts_tablet_manager.cc:1434] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 13:17:31.572382  5123 leader_election.cc:343] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.573300  5201 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.573470  5202 raft_consensus.cc:385] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.573884  5202 raft_consensus.cc:740] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.574255  5123 leader_election.cc:304] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:31.574536  5202 consensus_queue.cc:260] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.575655  5599 raft_consensus.cc:2804] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.576347  5599 raft_consensus.cc:697] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:31.577350  5202 ts_tablet_manager.cc:1434] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:17:31.577281  5599 consensus_queue.cc:237] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.573012  5206 raft_consensus.cc:359] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.580302  5206 raft_consensus.cc:385] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.580701  5206 raft_consensus.cc:740] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.581672  5206 consensus_queue.cc:260] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.591961  5206 ts_tablet_manager.cc:1434] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.001s
I20260709 13:17:31.593214  5156 raft_consensus.cc:3060] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.597826  5201 tablet_bootstrap.cc:654] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.606372  4833 catalog_manager.cc:5697] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 0 to 1, leader changed from <none> to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 1 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.612017  5201 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.612596  5201 ts_tablet_manager.cc:1403] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.002s
I20260709 13:17:31.615365  5201 raft_consensus.cc:359] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.615948  5201 raft_consensus.cc:385] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.616214  5201 raft_consensus.cc:740] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.616870  5201 consensus_queue.cc:260] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.619043  5201 ts_tablet_manager.cc:1434] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:31.620023  5201 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.626108  5201 tablet_bootstrap.cc:654] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.672055  5201 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.672592  5201 ts_tablet_manager.cc:1403] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.029s
I20260709 13:17:31.675335  5201 raft_consensus.cc:359] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.675581  5587 raft_consensus.cc:493] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.676067  5201 raft_consensus.cc:385] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.676405  5201 raft_consensus.cc:740] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.676285  5587 raft_consensus.cc:515] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.677170  5201 consensus_queue.cc:260] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.679255  5201 ts_tablet_manager.cc:1434] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:31.679143  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:31.680006  4933 raft_consensus.cc:2468] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:31.680353  5201 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.681192  4976 leader_election.cc:304] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:31.681967  5580 raft_consensus.cc:2804] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.682324  5580 raft_consensus.cc:493] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.682621  5580 raft_consensus.cc:3060] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.686296  5201 tablet_bootstrap.cc:654] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.694743  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.695494  5084 raft_consensus.cc:2468] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:31.699990  5201 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.700881  5201 ts_tablet_manager.cc:1403] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
I20260709 13:17:31.701375  5587 leader_election.cc:290] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.703202  5580 raft_consensus.cc:515] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.703497  5201 raft_consensus.cc:359] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.704519  5201 raft_consensus.cc:385] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.704856  5201 raft_consensus.cc:740] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.705462  5599 consensus_queue.cc:1048] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.705654  5201 consensus_queue.cc:260] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.706312  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:31.706872  4933 raft_consensus.cc:3060] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.706934  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:31.707633  5084 raft_consensus.cc:3060] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.708129  5201 ts_tablet_manager.cc:1434] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:31.709636  5212 raft_consensus.cc:493] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.710119  5212 raft_consensus.cc:515] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.712059  5212 leader_election.cc:290] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.713645  5201 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.713891  4933 raft_consensus.cc:2468] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:31.714509  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.715174  5083 raft_consensus.cc:2468] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:31.715576  4976 leader_election.cc:304] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:31.717684  4975 leader_election.cc:304] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:31.718784  4932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:31.719846  5584 raft_consensus.cc:2804] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.720103  5201 tablet_bootstrap.cc:654] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.720394  5584 raft_consensus.cc:697] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:31.721289  5584 consensus_queue.cc:237] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.721693  5587 raft_consensus.cc:2804] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.722148  5587 raft_consensus.cc:493] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.722692  5587 raft_consensus.cc:3060] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.727146  4932 raft_consensus.cc:3060] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:31.732564  4976 leader_election.cc:343] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:31.751163  5585 consensus_queue.cc:1048] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.756754  5201 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.757345  5201 ts_tablet_manager.cc:1403] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.018s
I20260709 13:17:31.758309  4833 catalog_manager.cc:5697] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.759943  5201 raft_consensus.cc:359] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.760705  5201 raft_consensus.cc:385] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.760982  5201 raft_consensus.cc:740] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.761620  5201 consensus_queue.cc:260] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.762812  4931 raft_consensus.cc:3060] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.763803  5201 ts_tablet_manager.cc:1434] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:17:31.764767  5201 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:31.774134  5201 tablet_bootstrap.cc:654] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:31.776885  5586 consensus_queue.cc:1048] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:31.777667  5509 raft_consensus.cc:493] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.779237  5509 raft_consensus.cc:515] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.781689  5509 leader_election.cc:290] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:31.782812  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0550850ae264c03b931a289b670c061" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:31.783505  5156 raft_consensus.cc:2468] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:31.785056  5585 consensus_queue.cc:1048] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:31.785732  5301 raft_consensus.cc:493] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.786197  5301 raft_consensus.cc:515] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.786703  4975 leader_election.cc:304] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:31.788038  5584 raft_consensus.cc:2804] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.788496  5584 raft_consensus.cc:493] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.788846  5584 raft_consensus.cc:3060] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.788115  5301 leader_election.cc:290] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:31.791715  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.800053  4935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0550850ae264c03b931a289b670c061" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:31.800221  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "615c5414ab724457a1049455f559bab4" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:31.800773  4935 raft_consensus.cc:2468] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 0.
I20260709 13:17:31.804631  4900 leader_election.cc:304] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:31.805835  5301 raft_consensus.cc:2749] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:31.821221  5584 raft_consensus.cc:515] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.827943  5301 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.828496  5301 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.828742  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0550850ae264c03b931a289b670c061" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:31.829341  5156 raft_consensus.cc:3060] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.830489  5301 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:31.832501  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.833535  5080 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:31.834895  4900 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:31.835608  5084 raft_consensus.cc:2468] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:31.835953  5301 raft_consensus.cc:2804] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:31.836468  5301 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.836803  5301 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.705687  5580 leader_election.cc:290] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.838076  5156 raft_consensus.cc:2468] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:31.839433  4975 leader_election.cc:304] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:31.840544  5509 raft_consensus.cc:2804] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.840616  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:31.841059  5509 raft_consensus.cc:697] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:31.841617  5154 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 0.
I20260709 13:17:31.841928  5509 consensus_queue.cc:237] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:31.845112  5584 leader_election.cc:290] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:31.846771  5301 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.853341  5580 raft_consensus.cc:493] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.854142  4937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0550850ae264c03b931a289b670c061" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:31.854915  4937 raft_consensus.cc:3060] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.857367  4933 raft_consensus.cc:3060] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.862105  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:31.864342  5084 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.854163  5580 raft_consensus.cc:515] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:31.876391  4937 raft_consensus.cc:2468] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:31.885854  5301 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:31.888622  4833 catalog_manager.cc:5697] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.887722  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:31.892565  5156 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.901263  5156 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:31.914062  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:31.915004  5080 raft_consensus.cc:2393] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 1: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:31.919142  4900 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:31.921200  5587 raft_consensus.cc:515] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.963472  5587 leader_election.cc:290] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:31.927477  5210 raft_consensus.cc:2804] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:31.923570  5580 leader_election.cc:290] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:31.989223  5012 raft_consensus.cc:3060] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:31.983421  5210 raft_consensus.cc:697] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:31.991245  5210 consensus_queue.cc:237] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:31.979614  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77438d30f849be8959ef2a5aea7f5b" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:31.988128  4933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:31.993162  5201 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: No bootstrap required, opened a new log
I20260709 13:17:31.993681  5201 ts_tablet_manager.cc:1403] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.229s	user 0.094s	sys 0.097s
I20260709 13:17:31.996399  5201 raft_consensus.cc:359] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:31.997056  5201 raft_consensus.cc:385] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:31.997326  5201 raft_consensus.cc:740] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:31.998054  5201 consensus_queue.cc:260] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:32.000469  5084 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 1.
I20260709 13:17:32.000505  5201 ts_tablet_manager.cc:1434] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 13:17:32.005319  4976 leader_election.cc:343] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:32.009727  4933 raft_consensus.cc:3060] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.014343  4835 catalog_manager.cc:5697] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.017915  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:32.018633  5084 raft_consensus.cc:3060] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.021605  4975 leader_election.cc:304] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:32.022408  5587 raft_consensus.cc:2749] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.025734  5411 consensus_queue.cc:1048] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.031097  5084 raft_consensus.cc:2468] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:32.054752  4975 leader_election.cc:304] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:32.055560  5648 raft_consensus.cc:2804] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:32.056111  5648 raft_consensus.cc:697] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:32.056989  5648 consensus_queue.cc:237] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:32.082146  5411 consensus_queue.cc:1048] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.114221  4834 catalog_manager.cc:5697] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 1 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:32.149706  5587 consensus_queue.cc:1048] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.173346  5587 consensus_queue.cc:1048] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.365384  5587 consensus_queue.cc:1048] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.377607  5509 consensus_queue.cc:1048] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.387888  5210 raft_consensus.cc:493] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.388489  5210 raft_consensus.cc:515] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:32.390573  5210 leader_election.cc:290] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:32.392735  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:32.393723  5084 raft_consensus.cc:2393] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e2c2c6ff9224614b4b24e53c472d346 in current term 1: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:32.395326  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261bba9d86af4a97a43b900a29cda09e" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:32.396970  4900 leader_election.cc:304] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:32.399137  5210 raft_consensus.cc:3060] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:32.403575  5301 consensus_queue.cc:1048] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.407444  5210 raft_consensus.cc:2749] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:32.421500  5658 consensus_queue.cc:1048] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:32.489145  5212 consensus_queue.cc:1048] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.508428  5509 consensus_queue.cc:1048] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:32.707175 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
W20260709 13:17:32.724612  5124 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 404 similar messages]
W20260709 13:17:32.748560  4976 consensus_peers.cc:597] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.750491  5124 consensus_peers.cc:597] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.765290 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:32.766398 29718 tablet_replica.cc:333] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.767529 29718 raft_consensus.cc:2243] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.768059 29718 raft_consensus.cc:2272] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.771109 29718 tablet_replica.cc:333] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.771952 29718 raft_consensus.cc:2243] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.772488 29718 raft_consensus.cc:2272] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.775378 29718 tablet_replica.cc:333] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.776346 29718 raft_consensus.cc:2243] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.776870 29718 raft_consensus.cc:2272] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.777724  5124 consensus_peers.cc:597] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.779222 29718 tablet_replica.cc:333] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.780263 29718 raft_consensus.cc:2243] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.781265 29718 raft_consensus.cc:2272] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.784073 29718 tablet_replica.cc:333] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.784595 29718 raft_consensus.cc:2243] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.784934 29718 raft_consensus.cc:2272] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.786779 29718 tablet_replica.cc:333] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.787559 29718 raft_consensus.cc:2243] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.788136 29718 raft_consensus.cc:2272] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.790787 29718 tablet_replica.cc:333] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.791618 29718 raft_consensus.cc:2243] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.792058 29718 raft_consensus.cc:2272] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.792343  5050 consensus_peers.cc:597] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.793840 29718 tablet_replica.cc:333] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.794425 29718 raft_consensus.cc:2243] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.795279 29718 raft_consensus.cc:2272] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.797684 29718 tablet_replica.cc:333] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.798370 29718 raft_consensus.cc:2243] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.798875 29718 raft_consensus.cc:2272] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.801265 29718 tablet_replica.cc:333] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
W20260709 13:17:32.801789  4976 consensus_peers.cc:597] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.801894 29718 raft_consensus.cc:2243] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.802675 29718 raft_consensus.cc:2272] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.803231  5050 consensus_peers.cc:597] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.804867 29718 tablet_replica.cc:333] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.805507 29718 raft_consensus.cc:2243] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.806248 29718 raft_consensus.cc:2272] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.808384 29718 tablet_replica.cc:333] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.809149 29718 raft_consensus.cc:2243] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.809600 29718 raft_consensus.cc:2272] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.811868 29718 tablet_replica.cc:333] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.812602 29718 raft_consensus.cc:2243] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.813066 29718 raft_consensus.cc:2272] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.815286 29718 tablet_replica.cc:333] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.816080 29718 raft_consensus.cc:2243] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.816526 29718 raft_consensus.cc:2272] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.818876 29718 tablet_replica.cc:333] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.819736 29718 raft_consensus.cc:2243] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.820631 29718 raft_consensus.cc:2272] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.822798 29718 tablet_replica.cc:333] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.823565 29718 raft_consensus.cc:2243] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.824054 29718 raft_consensus.cc:2272] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.824643  5124 consensus_peers.cc:597] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.826202 29718 tablet_replica.cc:333] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.826782 29718 raft_consensus.cc:2243] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.827121 29718 raft_consensus.cc:2272] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.827154  5124 consensus_peers.cc:597] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.829239 29718 tablet_replica.cc:333] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.829902 29718 raft_consensus.cc:2243] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.830875 29718 raft_consensus.cc:2272] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.833174 29718 tablet_replica.cc:333] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.833946 29718 raft_consensus.cc:2243] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.834440 29718 raft_consensus.cc:2272] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.835258  4976 consensus_peers.cc:597] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.836539 29718 tablet_replica.cc:333] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
W20260709 13:17:32.836957  4976 consensus_peers.cc:597] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.837411 29718 raft_consensus.cc:2243] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.837972 29718 raft_consensus.cc:2272] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.840044 29718 tablet_replica.cc:333] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.840556 29718 raft_consensus.cc:2243] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.840899 29718 raft_consensus.cc:2272] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.842556 29718 tablet_replica.cc:333] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.843122 29718 raft_consensus.cc:2243] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.843592 29718 raft_consensus.cc:2272] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.847399 29718 tablet_replica.cc:333] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.848279 29718 raft_consensus.cc:2243] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.849236 29718 raft_consensus.cc:2272] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.849269  5124 consensus_peers.cc:597] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.849244  4976 consensus_peers.cc:597] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.851855  5124 consensus_peers.cc:597] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.851912 29718 tablet_replica.cc:333] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.852775 29718 raft_consensus.cc:2243] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.853216 29718 raft_consensus.cc:2272] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.855268 29718 tablet_replica.cc:333] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.855901 29718 raft_consensus.cc:2243] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.856463 29718 raft_consensus.cc:2272] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.859109 29718 tablet_replica.cc:333] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
W20260709 13:17:32.859210  4976 consensus_peers.cc:597] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.859807 29718 raft_consensus.cc:2243] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.860249 29718 raft_consensus.cc:2272] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.862078 29718 tablet_replica.cc:333] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.862649 29718 raft_consensus.cc:2243] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.863051 29718 raft_consensus.cc:2272] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.864981 29718 tablet_replica.cc:333] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.865671 29718 raft_consensus.cc:2243] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.866413 29718 raft_consensus.cc:2272] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.868357 29718 tablet_replica.cc:333] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.868978 29718 raft_consensus.cc:2243] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.869390 29718 raft_consensus.cc:2272] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.871264 29718 tablet_replica.cc:333] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.872004 29718 raft_consensus.cc:2243] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.872478 29718 raft_consensus.cc:2272] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.874588 29718 tablet_replica.cc:333] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
W20260709 13:17:32.874465  5124 consensus_peers.cc:597] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.875386 29718 raft_consensus.cc:2243] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.875926 29718 raft_consensus.cc:2272] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.878134 29718 tablet_replica.cc:333] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
W20260709 13:17:32.878911  5124 consensus_peers.cc:597] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.878923 29718 raft_consensus.cc:2243] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.879988 29718 raft_consensus.cc:2272] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.882287 29718 tablet_replica.cc:333] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.882858 29718 raft_consensus.cc:2243] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.883293 29718 raft_consensus.cc:2272] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.885109 29718 tablet_replica.cc:333] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.885677 29718 raft_consensus.cc:2243] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.886075 29718 raft_consensus.cc:2272] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.887842 29718 tablet_replica.cc:333] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.888396 29718 raft_consensus.cc:2243] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.888736 29718 raft_consensus.cc:2272] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.890367 29718 tablet_replica.cc:333] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.891141 29718 raft_consensus.cc:2243] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.892051 29718 raft_consensus.cc:2272] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.894399 29718 tablet_replica.cc:333] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.895128 29718 raft_consensus.cc:2243] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.895596 29718 raft_consensus.cc:2272] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.897522  4976 consensus_peers.cc:597] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.898099 29718 tablet_replica.cc:333] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.898890 29718 raft_consensus.cc:2243] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.899758 29718 raft_consensus.cc:2272] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.901940 29718 tablet_replica.cc:333] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.902462 29718 raft_consensus.cc:2243] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.903174 29718 raft_consensus.cc:2272] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.905193 29718 tablet_replica.cc:333] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.905932 29718 raft_consensus.cc:2243] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.906394 29718 raft_consensus.cc:2272] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.908288 29718 tablet_replica.cc:333] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.908845 29718 raft_consensus.cc:2243] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.909296 29718 raft_consensus.cc:2272] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.911252 29718 tablet_replica.cc:333] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.911906 29718 raft_consensus.cc:2243] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.912360 29718 raft_consensus.cc:2272] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.914737 29718 tablet_replica.cc:333] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.915395 29718 raft_consensus.cc:2243] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.915972 29718 raft_consensus.cc:2272] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.918292 29718 tablet_replica.cc:333] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
W20260709 13:17:32.918570  5124 consensus_peers.cc:597] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.919081 29718 raft_consensus.cc:2243] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:32.919973 29718 raft_consensus.cc:2272] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:32.921944 29718 tablet_replica.cc:333] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: stopping tablet replica
I20260709 13:17:32.922401 29718 raft_consensus.cc:2243] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:32.922780 29718 raft_consensus.cc:2272] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:32.948690  4976 consensus_peers.cc:597] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.959061  5050 consensus_peers.cc:597] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.959936  5124 consensus_peers.cc:597] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.961486  4976 consensus_peers.cc:597] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:32.962792  5124 consensus_peers.cc:597] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:32.991565 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
W20260709 13:17:33.012367  4976 consensus_peers.cc:597] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.025133  4976 consensus_peers.cc:597] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.050087 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:33.055966  5050 consensus_peers.cc:597] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.058063  5668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:33.058665  5669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:33.060945  5671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:33.063956 29718 server_base.cc:1061] running on GCE node
W20260709 13:17:33.065758  4976 consensus_peers.cc:597] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.068298 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:33.068638 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:33.068902 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603053068879 us; error 0 us; skew 500 ppm
I20260709 13:17:33.069543 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:33.077399 29718 webserver.cc:533] Webserver started at http://127.29.5.129:46233/ using document root <none> and password file <none>
I20260709 13:17:33.078037 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:33.078262 29718 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:17:33.095078 29718 fs_manager.cc:714] Time spent opening directory manager: real 0.015s	user 0.002s	sys 0.012s
W20260709 13:17:33.113054  5124 consensus_peers.cc:597] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.114589  5677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:33.117272 29718 fs_manager.cc:730] Time spent opening block manager: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:17:33.117678 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "7e2c2c6ff9224614b4b24e53c472d346"
format_stamp: "Formatted at 2026-07-09 13:17:21 on dist-test-slave-kgkf"
I20260709 13:17:33.118083 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:33.175554 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:33.177002 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:33.181092 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:17:33.197335  5050 consensus_peers.cc:597] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:33.199972  5686 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:17:33.225435  4976 consensus_peers.cc:597] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.225914  4976 consensus_peers.cc:597] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.237875  5050 consensus_peers.cc:597] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.256438  4976 consensus_peers.cc:597] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.293170  5050 consensus_peers.cc:597] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.297200  4976 consensus_peers.cc:597] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:33.496296  5123 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:45459, user_credentials={real_user=slave}} blocked reactor thread for 55636.5us
I20260709 13:17:33.557339 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:17:33.557699 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.359s	user 0.008s	sys 0.001s
I20260709 13:17:33.557962 29718 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:17:33.565876  5686 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.585081  5686 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.586127  5686 tablet_bootstrap.cc:492] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.586781  5686 ts_tablet_manager.cc:1403] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.004s
I20260709 13:17:33.589540  5686 raft_consensus.cc:359] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.590283  5686 raft_consensus.cc:740] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.591042  5686 consensus_queue.cc:260] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.593403  5686 ts_tablet_manager.cc:1434] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:33.594107  5686 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.606910  5686 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.608023  5686 tablet_bootstrap.cc:492] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.608726  5686 ts_tablet_manager.cc:1403] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:17:33.611271  5686 raft_consensus.cc:359] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.611934  5686 raft_consensus.cc:740] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.612605  5686 consensus_queue.cc:260] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.614393  5686 ts_tablet_manager.cc:1434] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:17:33.615200  5686 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.629441  5686 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.630384  5686 tablet_bootstrap.cc:492] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.630997  5686 ts_tablet_manager.cc:1403] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:17:33.633226  5686 raft_consensus.cc:359] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.641790  5686 raft_consensus.cc:740] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.647100  5686 consensus_queue.cc:260] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.649222  5686 ts_tablet_manager.cc:1434] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:33.649967  5686 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.662204  5686 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.663177  5686 tablet_bootstrap.cc:492] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.663875  5686 ts_tablet_manager.cc:1403] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:17:33.666278  5686 raft_consensus.cc:359] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:33.667030  5686 raft_consensus.cc:740] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.668300  5686 consensus_queue.cc:260] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:33.670236  5686 ts_tablet_manager.cc:1434] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:17:33.671027  5686 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.721657  5686 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.722579  5686 tablet_bootstrap.cc:492] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.723199  5686 ts_tablet_manager.cc:1403] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.052s	user 0.032s	sys 0.012s
I20260709 13:17:33.725553  5686 raft_consensus.cc:359] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.726194  5686 raft_consensus.cc:740] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.726817  5686 consensus_queue.cc:260] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.728675  5686 ts_tablet_manager.cc:1434] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:33.729439  5686 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.746419  5686 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.747310  5686 tablet_bootstrap.cc:492] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.747951  5686 ts_tablet_manager.cc:1403] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:17:33.750221  5686 raft_consensus.cc:359] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.750862  5686 raft_consensus.cc:740] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.751587  5686 consensus_queue.cc:260] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.755834  5686 ts_tablet_manager.cc:1434] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:17:33.756592  5686 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.776496  5686 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.777503  5686 tablet_bootstrap.cc:492] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.778244  5686 ts_tablet_manager.cc:1403] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:17:33.780925  5686 raft_consensus.cc:359] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.781687  5686 raft_consensus.cc:740] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.782330  5686 consensus_queue.cc:260] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.784734  5686 ts_tablet_manager.cc:1434] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:33.785629  5686 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:33.905936  5706 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.907666  5706 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.907738  5585 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.917050  5585 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.913170  5509 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.919461  5509 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:33.931442  5624 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.932461  5624 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:33.933118  5686 tablet_bootstrap.cc:700] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent opening tablet: real 0.142s	user 0.004s	sys 0.000s
I20260709 13:17:33.934469  5706 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:33.936246  5690 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.937126  5690 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:33.940893  5690 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:33.943630  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:33.955565  4976 leader_election.cc:336] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:33.956130  4976 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:33.957201  5648 raft_consensus.cc:2749] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.959560  5686 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:33.960753  5686 tablet_bootstrap.cc:492] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:33.961683  5686 ts_tablet_manager.cc:1403] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.176s	user 0.018s	sys 0.009s
I20260709 13:17:33.963732  5509 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:33.964504  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:33.965273  5158 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:33.965833  5585 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:33.972922  5686 raft_consensus.cc:359] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.979188  5686 raft_consensus.cc:740] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:33.967245  4975 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:33.977240  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:33.981396  5012 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:33.982694  5509 raft_consensus.cc:2804] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.983089  5509 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.973088  5624 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:33.983493  5509 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.985451  5050 leader_election.cc:336] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:33.986127  5686 consensus_queue.cc:260] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:33.986658  5123 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:33.987939  5691 raft_consensus.cc:2804] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.988371  5691 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:33.988798  5691 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.992494  4976 leader_election.cc:336] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:33.999054  5686 ts_tablet_manager.cc:1434] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 13:17:34.000633  5686 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.004456  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.005638  5080 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:34.011140  5123 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:34.012427  5690 raft_consensus.cc:2804] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.012046  5509 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.012948  5690 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.013525  5690 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.014616  5509 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.015394  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:34.018594  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:34.020642  5689 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.021392  5689 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:34.023101  5124 leader_election.cc:336] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.023757  5689 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
W20260709 13:17:34.025574  4976 leader_election.cc:336] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
W20260709 13:17:34.028110  5124 leader_election.cc:336] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.028234  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:34.032985  5050 leader_election.cc:336] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.034041  5049 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.035470  5485 raft_consensus.cc:2749] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.036152  5509 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.036835  5509 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.038926  5509 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:34.045177  4976 leader_election.cc:336] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.048146  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.049932  4975 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:34.051841  5509 raft_consensus.cc:2749] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.053443 29718 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:17:34.053862 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.496s	user 0.271s	sys 0.028s
I20260709 13:17:34.054105  5686 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.055127  5485 raft_consensus.cc:493] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.055935  5485 raft_consensus.cc:515] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.057193  5691 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.058377  5485 leader_election.cc:290] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.061502  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
W20260709 13:17:34.065162  5050 leader_election.cc:336] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.065703  5050 leader_election.cc:304] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.066486  5686 tablet_bootstrap.cc:492] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.066852  5624 raft_consensus.cc:2749] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.067335  5686 ts_tablet_manager.cc:1403] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.000s
I20260709 13:17:34.066682  5690 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.068895  5159 raft_consensus.cc:2393] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c70fac7b468a4fa59ccb26ef6e6220f6 in current term 2: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:34.070528  5686 raft_consensus.cc:359] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.071259  5686 raft_consensus.cc:740] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.072335  5686 consensus_queue.cc:260] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.074679  5158 raft_consensus.cc:2393] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 2: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:34.074986  5686 ts_tablet_manager.cc:1434] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:17:34.074692  5049 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.076009  5624 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.076403  5686 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.078557  4975 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.082823  5509 raft_consensus.cc:2749] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.087862  5690 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.089102  5691 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.089123  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:34.091610  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
W20260709 13:17:34.094682  5124 leader_election.cc:336] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
W20260709 13:17:34.095455  5124 leader_election.cc:336] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.097693  5006 raft_consensus.cc:2393] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 546aee349d8547699b9d86b3640f5aae in current term 2: Already voted for candidate 561ca9eb1a1a4421b17518a3ff3725dc in this term.
I20260709 13:17:34.099570  5485 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.100319  5485 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.103050  5485 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.105377  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:34.105786  5123 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.106154  5012 raft_consensus.cc:2468] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:34.107272  5049 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:34.108584  5586 raft_consensus.cc:2749] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.108843  5485 raft_consensus.cc:2804] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.110432  5485 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.110711  5485 raft_consensus.cc:3060] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.113114  5689 raft_consensus.cc:493] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.113915  5689 raft_consensus.cc:515] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:34.114396  5050 leader_election.cc:336] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.125792  5624 raft_consensus.cc:2749] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.131500  5485 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.133813  5485 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.139178  5691 raft_consensus.cc:493] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.140066  5691 raft_consensus.cc:515] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.142860  5691 leader_election.cc:290] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:34.141944  5050 leader_election.cc:336] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.144358  5485 raft_consensus.cc:493] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.145056  5485 raft_consensus.cc:515] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.145629  5689 leader_election.cc:290] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.147013  5485 leader_election.cc:290] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
W20260709 13:17:34.146867  5050 leader_election.cc:336] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.151826  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.152526  5691 raft_consensus.cc:493] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.152674  5080 raft_consensus.cc:2468] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
I20260709 13:17:34.153498  5691 raft_consensus.cc:515] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:34.154541  5124 leader_election.cc:336] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.155555  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:34.156278  5012 raft_consensus.cc:3060] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.157773  5123 leader_election.cc:304] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.159937  5586 raft_consensus.cc:2804] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.160012  5509 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.164237  5690 raft_consensus.cc:493] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.166471  5691 leader_election.cc:290] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
W20260709 13:17:34.167187  5050 leader_election.cc:336] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.174540  5012 raft_consensus.cc:2468] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 2.
I20260709 13:17:34.173661  5010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:34.175745  5010 raft_consensus.cc:2468] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:34.175925  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:34.173108  5690 raft_consensus.cc:515] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.177845  5509 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.178651  5690 leader_election.cc:290] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.179890  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:34.183722  5509 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:34.167943  5586 raft_consensus.cc:493] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.187314  5586 raft_consensus.cc:3060] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.187776  5509 raft_consensus.cc:493] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.189706  5509 raft_consensus.cc:515] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.191937  5509 leader_election.cc:290] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:34.194952  5124 leader_election.cc:336] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.195479  5124 leader_election.cc:304] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.195843  5648 raft_consensus.cc:493] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
W20260709 13:17:34.196475  5124 leader_election.cc:336] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.196436  5648 raft_consensus.cc:515] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.197386  5690 raft_consensus.cc:2749] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.198791  5648 leader_election.cc:290] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:34.197669  4976 leader_election.cc:336] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.205610  5049 leader_election.cc:304] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
W20260709 13:17:34.206578  4976 leader_election.cc:336] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.207293  5485 raft_consensus.cc:2804] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.207751  5485 raft_consensus.cc:493] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.208185  5485 raft_consensus.cc:3060] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.214294  5686 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.216554  5084 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
W20260709 13:17:34.218451  4976 leader_election.cc:336] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.222410  5586 raft_consensus.cc:515] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.224032  5686 tablet_bootstrap.cc:492] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.224089  5158 raft_consensus.cc:2393] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c70fac7b468a4fa59ccb26ef6e6220f6 in current term 2: Already voted for candidate 546aee349d8547699b9d86b3640f5aae in this term.
I20260709 13:17:34.225888  5123 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.226796  5690 raft_consensus.cc:2804] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.227502  5690 raft_consensus.cc:697] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:34.230553  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.230839  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.231436  5080 raft_consensus.cc:2468] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:34.231531  5081 raft_consensus.cc:2468] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:34.229033  5690 consensus_queue.cc:237] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.233357  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.235436  5083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:34.235641  5049 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.236941  5689 raft_consensus.cc:2804] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.237339  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9410663e6c48bf9ec25dc3b9c57805" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:34.237569  5689 raft_consensus.cc:697] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:34.238113  5086 raft_consensus.cc:3060] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.239454  5689 consensus_queue.cc:237] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:34.241581  5124 leader_election.cc:336] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.243538  5686 ts_tablet_manager.cc:1403] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.167s	user 0.036s	sys 0.013s
I20260709 13:17:34.246778  4975 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.246307  5123 leader_election.cc:304] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:34.246682  5049 leader_election.cc:304] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.248214  4975 leader_election.cc:304] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.248960  5485 raft_consensus.cc:515] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.250427  5509 raft_consensus.cc:2804] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.250872  5509 raft_consensus.cc:493] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.251121  5081 raft_consensus.cc:2393] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 561ca9eb1a1a4421b17518a3ff3725dc in current term 2: Already voted for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in this term.
I20260709 13:17:34.251255  5509 raft_consensus.cc:3060] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.251811  5648 raft_consensus.cc:2804] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.252398  5648 raft_consensus.cc:493] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.252909  5648 raft_consensus.cc:3060] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.256831  5691 raft_consensus.cc:2749] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.246475  5586 leader_election.cc:290] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.264483  5485 leader_election.cc:290] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.266073  5509 raft_consensus.cc:515] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.270007  5648 raft_consensus.cc:515] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.278079  5648 leader_election.cc:290] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:34.281751  5586 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.282560  5586 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:34.283631  5050 leader_election.cc:336] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
W20260709 13:17:34.291536  5124 leader_election.cc:336] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.292963  5509 leader_election.cc:290] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:34.294471  5586 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:34.295233  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:34.296142  5011 raft_consensus.cc:2468] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 1.
W20260709 13:17:34.296326  4976 leader_election.cc:336] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.297398  5123 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.299116  5690 raft_consensus.cc:2804] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.298924  5686 raft_consensus.cc:359] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.299587  5690 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.299757  5686 raft_consensus.cc:740] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.300125  5690 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:34.300796  4976 leader_election.cc:336] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
W20260709 13:17:34.303005  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 56416us
I20260709 13:17:34.302500  5086 raft_consensus.cc:2468] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:34.304607  5624 raft_consensus.cc:2749] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.300716  5686 consensus_queue.cc:260] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.308444  5686 ts_tablet_manager.cc:1434] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:17:34.309535  5686 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.309079  4833 catalog_manager.cc:5697] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.314507  5690 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.320973  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53aee4bd1aa94a5f9275d30815804a88" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:34.321681  5080 raft_consensus.cc:3060] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.330168  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:34.330987  5011 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.330909  5080 raft_consensus.cc:2468] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 2.
I20260709 13:17:34.331420  5690 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
W20260709 13:17:34.342357  5124 leader_election.cc:336] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.343674  5686 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.344777  5686 tablet_bootstrap.cc:492] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.352326  5686 ts_tablet_manager.cc:1403] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.002s
I20260709 13:17:34.347627  5011 raft_consensus.cc:2468] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:34.348320  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b51f860fd714a01b39a1a9fb6db5974" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:34.354035  5123 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.354147  5080 raft_consensus.cc:3060] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.355710  5686 raft_consensus.cc:359] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.356109  5690 raft_consensus.cc:2804] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.356792  5690 raft_consensus.cc:697] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:34.357743  5690 consensus_queue.cc:237] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.361254  5686 raft_consensus.cc:740] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.362170  5686 consensus_queue.cc:260] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.364351  5686 ts_tablet_manager.cc:1434] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:17:34.365236  5686 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.367995  5509 raft_consensus.cc:493] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.368067  4975 leader_election.cc:304] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:34.369690  5648 raft_consensus.cc:3060] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.378086  5648 raft_consensus.cc:2749] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.369211  5509 raft_consensus.cc:515] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.382529  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:34.383490  5158 raft_consensus.cc:2468] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:34.385212  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b80fa21498e64631ad2657c5021c55e1" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:34.386682  4975 leader_election.cc:304] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:34.392009  5648 raft_consensus.cc:2804] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.392447  5648 raft_consensus.cc:493] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.392863  5648 raft_consensus.cc:3060] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.396591  5509 leader_election.cc:290] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.397370  5012 raft_consensus.cc:2468] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 2.
I20260709 13:17:34.401973  5689 raft_consensus.cc:493] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.402619  5689 raft_consensus.cc:515] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.406514  5648 raft_consensus.cc:515] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.409232  5689 leader_election.cc:290] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.413619  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "418c40cbfa1e482bac10f761a5a39a30" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:34.414376  5159 raft_consensus.cc:3060] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.417521  5123 leader_election.cc:304] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.418460  5690 raft_consensus.cc:2804] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.418987  5690 raft_consensus.cc:697] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
W20260709 13:17:34.419425  5050 leader_election.cc:336] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.421439  5686 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.422452  5686 tablet_bootstrap.cc:492] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.421911  5690 consensus_queue.cc:237] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.423228  5686 ts_tablet_manager.cc:1403] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.011s
I20260709 13:17:34.424912  4975 leader_election.cc:304] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.425977  5509 raft_consensus.cc:2804] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.426703  5509 raft_consensus.cc:697] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:34.427670  5509 consensus_queue.cc:237] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:34.423918  4976 leader_election.cc:336] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.441942  5049 leader_election.cc:304] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.435417  5159 raft_consensus.cc:2468] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 2.
I20260709 13:17:34.447117  5689 raft_consensus.cc:2804] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.447876  5689 raft_consensus.cc:697] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:34.449154  5689 consensus_queue.cc:237] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.449492  5686 raft_consensus.cc:359] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.453433  5686 raft_consensus.cc:740] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.454389  5686 consensus_queue.cc:260] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.457724  4975 leader_election.cc:304] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:34.462814  5688 raft_consensus.cc:2804] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.476930  5080 raft_consensus.cc:2468] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 2.
I20260709 13:17:34.488323  5686 ts_tablet_manager.cc:1434] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.065s	user 0.012s	sys 0.000s
I20260709 13:17:34.462334  5648 leader_election.cc:290] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.495632  5688 raft_consensus.cc:697] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:34.497161  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:34.504441  5158 raft_consensus.cc:2468] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 1.
I20260709 13:17:34.506002  5686 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.504796  5688 consensus_queue.cc:237] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
W20260709 13:17:34.517385  4976 leader_election.cc:336] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.518306  4834 catalog_manager.cc:5697] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:34.546487  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 46631.2us
I20260709 13:17:34.547566  5049 leader_election.cc:304] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.549234  5590 raft_consensus.cc:2804] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:34.549616  5590 raft_consensus.cc:493] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:34.550024  5590 raft_consensus.cc:3060] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.562211  5590 raft_consensus.cc:515] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.573397  4975 leader_election.cc:304] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.574631  5688 raft_consensus.cc:2804] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.575536  5688 raft_consensus.cc:697] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
W20260709 13:17:34.576434  5050 leader_election.cc:336] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:34.576690  5688 consensus_queue.cc:237] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.580049  5590 leader_election.cc:290] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:34.581924  4832 catalog_manager.cc:5697] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 2 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.594884  5686 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.596065  5686 tablet_bootstrap.cc:492] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.595934  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89005842f7624652bbcd94368c089cb3" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:34.596710  5156 raft_consensus.cc:3060] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.596807  5686 ts_tablet_manager.cc:1403] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.016s
I20260709 13:17:34.599591  5686 raft_consensus.cc:359] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.600390  5686 raft_consensus.cc:740] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.601087  5686 consensus_queue.cc:260] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.603257  5686 ts_tablet_manager.cc:1434] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:34.604532  5686 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.606521  5156 raft_consensus.cc:2468] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 2.
I20260709 13:17:34.617055  5049 leader_election.cc:304] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:34.618170  5485 raft_consensus.cc:2804] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:34.617487  4833 catalog_manager.cc:5697] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.618759  5485 raft_consensus.cc:697] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:34.619736  4833 catalog_manager.cc:5697] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.619977  5485 consensus_queue.cc:237] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.636659  4834 catalog_manager.cc:5697] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.666631  4833 catalog_manager.cc:5697] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 2 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:34.669061  4833 catalog_manager.cc:5697] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 2 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.672300  5686 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.672941  4834 catalog_manager.cc:5697] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 1 to 2, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.677578  5686 tablet_bootstrap.cc:492] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.683125  5686 ts_tablet_manager.cc:1403] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.013s
I20260709 13:17:34.685959  5686 raft_consensus.cc:359] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.686640  5686 raft_consensus.cc:740] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.689394  5686 consensus_queue.cc:260] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.695371  5686 ts_tablet_manager.cc:1434] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:17:34.697456  5686 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.703186  5012 raft_consensus.cc:1275] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer c70fac7b468a4fa59ccb26ef6e6220f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.706218  5485 consensus_queue.cc:1048] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.743458  5686 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.744501  5686 tablet_bootstrap.cc:492] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.745157  5686 ts_tablet_manager.cc:1403] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.015s
I20260709 13:17:34.748545  5686 raft_consensus.cc:359] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.749327  5686 raft_consensus.cc:740] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.749951  5686 consensus_queue.cc:260] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.767366  5686 ts_tablet_manager.cc:1434] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:17:34.769181  5686 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:34.777957  5050 consensus_peers.cc:597] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.824635  5084 raft_consensus.cc:1275] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.826175  5693 consensus_queue.cc:1048] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:34.840018  5124 consensus_peers.cc:597] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.850086  5686 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.851272  5686 tablet_bootstrap.cc:492] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.852077  5686 ts_tablet_manager.cc:1403] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.084s	user 0.031s	sys 0.013s
I20260709 13:17:34.856626  5086 raft_consensus.cc:1275] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.857436  5686 raft_consensus.cc:359] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.858203  5686 raft_consensus.cc:740] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.858961  5686 consensus_queue.cc:260] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.861160  5686 ts_tablet_manager.cc:1434] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:17:34.862039  5686 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.867945  5690 consensus_queue.cc:1048] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.879356  5697 raft_consensus.cc:493] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.880159  5697 raft_consensus.cc:515] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.886907  5686 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.889424  5686 tablet_bootstrap.cc:492] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.890488  5686 ts_tablet_manager.cc:1403] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.009s
I20260709 13:17:34.892835  5697 leader_election.cc:290] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:34.893980  5686 raft_consensus.cc:359] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.895121  5686 raft_consensus.cc:740] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.896193  5686 consensus_queue.cc:260] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:34.898710  5686 ts_tablet_manager.cc:1434] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:34.900027  5686 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:34.905424  5124 consensus_peers.cc:597] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.928220  5686 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.929723  5686 tablet_bootstrap.cc:492] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.930992  5686 ts_tablet_manager.cc:1403] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:17:34.934315  5686 raft_consensus.cc:359] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.935353  5686 raft_consensus.cc:740] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.936352  5686 consensus_queue.cc:260] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:34.939558  5686 ts_tablet_manager.cc:1434] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:17:34.941365  5686 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:34.946979  5124 consensus_peers.cc:597] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:34.947191  5011 raft_consensus.cc:1275] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.948873  5693 consensus_queue.cc:1048] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:34.965905  5686 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.966867  5686 tablet_bootstrap.cc:492] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:34.967199  5084 raft_consensus.cc:1275] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:34.967470  5686 ts_tablet_manager.cc:1403] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.003s
I20260709 13:17:34.970858  5686 raft_consensus.cc:359] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.971696  5686 raft_consensus.cc:740] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:34.972506  5686 consensus_queue.cc:260] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:34.974732  5686 ts_tablet_manager.cc:1434] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:34.975558  5686 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:34.989694  5706 consensus_queue.cc:1048] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:34.998242  5686 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:34.999691  5686 tablet_bootstrap.cc:492] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.001154  5686 ts_tablet_manager.cc:1403] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.003s
I20260709 13:17:35.004873  5686 raft_consensus.cc:359] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.005577  5686 raft_consensus.cc:740] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.006289  5686 consensus_queue.cc:260] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.008656  5686 ts_tablet_manager.cc:1434] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:17:35.009917  5686 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:35.016073  5050 consensus_peers.cc:597] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.046665  4976 consensus_peers.cc:597] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:35.051537  5050 consensus_peers.cc:597] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.054772  5011 raft_consensus.cc:1275] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer c70fac7b468a4fa59ccb26ef6e6220f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.056990  5485 consensus_queue.cc:1048] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.063797  5697 raft_consensus.cc:493] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.064462  5697 raft_consensus.cc:515] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.067343  5697 leader_election.cc:290] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:35.079648  5154 raft_consensus.cc:1275] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.087155  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:35.096565  5686 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.097718  5686 tablet_bootstrap.cc:492] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.098433  5686 ts_tablet_manager.cc:1403] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.003s
W20260709 13:17:35.099856  4976 consensus_peers.cc:597] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.105050  5084 raft_consensus.cc:1275] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.109745  5686 raft_consensus.cc:359] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.110560  5686 raft_consensus.cc:740] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.111323  5156 raft_consensus.cc:1275] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer c70fac7b468a4fa59ccb26ef6e6220f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:35.111270  5686 consensus_queue.cc:260] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.113703  5686 ts_tablet_manager.cc:1434] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:17:35.113807  5706 consensus_queue.cc:1048] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:35.114640  5686 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.126178  5590 consensus_queue.cc:1048] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.175714  5688 consensus_queue.cc:1048] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:35.176241  5697 raft_consensus.cc:493] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.177101  5697 raft_consensus.cc:515] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.180368  5697 leader_election.cc:290] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:35.186862  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:35.188519  5050 consensus_peers.cc:597] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.188679  5697 raft_consensus.cc:493] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.188972  5686 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.189327  5697 raft_consensus.cc:515] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.190014  5686 tablet_bootstrap.cc:492] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.190963  5686 ts_tablet_manager.cc:1403] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.077s	user 0.037s	sys 0.023s
I20260709 13:17:35.191285  5697 leader_election.cc:290] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
W20260709 13:17:35.197335  4976 consensus_peers.cc:597] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:35.197860  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494c1d883684e3285f3d2e4ad7c0c97" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:35.199991  5697 raft_consensus.cc:493] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.200620  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:35.200817  5686 raft_consensus.cc:359] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.201226  5697 raft_consensus.cc:515] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.204533  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:35.209282  5124 consensus_peers.cc:597] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.209853  5124 consensus_peers.cc:597] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.203502  5697 leader_election.cc:290] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:35.201607  5686 raft_consensus.cc:740] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.211414  5686 consensus_queue.cc:260] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.214233  5686 ts_tablet_manager.cc:1434] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:17:35.215127  5686 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.226011  5697 raft_consensus.cc:493] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.226675  5697 raft_consensus.cc:515] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.229449  5697 leader_election.cc:290] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:35.232412  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:35.251999  5124 consensus_peers.cc:597] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.256923  5697 raft_consensus.cc:493] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.257879  5697 raft_consensus.cc:515] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:35.271339  5801 log.cc:927] Time spent T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:35.273689  5697 leader_election.cc:290] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:35.276540  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
W20260709 13:17:35.318675  5124 consensus_peers.cc:597] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.344497  5050 consensus_peers.cc:597] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.350587  5686 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.352188  5686 tablet_bootstrap.cc:492] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
W20260709 13:17:35.353288  5124 consensus_peers.cc:597] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.355401  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.355677  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f494c1d883684e3285f3d2e4ad7c0c97" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.357435  5686 ts_tablet_manager.cc:1403] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.143s	user 0.037s	sys 0.089s
I20260709 13:17:35.361011  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.361305  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d65fd895041c443299524ba293a442c5" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.363185  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.363507  5686 raft_consensus.cc:359] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:35.364212  5686 raft_consensus.cc:740] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.364593  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea73967d5ce4c81b9f43fc970d37f88" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.364902  5686 consensus_queue.cc:260] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:35.366122  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "769e6ebd88db4a45830d07ff3d7b6b12" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.367018  5686 ts_tablet_manager.cc:1434] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.002s
I20260709 13:17:35.367612  5678 leader_election.cc:304] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:35.367969  5686 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.368510  5697 raft_consensus.cc:2749] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.370261  5678 leader_election.cc:304] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.371847  5697 raft_consensus.cc:2749] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.371933  5678 leader_election.cc:304] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:35.373476  5697 raft_consensus.cc:2749] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.374886  5678 leader_election.cc:304] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.376358  5697 raft_consensus.cc:2749] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:35.377027  5050 consensus_peers.cc:597] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.377738  5678 leader_election.cc:304] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.378545  5697 raft_consensus.cc:2749] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.379884  5678 leader_election.cc:304] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:35.380656  5697 raft_consensus.cc:2749] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.381860  5678 leader_election.cc:304] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.382630  5697 raft_consensus.cc:2749] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:35.400149  4976 consensus_peers.cc:597] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.424021  4976 consensus_peers.cc:597] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.432392  5124 consensus_peers.cc:597] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.433771  5124 consensus_peers.cc:597] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.424553  4976 consensus_peers.cc:597] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.435400  4976 consensus_peers.cc:597] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.435880  4976 consensus_peers.cc:597] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.439004  5124 consensus_peers.cc:597] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.439589  5124 consensus_peers.cc:597] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.441089  5686 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.442310  5686 tablet_bootstrap.cc:492] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
W20260709 13:17:35.443032  4976 consensus_peers.cc:597] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.443084  5686 ts_tablet_manager.cc:1403] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.029s
W20260709 13:17:35.443753  4976 consensus_peers.cc:597] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:35.444305  4976 consensus_peers.cc:597] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.445233 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:36057
I20260709 13:17:35.445425  5814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:36057 every 8 connection(s)
I20260709 13:17:35.446412  5686 raft_consensus.cc:359] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.447259  5686 raft_consensus.cc:740] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.448154  5686 consensus_queue.cc:260] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.450453  5686 ts_tablet_manager.cc:1434] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:35.451305  5686 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.479339  5686 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.480451  5686 tablet_bootstrap.cc:492] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.481091  5686 ts_tablet_manager.cc:1403] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 13:17:35.483542  5686 raft_consensus.cc:359] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.484251  5686 raft_consensus.cc:740] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.485255  5686 consensus_queue.cc:260] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.487354  5686 ts_tablet_manager.cc:1434] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:35.488274  5686 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.498199  5816 heartbeater.cc:344] Connected to a master server at 127.29.5.190:33299
I20260709 13:17:35.498800  5816 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:35.499668  5816 heartbeater.cc:507] Master 127.29.5.190:33299 requested a full tablet report, sending...
I20260709 13:17:35.504695  5686 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.505877  5686 tablet_bootstrap.cc:492] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.506583  5686 ts_tablet_manager.cc:1403] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:17:35.509385  5686 raft_consensus.cc:359] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.510115  5686 raft_consensus.cc:740] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.510833  5686 consensus_queue.cc:260] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.513368  5686 ts_tablet_manager.cc:1434] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:17:35.514245  5686 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.520064  4834 ts_manager.cc:194] Re-registered known tserver with Master: 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:35.529621  5686 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.530414  5686 tablet_bootstrap.cc:492] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.530990  5686 ts_tablet_manager.cc:1403] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:17:35.533483  5686 raft_consensus.cc:359] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.534035  5686 raft_consensus.cc:740] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.534657  5686 consensus_queue.cc:260] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
W20260709 13:17:35.536000  5124 consensus_peers.cc:597] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.536512  5686 ts_tablet_manager.cc:1434] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:17:35.537232  5686 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:35.540542  5124 consensus_peers.cc:597] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.558817  4834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47982
I20260709 13:17:35.559316  5686 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.560326  5686 tablet_bootstrap.cc:492] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.560967  5686 ts_tablet_manager.cc:1403] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260709 13:17:35.563532  5686 raft_consensus.cc:359] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.563969  5816 heartbeater.cc:499] Master 127.29.5.190:33299 was elected leader, sending a full tablet report...
I20260709 13:17:35.564249  5686 raft_consensus.cc:740] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.564987  5686 consensus_queue.cc:260] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.567042  5686 ts_tablet_manager.cc:1434] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:17:35.567849  5686 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.584520  5686 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.585011  5763 raft_consensus.cc:3060] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.585530  5686 tablet_bootstrap.cc:492] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.586278  5686 ts_tablet_manager.cc:1403] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.001s
I20260709 13:17:35.588814  5686 raft_consensus.cc:359] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.589325  5686 raft_consensus.cc:740] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.589921  5686 consensus_queue.cc:260] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.591536  5686 ts_tablet_manager.cc:1434] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:35.592219  5686 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
W20260709 13:17:35.623462  4976 consensus_peers.cc:597] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.635630  5686 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.636596  5686 tablet_bootstrap.cc:492] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.637179  5686 ts_tablet_manager.cc:1403] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.045s	user 0.023s	sys 0.020s
I20260709 13:17:35.639647  5686 raft_consensus.cc:359] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.640333  5686 raft_consensus.cc:740] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.640997  5686 consensus_queue.cc:260] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.642967  5686 ts_tablet_manager.cc:1434] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:35.647490  5686 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.662091  5686 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.662840  5686 tablet_bootstrap.cc:492] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.663419  5686 ts_tablet_manager.cc:1403] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:17:35.665905  5686 raft_consensus.cc:359] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.666532  5686 raft_consensus.cc:740] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.667120  5686 consensus_queue.cc:260] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.669044  5686 ts_tablet_manager.cc:1434] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:17:35.669804  5686 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.677297  5764 raft_consensus.cc:3060] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.687038  5818 raft_consensus.cc:493] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.687597  5818 raft_consensus.cc:515] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.689639  5818 leader_election.cc:290] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:35.691854  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" is_pre_election: true
I20260709 13:17:35.694708  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d965e514c434894bda41987fdad0b73" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:35.695389  5818 raft_consensus.cc:493] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.696686  5818 raft_consensus.cc:515] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.698289  5678 leader_election.cc:304] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.699157  5697 raft_consensus.cc:2749] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.701496  5818 leader_election.cc:290] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:35.703533  5760 raft_consensus.cc:3060] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.703521  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:35.710776  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e735d761e3064ffa967bf9214069af1b" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
W20260709 13:17:35.715715  4976 consensus_peers.cc:597] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.720018  5763 raft_consensus.cc:3060] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.721940  5678 leader_election.cc:304] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.722895  5697 raft_consensus.cc:2749] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:35.730499  4976 consensus_peers.cc:597] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.731290  5686 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.732468  5686 tablet_bootstrap.cc:492] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.733165  5686 ts_tablet_manager.cc:1403] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.005s
I20260709 13:17:35.735601  5686 raft_consensus.cc:359] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.736294  5686 raft_consensus.cc:740] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.736950  5686 consensus_queue.cc:260] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.743396  5686 ts_tablet_manager.cc:1434] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:35.744230  5686 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.764369  5686 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.765117  5686 tablet_bootstrap.cc:492] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.765775  5686 ts_tablet_manager.cc:1403] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:17:35.767932  5686 raft_consensus.cc:359] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.768904  5686 raft_consensus.cc:740] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
W20260709 13:17:35.770886  4976 consensus_peers.cc:597] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:17:35.771469  5686 consensus_queue.cc:260] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:35.774091  5686 ts_tablet_manager.cc:1434] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:17:35.774763  5686 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.788959  5686 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.790102  5686 tablet_bootstrap.cc:492] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.790766  5686 ts_tablet_manager.cc:1403] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:17:35.793226  5686 raft_consensus.cc:359] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.794307  5686 raft_consensus.cc:740] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.794956  5686 consensus_queue.cc:260] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.797560  5686 ts_tablet_manager.cc:1434] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:35.799237  5686 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.818069  5686 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.819087  5686 tablet_bootstrap.cc:492] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.819851  5686 ts_tablet_manager.cc:1403] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:17:35.821803  5686 raft_consensus.cc:359] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.822450  5686 raft_consensus.cc:740] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.823164  5686 consensus_queue.cc:260] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.826535  5686 ts_tablet_manager.cc:1434] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:35.827211  5686 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.843966  5686 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.844962  5686 tablet_bootstrap.cc:492] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.845698  5686 ts_tablet_manager.cc:1403] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:17:35.848423  5686 raft_consensus.cc:359] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.849120  5686 raft_consensus.cc:740] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.849774  5686 consensus_queue.cc:260] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.852116  5686 ts_tablet_manager.cc:1434] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:35.852941  5686 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.875046  5686 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:35.876111  5686 tablet_bootstrap.cc:492] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:35.877208  5686 ts_tablet_manager.cc:1403] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:17:35.879172  5686 raft_consensus.cc:359] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.879685  5686 raft_consensus.cc:740] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:35.880298  5686 consensus_queue.cc:260] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.882117  5686 ts_tablet_manager.cc:1434] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.002s
I20260709 13:17:35.885444  5706 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.885612  5686 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:35.886072  5706 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:35.888336  5706 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:35.889535  5760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346" is_pre_election: true
I20260709 13:17:35.890343  5760 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 1.
I20260709 13:17:35.892362  5697 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.892469  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:35.893261  5159 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 2.
I20260709 13:17:35.893069  5697 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:35.895993  4975 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:35.897284  5794 raft_consensus.cc:2804] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:35.897697  5794 raft_consensus.cc:493] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.898082  5794 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:35.904624  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae" is_pre_election: true
I20260709 13:17:35.905752  5763 raft_consensus.cc:3060] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.906461  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" is_pre_election: true
I20260709 13:17:35.908106  5678 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346; no voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:35.910190  5760 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.895563  5697 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:35.910235  5818 raft_consensus.cc:2749] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:35.925992  5759 raft_consensus.cc:3060] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:35.930866  5794 raft_consensus.cc:515] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.013777  5758 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.025470  5159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:36.026429  5159 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.050216  5764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a71d181490848c0888d12dc4b65cc0d" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
I20260709 13:17:36.052603  5764 raft_consensus.cc:3060] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:36.060920  5159 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 3.
I20260709 13:17:36.062649  4975 leader_election.cc:304] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:36.065613  5509 raft_consensus.cc:2804] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:17:36.067376  5049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.132:34111, user_credentials={real_user=slave}} blocked reactor thread for 142618us
I20260709 13:17:36.065078  5794 leader_election.cc:290] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 3 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:36.101138  5509 raft_consensus.cc:697] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:36.145737  5509 consensus_queue.cc:237] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.173096  5764 raft_consensus.cc:2468] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 3.
I20260709 13:17:36.174243  5686 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.175375  5686 tablet_bootstrap.cc:492] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.176167  5686 ts_tablet_manager.cc:1403] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.291s	user 0.062s	sys 0.101s
I20260709 13:17:36.181659  5764 raft_consensus.cc:3060] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:36.182482  5686 raft_consensus.cc:359] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:36.186280  5686 raft_consensus.cc:740] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.187238  5686 consensus_queue.cc:260] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:36.190161  5686 ts_tablet_manager.cc:1434] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:17:36.196015  5686 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.248837  5686 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.249938  5686 tablet_bootstrap.cc:492] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.250727  5686 ts_tablet_manager.cc:1403] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.011s
I20260709 13:17:36.254202  5686 raft_consensus.cc:359] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.256198  5686 raft_consensus.cc:740] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.257275  5686 consensus_queue.cc:260] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.251161  4832 catalog_manager.cc:5697] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 1 to 3, leader changed from 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129) to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 3 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:36.264905  5686 ts_tablet_manager.cc:1434] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:17:36.266244  5686 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.349313  5686 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.350438  5686 tablet_bootstrap.cc:492] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.351150  5686 ts_tablet_manager.cc:1403] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.085s	user 0.028s	sys 0.010s
I20260709 13:17:36.354909  5686 raft_consensus.cc:359] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.355667  5686 raft_consensus.cc:740] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.356436  5686 consensus_queue.cc:260] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.361369  5686 ts_tablet_manager.cc:1434] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:17:36.362247  5686 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.377245  5686 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.378153  5686 tablet_bootstrap.cc:492] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.378989  5686 ts_tablet_manager.cc:1403] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:17:36.381623  5686 raft_consensus.cc:359] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.382311  5686 raft_consensus.cc:740] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.383401  5686 consensus_queue.cc:260] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.389407  5686 ts_tablet_manager.cc:1434] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:17:36.390209  5686 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.416484  5686 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.417397  5686 tablet_bootstrap.cc:492] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.417990  5686 ts_tablet_manager.cc:1403] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 13:17:36.420154  5686 raft_consensus.cc:359] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.420661  5686 raft_consensus.cc:740] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.421280  5686 consensus_queue.cc:260] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.423267  5686 ts_tablet_manager.cc:1434] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:36.424337  5686 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.440559  5686 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.441550  5686 tablet_bootstrap.cc:492] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.442296  5686 ts_tablet_manager.cc:1403] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:17:36.445037  5686 raft_consensus.cc:359] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.445680  5686 raft_consensus.cc:740] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.446303  5686 consensus_queue.cc:260] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.448573  5686 ts_tablet_manager.cc:1434] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:17:36.449576  5686 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.468564  5686 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.469305  5686 tablet_bootstrap.cc:492] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.469851  5686 ts_tablet_manager.cc:1403] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 13:17:36.475050  5686 raft_consensus.cc:359] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.475831  5686 raft_consensus.cc:740] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.477756  5686 consensus_queue.cc:260] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:36.480113  5686 ts_tablet_manager.cc:1434] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:17:36.481726  5686 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap starting.
I20260709 13:17:36.496932  5686 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:36.497892  5686 tablet_bootstrap.cc:492] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Bootstrap complete.
I20260709 13:17:36.498600  5686 ts_tablet_manager.cc:1403] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:17:36.501108  5686 raft_consensus.cc:359] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.501713  5686 raft_consensus.cc:740] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Initialized, Role: FOLLOWER
I20260709 13:17:36.502293  5686 consensus_queue.cc:260] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:36.504232  5686 ts_tablet_manager.cc:1434] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:17:36.653133  5764 raft_consensus.cc:1275] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:36.658710  5844 consensus_queue.cc:1048] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:36.670819  5156 raft_consensus.cc:1275] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:36.674575  5847 consensus_queue.cc:1048] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:45.475190 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:45.531710  5154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20b3651a051845f49844d453fa92f074"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:45.532445  5154 raft_consensus.cc:606] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.534977  5154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:45.535434  5154 raft_consensus.cc:606] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.539315  5154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:45.539924  5154 raft_consensus.cc:606] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.542744  5154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:45.543255  5154 raft_consensus.cc:606] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.546859  5156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:45.547344  5156 raft_consensus.cc:606] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.561189  5011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:45.561789  5011 raft_consensus.cc:606] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.574753  5081 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482"
dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:35590
I20260709 13:17:45.575390  5081 raft_consensus.cc:606] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:45.576822 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:17:45.578052 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:45.609493  5878 raft_consensus.cc:993] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.610155  5874 raft_consensus.cc:1081] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.611655  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:17:45.612171  5763 raft_consensus.cc:493] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.612485  5763 raft_consensus.cc:3060] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.618927  5763 raft_consensus.cc:515] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:45.622133  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:45.622901  5156 raft_consensus.cc:3055] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.623162  5763 leader_election.cc:290] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:45.623205  5156 raft_consensus.cc:740] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:45.624235  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281e91779b14462aa4fb6af62998cd20" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:45.624926  5011 raft_consensus.cc:3060] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.624589  5156 consensus_queue.cc:260] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:45.626120  5156 raft_consensus.cc:3060] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.633411  5011 raft_consensus.cc:2468] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.633872  5156 raft_consensus.cc:2468] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.634884  5678 leader_election.cc:304] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:45.636504  5889 raft_consensus.cc:2804] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.637676  5889 raft_consensus.cc:697] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:45.638648  5889 consensus_queue.cc:237] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:45.648942  4835 catalog_manager.cc:5697] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.762681  5874 raft_consensus.cc:993] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.763177  5878 raft_consensus.cc:1081] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.764864  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:17:45.765379  5760 raft_consensus.cc:493] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.765718  5760 raft_consensus.cc:3060] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.772837  5760 raft_consensus.cc:515] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:45.774474  5760 leader_election.cc:290] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:45.775358  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:45.775574  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a60d1eac4c774fa9b9d2d947403a30c2" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:45.776042  5081 raft_consensus.cc:3060] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.776096  5156 raft_consensus.cc:3055] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.776563  5156 raft_consensus.cc:740] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:45.777474  5156 consensus_queue.cc:260] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:45.778813  5156 raft_consensus.cc:3060] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.785576  5081 raft_consensus.cc:2468] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.786659  5156 raft_consensus.cc:2468] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.787139  5678 leader_election.cc:304] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:45.788098  5889 raft_consensus.cc:2804] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.788611  5889 raft_consensus.cc:697] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:45.789505  5889 consensus_queue.cc:237] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:45.799057  4835 catalog_manager.cc:5697] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.854982  5878 raft_consensus.cc:993] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.855446  5878 raft_consensus.cc:1081] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.856796  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20b3651a051845f49844d453fa92f074"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:17:45.857197  5760 raft_consensus.cc:493] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.857463  5760 raft_consensus.cc:3060] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.864127  5760 raft_consensus.cc:515] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:45.865680  5760 leader_election.cc:290] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:45.866703  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b3651a051845f49844d453fa92f074" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:45.867000  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20b3651a051845f49844d453fa92f074" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:45.867266  5156 raft_consensus.cc:3055] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.867604  5006 raft_consensus.cc:3060] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.867604  5156 raft_consensus.cc:740] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:45.868707  5156 consensus_queue.cc:260] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:45.869841  5156 raft_consensus.cc:3060] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.874420  5884 raft_consensus.cc:993] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.874966  5884 raft_consensus.cc:1081] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.876664  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41236
I20260709 13:17:45.876880  5156 raft_consensus.cc:2468] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.877210  5763 raft_consensus.cc:493] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.877583  5763 raft_consensus.cc:3060] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.878135  5678 leader_election.cc:304] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:45.879040  5889 raft_consensus.cc:2804] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.879520  5889 raft_consensus.cc:697] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:45.880443  5889 consensus_queue.cc:237] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:45.884388  5763 raft_consensus.cc:515] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:45.886476  5763 leader_election.cc:290] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:45.887086  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:45.887687  5011 raft_consensus.cc:3060] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.887822  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d49d805bf2f2496ba8e8f3db24871482" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:45.888453  5081 raft_consensus.cc:3055] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.888747  5081 raft_consensus.cc:740] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:45.889617  5081 consensus_queue.cc:260] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:45.890949  5081 raft_consensus.cc:3060] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.895181  5011 raft_consensus.cc:2468] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.895761  5006 raft_consensus.cc:2468] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.897126  5678 leader_election.cc:304] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:45.897961  5081 raft_consensus.cc:2468] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.898137  5890 raft_consensus.cc:2804] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.900365  5890 raft_consensus.cc:697] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:45.901213  5890 consensus_queue.cc:237] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:45.903111  5874 raft_consensus.cc:993] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.903640  5878 raft_consensus.cc:1081] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.905371  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:17:45.905977  5763 raft_consensus.cc:493] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.906358  5763 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.913053  5763 raft_consensus.cc:515] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:45.914978  5763 leader_election.cc:290] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 3 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:45.916029  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:45.916620  5156 raft_consensus.cc:3055] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:45.916936  5156 raft_consensus.cc:740] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:45.917268  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23abed59564b473b8104457c3f04dbd1" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:45.917933  5081 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.917783  5156 consensus_queue.cc:260] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:45.918954  5156 raft_consensus.cc:3060] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.918315  4835 catalog_manager.cc:5697] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.920461  4835 catalog_manager.cc:5697] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:45.928978  5081 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 3.
I20260709 13:17:45.931948  5678 leader_election.cc:304] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:45.932943  5890 raft_consensus.cc:2804] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:45.932802  5156 raft_consensus.cc:2468] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 3.
I20260709 13:17:45.933578  5890 raft_consensus.cc:697] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:45.934655  5890 consensus_queue.cc:237] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:45.947309  4835 catalog_manager.cc:5697] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 2 to 3, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 3 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:45.963660  5877 raft_consensus.cc:993] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.964223  5509 raft_consensus.cc:1081] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:45.965581  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:45.966053  5760 raft_consensus.cc:493] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:45.966375  5760 raft_consensus.cc:3060] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.971972  5760 raft_consensus.cc:515] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:45.974275  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:45.974807  5006 raft_consensus.cc:3055] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:45.975054  5006 raft_consensus.cc:740] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:45.975744  5006 consensus_queue.cc:260] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:45.976135  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba09625c6e454229af67996d21b2d4dc" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:45.976680  5006 raft_consensus.cc:3060] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.976749  5081 raft_consensus.cc:3060] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.981284  5760 leader_election.cc:290] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:45.984272  5081 raft_consensus.cc:2468] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.984477  5006 raft_consensus.cc:2468] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:45.985462  5678 leader_election.cc:304] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:45.986313  5890 raft_consensus.cc:2804] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:45.986783  5890 raft_consensus.cc:697] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:45.987630  5890 consensus_queue.cc:237] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } }
I20260709 13:17:45.997601  4835 catalog_manager.cc:5697] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.016275  5878 raft_consensus.cc:993] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.016781  5874 raft_consensus.cc:1081] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.018078  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:17:46.018493  5760 raft_consensus.cc:493] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.018748  5760 raft_consensus.cc:3060] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.025045  5760 raft_consensus.cc:515] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:46.027462  5081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:46.028355  5081 raft_consensus.cc:3060] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.028575  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f70c10d7c4ab0aac5333f93491029" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:46.029174  5156 raft_consensus.cc:3055] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.029453  5156 raft_consensus.cc:740] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:46.030176  5156 consensus_queue.cc:260] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:46.031565  5156 raft_consensus.cc:3060] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.036860  5760 leader_election.cc:290] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:46.039511  5081 raft_consensus.cc:2468] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.039366  5156 raft_consensus.cc:2468] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.041196  5678 leader_election.cc:304] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:46.042045  5890 raft_consensus.cc:2804] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.042512  5890 raft_consensus.cc:697] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:46.043395  5890 consensus_queue.cc:237] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:46.053045  4835 catalog_manager.cc:5697] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.103547  5006 raft_consensus.cc:1275] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.104789  5890 consensus_queue.cc:1048] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.116143  5154 raft_consensus.cc:1275] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.117627  5890 consensus_queue.cc:1048] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.194227  5156 raft_consensus.cc:1275] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.196203  5890 consensus_queue.cc:1048] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.207379  5081 raft_consensus.cc:1275] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.210937  5898 consensus_queue.cc:1048] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:46.282655  5011 raft_consensus.cc:1275] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.284065  5898 consensus_queue.cc:1048] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.298327  5080 raft_consensus.cc:1275] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.300879  5889 consensus_queue.cc:1048] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.323529  5011 raft_consensus.cc:1275] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.324976  5889 consensus_queue.cc:1048] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.339162  5154 raft_consensus.cc:1275] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.340476  5889 consensus_queue.cc:1048] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.407225  5080 raft_consensus.cc:1275] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.408399  5889 consensus_queue.cc:1048] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.418066  5154 raft_consensus.cc:1275] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:46.420068  5898 consensus_queue.cc:1048] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:46.426460  5080 raft_consensus.cc:1275] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.428028  5890 consensus_queue.cc:1048] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:46.439852  5011 raft_consensus.cc:1275] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.442955  5889 consensus_queue.cc:1048] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.579135 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.597050  5080 raft_consensus.cc:1275] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.598320  5890 consensus_queue.cc:1048] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.608400  5154 raft_consensus.cc:1275] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:46.611310  5898 consensus_queue.cc:1048] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:46.631004 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.671017  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:46.671511  5012 raft_consensus.cc:606] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:46.673938  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597b56d5b0084f239a472638315fdb19"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:46.674360  5012 raft_consensus.cc:606] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:46.676379  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "896e123c38644e439ea2de7c32690f10"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:46.676782  5012 raft_consensus.cc:606] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:46.679028  5080 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5"
dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
mode: GRACEFUL
new_leader_uuid: "546aee349d8547699b9d86b3640f5aae"
 from {username='slave'} at 127.0.0.1:35590
I20260709 13:17:46.679551  5080 raft_consensus.cc:606] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Received request to transfer leadership to TS 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:46.681982  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:46.682423  5012 raft_consensus.cc:606] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:46.684881  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:46.685305  5012 raft_consensus.cc:606] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:46.686425 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:46.687683 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:46.746275  5914 raft_consensus.cc:993] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.746805  5509 raft_consensus.cc:1081] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.748107  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:46.748518  5760 raft_consensus.cc:493] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.748860  5760 raft_consensus.cc:3060] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.755250  5760 raft_consensus.cc:515] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.757761  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:46.758386  5154 raft_consensus.cc:3060] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.758388  5760 leader_election.cc:290] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:46.759028  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac4779ad927429881b9f59f0f356abb" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:46.759686  5012 raft_consensus.cc:3055] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.762336  5012 raft_consensus.cc:740] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:46.764747  5012 consensus_queue.cc:260] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.766120  5012 raft_consensus.cc:3060] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.768211  5154 raft_consensus.cc:2468] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.769475  5678 leader_election.cc:304] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:46.771279  5923 raft_consensus.cc:2804] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.771723  5923 raft_consensus.cc:697] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:46.772584  5923 consensus_queue.cc:237] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.775022  5012 raft_consensus.cc:2468] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.785907  4832 catalog_manager.cc:5697] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.869143  5509 raft_consensus.cc:993] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.869585  5877 raft_consensus.cc:1081] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.870913  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "597b56d5b0084f239a472638315fdb19"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:46.871415  5760 raft_consensus.cc:493] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.871649  5760 raft_consensus.cc:3060] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.877508  5760 raft_consensus.cc:515] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.879168  5760 leader_election.cc:290] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:46.880110  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:46.880505  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597b56d5b0084f239a472638315fdb19" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:46.880829  5154 raft_consensus.cc:3060] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.881160  5012 raft_consensus.cc:3055] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.881467  5012 raft_consensus.cc:740] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:46.882308  5012 consensus_queue.cc:260] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.883312  5012 raft_consensus.cc:3060] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.885882  5154 raft_consensus.cc:2468] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.887141  5678 leader_election.cc:304] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:46.888017  5898 raft_consensus.cc:2804] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.888419  5012 raft_consensus.cc:2468] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.888465  5898 raft_consensus.cc:697] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:46.889559  5898 consensus_queue.cc:237] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.898779  4832 catalog_manager.cc:5697] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.919955  5509 raft_consensus.cc:993] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.920492  5877 raft_consensus.cc:1081] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:46.921867  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:46.922250  5760 raft_consensus.cc:493] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.922477  5760 raft_consensus.cc:3060] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.927227  5760 raft_consensus.cc:515] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.928706  5760 leader_election.cc:290] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:46.929394  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:46.929797  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "408af3f61ed34eed834a306bc4e6a465" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:46.930096  5154 raft_consensus.cc:3060] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.930377  5012 raft_consensus.cc:3055] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.930714  5012 raft_consensus.cc:740] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:46.931360  5012 consensus_queue.cc:260] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.932360  5012 raft_consensus.cc:3060] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.935283  5154 raft_consensus.cc:2468] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.936259  5678 leader_election.cc:304] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:46.937155  5898 raft_consensus.cc:2804] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.937237  5012 raft_consensus.cc:2468] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:46.937660  5898 raft_consensus.cc:697] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:46.938550  5898 consensus_queue.cc:237] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:46.949882  4832 catalog_manager.cc:5697] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:46.961024  5900 raft_consensus.cc:993] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: : Instructing follower 546aee349d8547699b9d86b3640f5aae to start an election
I20260709 13:17:46.961423  5884 raft_consensus.cc:1081] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Signalling peer 546aee349d8547699b9d86b3640f5aae to start an election
I20260709 13:17:46.962728  5154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
 from {username='slave'} at 127.0.0.1:44334
I20260709 13:17:46.963137  5154 raft_consensus.cc:493] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:46.963402  5154 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.969244  5154 raft_consensus.cc:515] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:46.971705  5154 leader_election.cc:290] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:46.972419  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:46.972484  5080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:46.973212  5012 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.973263  5080 raft_consensus.cc:3055] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:46.973686  5080 raft_consensus.cc:740] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:46.974373  5080 consensus_queue.cc:260] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:46.975576  5080 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:46.979748  5012 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:46.981070  5123 leader_election.cc:304] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:46.981802  5878 raft_consensus.cc:2804] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:46.982230  5878 raft_consensus.cc:697] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:46.983047  5878 consensus_queue.cc:237] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:46.984483  5080 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:46.991477  4832 catalog_manager.cc:5697] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 1 to 2, leader changed from c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131) to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.021351  5509 raft_consensus.cc:993] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:47.021955  5877 raft_consensus.cc:1081] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:47.023276  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "896e123c38644e439ea2de7c32690f10"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:47.023840  5760 raft_consensus.cc:493] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.024204  5760 raft_consensus.cc:3060] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.030763  5760 raft_consensus.cc:515] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:47.032442  5760 leader_election.cc:290] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:47.033095  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:47.033833  5012 raft_consensus.cc:3055] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.034252  5012 raft_consensus.cc:740] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:47.034562  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896e123c38644e439ea2de7c32690f10" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:47.035223  5154 raft_consensus.cc:3060] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.035218  5012 consensus_queue.cc:260] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:47.036893  5012 raft_consensus.cc:3060] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.042814  5154 raft_consensus.cc:2468] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:47.044317  5678 leader_election.cc:304] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:47.045104  5890 raft_consensus.cc:2804] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.045667  5890 raft_consensus.cc:697] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:47.046698  5890 consensus_queue.cc:237] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:47.047655  5012 raft_consensus.cc:2468] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:47.072757  4832 catalog_manager.cc:5697] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.247956  5914 raft_consensus.cc:993] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:47.248442  5877 raft_consensus.cc:1081] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:47.249745  5763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:47.250206  5763 raft_consensus.cc:493] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.250485  5763 raft_consensus.cc:3060] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.256412  5763 raft_consensus.cc:515] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:47.258198  5763 leader_election.cc:290] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:47.258726  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:47.259380  5154 raft_consensus.cc:3060] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.259260  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e110c0e66ae646dbba07c2ca28fd5631" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:47.260504  5012 raft_consensus.cc:3055] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.260867  5012 raft_consensus.cc:740] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:47.261757  5012 consensus_queue.cc:260] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:47.262934  5012 raft_consensus.cc:3060] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.266336  5154 raft_consensus.cc:2468] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:47.267454  5678 leader_election.cc:304] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:47.268258  5923 raft_consensus.cc:2804] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.268746  5923 raft_consensus.cc:697] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:47.269629  5923 consensus_queue.cc:237] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:47.272317  5012 raft_consensus.cc:2468] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:47.279577  4832 catalog_manager.cc:5697] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.289006  5012 raft_consensus.cc:1275] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.290089  5923 consensus_queue.cc:1048] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.303357  5154 raft_consensus.cc:1275] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.304044  5156 raft_consensus.cc:1275] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.305905  5923 consensus_queue.cc:1048] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.307616  5898 consensus_queue.cc:1048] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.333079  5011 raft_consensus.cc:1275] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.334492  5889 consensus_queue.cc:1048] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.373083  5156 raft_consensus.cc:1275] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.374370  5923 consensus_queue.cc:1048] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.387225  5011 raft_consensus.cc:1275] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.391366  5923 consensus_queue.cc:1048] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.458779  5011 raft_consensus.cc:1275] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.460086  5889 consensus_queue.cc:1048] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.469647  5154 raft_consensus.cc:1275] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.471796  5898 consensus_queue.cc:1048] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.529970  5011 raft_consensus.cc:1275] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.531553  5878 consensus_queue.cc:1048] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.540658  5086 raft_consensus.cc:1275] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.542121  5874 consensus_queue.cc:1048] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.688690 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.725255 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:47.764001  5154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:47.764505  5154 raft_consensus.cc:606] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Received request to transfer leadership to TS c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:47.767258  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0550850ae264c03b931a289b670c061"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:47.767881  5012 raft_consensus.cc:606] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:47.769006 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:47.770131 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:47.831614  5914 raft_consensus.cc:993] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:47.832300  5877 raft_consensus.cc:1081] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:47.833555  5760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0550850ae264c03b931a289b670c061"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41212
I20260709 13:17:47.834055  5760 raft_consensus.cc:493] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:47.834332  5760 raft_consensus.cc:3060] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.839986  5760 raft_consensus.cc:515] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:47.841475  5012 raft_consensus.cc:1275] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.841802  5760 leader_election.cc:290] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:47.842875  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0550850ae264c03b931a289b670c061" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:47.842918  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0550850ae264c03b931a289b670c061" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:47.842985  5923 consensus_queue.cc:1048] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:47.843698  5154 raft_consensus.cc:3060] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.843823  5012 raft_consensus.cc:3055] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:47.845445  5012 raft_consensus.cc:740] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:47.846320  5012 consensus_queue.cc:260] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:47.847709  5012 raft_consensus.cc:3060] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:47.850419  5154 raft_consensus.cc:2468] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:47.851647  5678 leader_election.cc:304] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:47.852429  5923 raft_consensus.cc:2804] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:47.852919  5923 raft_consensus.cc:697] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:47.853749  5923 consensus_queue.cc:237] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:47.854905  5012 raft_consensus.cc:2468] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 2.
I20260709 13:17:47.865921  5154 raft_consensus.cc:1275] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:47.868394  5890 consensus_queue.cc:1048] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:47.869684  4835 catalog_manager.cc:5697] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.057979  5874 raft_consensus.cc:993] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower c70fac7b468a4fa59ccb26ef6e6220f6 to start an election
I20260709 13:17:48.058457  5956 raft_consensus.cc:1081] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Signalling peer c70fac7b468a4fa59ccb26ef6e6220f6 to start an election
I20260709 13:17:48.060195  5080 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5"
dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
 from {username='slave'} at 127.0.0.1:55972
I20260709 13:17:48.060771  5080 raft_consensus.cc:493] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:48.061152  5080 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.067480  5080 raft_consensus.cc:515] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:48.069976  5080 leader_election.cc:290] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 3 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:48.070593  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:48.071206  5011 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.071534  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969b73f3d2bc408aafcf19ab23755ee5" candidate_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:48.072129  5154 raft_consensus.cc:3055] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:48.072425  5154 raft_consensus.cc:740] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:48.073113  5154 consensus_queue.cc:260] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:48.074226  5154 raft_consensus.cc:3060] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.078011  5011 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 3.
I20260709 13:17:48.079306  5049 leader_election.cc:304] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:48.080143  5933 raft_consensus.cc:2804] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:48.080615  5933 raft_consensus.cc:697] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 LEADER]: Becoming Leader. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:48.080832  5154 raft_consensus.cc:2468] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c70fac7b468a4fa59ccb26ef6e6220f6 in term 3.
I20260709 13:17:48.081462  5933 consensus_queue.cc:237] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:48.095642  4835 catalog_manager.cc:5697] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 reported cstate change: term changed from 2 to 3, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.259932  5156 raft_consensus.cc:1275] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.261111  5889 consensus_queue.cc:1048] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.272868  5011 raft_consensus.cc:1275] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:48.274937  5889 consensus_queue.cc:1048] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:48.474160  5156 raft_consensus.cc:1275] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Refusing update from remote peer c70fac7b468a4fa59ccb26ef6e6220f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.475517  5884 consensus_queue.cc:1048] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.487015  5012 raft_consensus.cc:1275] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Refusing update from remote peer c70fac7b468a4fa59ccb26ef6e6220f6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:48.494585  5933 consensus_queue.cc:1048] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:48.771108 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.809657 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.846309  5086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838"
dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
mode: GRACEFUL
new_leader_uuid: "546aee349d8547699b9d86b3640f5aae"
 from {username='slave'} at 127.0.0.1:35590
I20260709 13:17:48.846844  5086 raft_consensus.cc:606] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Received request to transfer leadership to TS 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:48.848439 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:48.849623 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:49.372548  5960 raft_consensus.cc:993] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: : Instructing follower 546aee349d8547699b9d86b3640f5aae to start an election
I20260709 13:17:49.373157  5960 raft_consensus.cc:1081] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Signalling peer 546aee349d8547699b9d86b3640f5aae to start an election
I20260709 13:17:49.375726  5154 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
 from {username='slave'} at 127.0.0.1:44334
I20260709 13:17:49.376257  5154 raft_consensus.cc:493] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.376567  5154 raft_consensus.cc:3060] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.381507  5154 raft_consensus.cc:515] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:49.383292  5154 leader_election.cc:290] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:49.384029  5011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:49.384459  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1034335eb97407db28e1bb34a99a838" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:49.384601  5011 raft_consensus.cc:3060] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.386528  5086 raft_consensus.cc:3055] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:49.386865  5086 raft_consensus.cc:740] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c70fac7b468a4fa59ccb26ef6e6220f6, State: Running, Role: LEADER
I20260709 13:17:49.387633  5086 consensus_queue.cc:260] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:49.388893  5086 raft_consensus.cc:3060] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:49.391525  5011 raft_consensus.cc:2468] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:49.392807  5123 leader_election.cc:304] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, 561ca9eb1a1a4421b17518a3ff3725dc; no voters: 
I20260709 13:17:49.393895  5964 raft_consensus.cc:2804] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:49.394436  5964 raft_consensus.cc:697] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:49.395908  5086 raft_consensus.cc:2468] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:49.395648  5964 consensus_queue.cc:237] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:49.409036  4835 catalog_manager.cc:5697] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 1 to 2, leader changed from c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131) to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.787719  5011 raft_consensus.cc:1275] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.789008  5874 consensus_queue.cc:1048] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.800019  5080 raft_consensus.cc:1275] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:49.801455  5874 consensus_queue.cc:1048] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:49.850562 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.901170 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.938526  5156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:49.939041  5156 raft_consensus.cc:606] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Received request to transfer leadership to TS 561ca9eb1a1a4421b17518a3ff3725dc
I20260709 13:17:49.940317 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:49.941687 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:50.124511  5964 raft_consensus.cc:993] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 561ca9eb1a1a4421b17518a3ff3725dc to start an election
I20260709 13:17:50.125123  5973 raft_consensus.cc:1081] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Signalling peer 561ca9eb1a1a4421b17518a3ff3725dc to start an election
I20260709 13:17:50.126677  5011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
 from {username='slave'} at 127.0.0.1:34566
I20260709 13:17:50.127254  5011 raft_consensus.cc:493] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:50.127631  5011 raft_consensus.cc:3060] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.132840  5011 raft_consensus.cc:515] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:50.134703  5011 leader_election.cc:290] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Requested vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111)
I20260709 13:17:50.136040  5156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:50.136068  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2357ff63d6a543a8bb0105adfdd10a8e" candidate_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:50.136917  5086 raft_consensus.cc:3060] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.136816  5156 raft_consensus.cc:3055] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:50.138039  5156 raft_consensus.cc:740] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:50.138940  5156 consensus_queue.cc:260] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:50.140367  5156 raft_consensus.cc:3060] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:50.145969  5086 raft_consensus.cc:2468] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 2.
I20260709 13:17:50.147163  4975 leader_election.cc:304] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:50.147290  5156 raft_consensus.cc:2468] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 561ca9eb1a1a4421b17518a3ff3725dc in term 2.
I20260709 13:17:50.147863  5914 raft_consensus.cc:2804] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:50.148301  5914 raft_consensus.cc:697] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Becoming Leader. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:50.149081  5914 consensus_queue.cc:237] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:50.158078  4832 catalog_manager.cc:5697] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc reported cstate change: term changed from 1 to 2, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130). New cstate: current_term: 2 leader_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.557010  5156 raft_consensus.cc:1275] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:50.558301  5877 consensus_queue.cc:1048] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:50.568398  5086 raft_consensus.cc:1275] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 561ca9eb1a1a4421b17518a3ff3725dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:50.573177  5877 consensus_queue.cc:1048] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:50.942684 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.001834 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.044631  5012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db"
dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
mode: GRACEFUL
new_leader_uuid: "546aee349d8547699b9d86b3640f5aae"
 from {username='slave'} at 127.0.0.1:33686
I20260709 13:17:51.045224  5012 raft_consensus.cc:606] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Received request to transfer leadership to TS 546aee349d8547699b9d86b3640f5aae
I20260709 13:17:51.046667 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:51.048499 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:51.402211  5989 raft_consensus.cc:993] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: : Instructing follower 546aee349d8547699b9d86b3640f5aae to start an election
I20260709 13:17:51.402774  5989 raft_consensus.cc:1081] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Signalling peer 546aee349d8547699b9d86b3640f5aae to start an election
I20260709 13:17:51.404604  5156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
 from {username='slave'} at 127.0.0.1:44340
I20260709 13:17:51.405131  5156 raft_consensus.cc:493] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:51.405543  5156 raft_consensus.cc:3060] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.412580  5156 raft_consensus.cc:515] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:51.414565  5156 leader_election.cc:290] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Requested vote from peers 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371), c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459)
I20260709 13:17:51.415294  5012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:51.415933  5012 raft_consensus.cc:3055] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:51.415665  5086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e840ef3c7b6a42b2a98b08ea3eb6b0db" candidate_uuid: "546aee349d8547699b9d86b3640f5aae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6"
I20260709 13:17:51.416251  5012 raft_consensus.cc:740] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 561ca9eb1a1a4421b17518a3ff3725dc, State: Running, Role: LEADER
I20260709 13:17:51.416473  5086 raft_consensus.cc:3060] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.417237  5012 consensus_queue.cc:260] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:51.418627  5012 raft_consensus.cc:3060] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:51.423185  5086 raft_consensus.cc:2468] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:51.424662  5123 leader_election.cc:304] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae, c70fac7b468a4fa59ccb26ef6e6220f6; no voters: 
I20260709 13:17:51.425729  5973 raft_consensus.cc:2804] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:51.426204  5973 raft_consensus.cc:697] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Leader. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:51.427052  5012 raft_consensus.cc:2468] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 546aee349d8547699b9d86b3640f5aae in term 2.
I20260709 13:17:51.427032  5973 consensus_queue.cc:237] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } }
I20260709 13:17:51.440804  4835 catalog_manager.cc:5697] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae reported cstate change: term changed from 1 to 2, leader changed from 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130) to 546aee349d8547699b9d86b3640f5aae (127.29.5.132). New cstate: current_term: 2 leader_uuid: "546aee349d8547699b9d86b3640f5aae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.905783  5011 raft_consensus.cc:1275] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.907958  5973 consensus_queue.cc:1048] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:51.923468  5086 raft_consensus.cc:1275] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Refusing update from remote peer 546aee349d8547699b9d86b3640f5aae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:51.928905  6002 consensus_queue.cc:1048] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [LEADER]: Connected to new peer: Peer: permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:52.049572 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.122702 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:52.161935  5156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7"
dest_uuid: "546aee349d8547699b9d86b3640f5aae"
mode: GRACEFUL
new_leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:47536
I20260709 13:17:52.162633  5156 raft_consensus.cc:606] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Received request to transfer leadership to TS 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:52.163970 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:17:52.165153 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:52.563869  6002 raft_consensus.cc:993] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: : Instructing follower 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:52.564440  6001 raft_consensus.cc:1081] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Signalling peer 7e2c2c6ff9224614b4b24e53c472d346 to start an election
I20260709 13:17:52.566282  5764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7"
dest_uuid: "7e2c2c6ff9224614b4b24e53c472d346"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:17:52.566823  5764 raft_consensus.cc:493] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:52.567217  5764 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.572656  5764 raft_consensus.cc:515] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:52.574648  5764 leader_election.cc:290] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 3 election: Requested vote from peers 546aee349d8547699b9d86b3640f5aae (127.29.5.132:34111), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:52.575376  5154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "546aee349d8547699b9d86b3640f5aae"
I20260709 13:17:52.576068  5154 raft_consensus.cc:3055] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.576146  5006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780f1c1303f94a6d8b8b407d2392d1e7" candidate_uuid: "7e2c2c6ff9224614b4b24e53c472d346" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "561ca9eb1a1a4421b17518a3ff3725dc"
I20260709 13:17:52.576460  5154 raft_consensus.cc:740] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 546aee349d8547699b9d86b3640f5aae, State: Running, Role: LEADER
I20260709 13:17:52.576848  5006 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.577327  5154 consensus_queue.cc:260] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:52.578408  5154 raft_consensus.cc:3060] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.582986  5006 raft_consensus.cc:2468] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 3.
I20260709 13:17:52.583431  5154 raft_consensus.cc:2468] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e2c2c6ff9224614b4b24e53c472d346 in term 3.
I20260709 13:17:52.584102  5678 leader_election.cc:304] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346; no voters: 
I20260709 13:17:52.584900  5996 raft_consensus.cc:2804] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.585444  5996 raft_consensus.cc:697] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 LEADER]: Becoming Leader. State: Replica: 7e2c2c6ff9224614b4b24e53c472d346, State: Running, Role: LEADER
I20260709 13:17:52.586253  5996 consensus_queue.cc:237] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:52.597043  4832 catalog_manager.cc:5697] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 reported cstate change: term changed from 2 to 3, leader changed from 546aee349d8547699b9d86b3640f5aae (127.29.5.132) to 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129). New cstate: current_term: 3 leader_uuid: "7e2c2c6ff9224614b4b24e53c472d346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.121904  5154 raft_consensus.cc:1275] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:53.123234  5890 consensus_queue.cc:1048] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.141835  5006 raft_consensus.cc:1275] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Refusing update from remote peer 7e2c2c6ff9224614b4b24e53c472d346: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:53.143646  6010 consensus_queue.cc:1048] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:53.166062 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.212347 29718 tablet_server.cc:179] TabletServer@127.29.5.129:36057 shutting down...
W20260709 13:17:53.226267  5124 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 239 similar messages]
W20260709 13:17:53.230631  5124 consensus_peers.cc:597] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.234366  5050 consensus_peers.cc:597] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.253683  4976 consensus_peers.cc:597] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.258145  4976 consensus_peers.cc:597] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.258224 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.259310 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.260182 29718 raft_consensus.cc:2243] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:17:53.260370  5124 consensus_peers.cc:597] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.261049 29718 raft_consensus.cc:2272] T b0550850ae264c03b931a289b670c061 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.263500 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.264359 29718 raft_consensus.cc:2243] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.265632 29718 raft_consensus.cc:2272] T ac3f70c10d7c4ab0aac5333f93491029 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.267481  4976 consensus_peers.cc:597] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.268013 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.269220 29718 raft_consensus.cc:2243] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.269726 29718 raft_consensus.cc:2272] T be904dd9747941818620fdde5b5e8dd8 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.272496 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.273025 29718 raft_consensus.cc:2243] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.273418 29718 raft_consensus.cc:2272] T bb728a4f28ed48c082e7f2d65155bd4c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.275362 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.276017 29718 raft_consensus.cc:2243] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.276710 29718 raft_consensus.cc:2272] T 20b3651a051845f49844d453fa92f074 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.278578 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.279203 29718 raft_consensus.cc:2243] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.279680 29718 raft_consensus.cc:2272] T 453a7f2f432e4b6d83de031143ba6238 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.282338 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.282863 29718 raft_consensus.cc:2243] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.283246 29718 raft_consensus.cc:2272] T 15cb77576c214fada45083baabff5c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.285712 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.286269 29718 raft_consensus.cc:2243] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.286653 29718 raft_consensus.cc:2272] T 5844863880a54fe9a4194162d5c8f72c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.289372 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.290072 29718 raft_consensus.cc:2243] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.290868 29718 raft_consensus.cc:2272] T 597b56d5b0084f239a472638315fdb19 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.292896 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.293442 29718 raft_consensus.cc:2243] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.293833 29718 raft_consensus.cc:2272] T f4c75efa2c834642afd84dcbcec453b9 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.295866 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.296435 29718 raft_consensus.cc:2243] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.296766 29718 raft_consensus.cc:2272] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.298796 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.299317 29718 raft_consensus.cc:2243] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.299706 29718 raft_consensus.cc:2272] T 5421978302744408a4763ff08b738c2d P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.301918 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.302448 29718 raft_consensus.cc:2243] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.303233 29718 raft_consensus.cc:2272] T eac4779ad927429881b9f59f0f356abb P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.305198 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.305751 29718 raft_consensus.cc:2243] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.306128 29718 raft_consensus.cc:2272] T 184945b6c18c46b4b5a242903e4df7ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.308104 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.308676 29718 raft_consensus.cc:2243] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.309365 29718 raft_consensus.cc:2272] T e110c0e66ae646dbba07c2ca28fd5631 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.311264 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.311823 29718 raft_consensus.cc:2243] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.312193 29718 raft_consensus.cc:2272] T 21d1ce843f5a4a4d82a4c35768da1639 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.314190 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.314822 29718 raft_consensus.cc:2243] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.315187 29718 raft_consensus.cc:2272] T 2dbedf50a3c84aecb67e73854339d8e3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.317628 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.318203 29718 raft_consensus.cc:2243] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.318715 29718 raft_consensus.cc:2272] T 4a71d181490848c0888d12dc4b65cc0d P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.322239 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.323083 29718 raft_consensus.cc:2243] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:17:53.323942  5050 consensus_peers.cc:597] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.324014 29718 raft_consensus.cc:2272] T 896e123c38644e439ea2de7c32690f10 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.326372 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.327114 29718 raft_consensus.cc:2243] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.327531 29718 raft_consensus.cc:2272] T 615c5414ab724457a1049455f559bab4 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.330324  4976 consensus_peers.cc:597] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.330394 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.331243 29718 raft_consensus.cc:2243] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.332089 29718 raft_consensus.cc:2272] T a60d1eac4c774fa9b9d2d947403a30c2 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.332391  5124 consensus_peers.cc:597] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.334308 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.334954 29718 raft_consensus.cc:2243] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.335402 29718 raft_consensus.cc:2272] T 3b51f860fd714a01b39a1a9fb6db5974 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.337675 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.338228 29718 raft_consensus.cc:2243] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.338611 29718 raft_consensus.cc:2272] T 36a37190f2bf45f0bdf40239c84eb18c P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.340739 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.341313 29718 raft_consensus.cc:2243] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.341693 29718 raft_consensus.cc:2272] T d65fd895041c443299524ba293a442c5 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.343679 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.344358 29718 raft_consensus.cc:2243] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.345155 29718 raft_consensus.cc:2272] T 780f1c1303f94a6d8b8b407d2392d1e7 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.347505 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.348098 29718 raft_consensus.cc:2243] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.348450 29718 raft_consensus.cc:2272] T e735d761e3064ffa967bf9214069af1b P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.350459 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.351059 29718 raft_consensus.cc:2243] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.351450 29718 raft_consensus.cc:2272] T 07ee2e2aa9aa4bba9f078425f142e0fc P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.353485 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.354017 29718 raft_consensus.cc:2243] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.354454 29718 raft_consensus.cc:2272] T 0b9410663e6c48bf9ec25dc3b9c57805 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.356413 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.356973 29718 raft_consensus.cc:2243] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.357357 29718 raft_consensus.cc:2272] T 8cf3fbfd93384fd8ba4351d1330239ad P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.359472 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.360101 29718 raft_consensus.cc:2243] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.360461 29718 raft_consensus.cc:2272] T 795eacb4ba194dc8a9811b3471aae575 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.362828 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.363570 29718 raft_consensus.cc:2243] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.364156 29718 raft_consensus.cc:2272] T b80fa21498e64631ad2657c5021c55e1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.366853 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.367424 29718 raft_consensus.cc:2243] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.367925 29718 raft_consensus.cc:2272] T 89005842f7624652bbcd94368c089cb3 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.370090 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.370656 29718 raft_consensus.cc:2243] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.371560 29718 raft_consensus.cc:2272] T d49d805bf2f2496ba8e8f3db24871482 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.374137 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.374909 29718 raft_consensus.cc:2243] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.375380 29718 raft_consensus.cc:2272] T cea73967d5ce4c81b9f43fc970d37f88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.378265 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.378984 29718 raft_consensus.cc:2243] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.379469 29718 raft_consensus.cc:2272] T ebed353d692f4b5390b659b83f88dc16 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.382412 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.383139 29718 raft_consensus.cc:2243] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.384110 29718 raft_consensus.cc:2272] T 23abed59564b473b8104457c3f04dbd1 P 7e2c2c6ff9224614b4b24e53c472d346 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.386929 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.387673 29718 raft_consensus.cc:2243] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.388273 29718 raft_consensus.cc:2272] T 418c40cbfa1e482bac10f761a5a39a30 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.391026 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.391757 29718 raft_consensus.cc:2243] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.392261 29718 raft_consensus.cc:2272] T 4d965e514c434894bda41987fdad0b73 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.395455 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.396199 29718 raft_consensus.cc:2243] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.396737 29718 raft_consensus.cc:2272] T f494c1d883684e3285f3d2e4ad7c0c97 P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.399274 29718 tablet_replica.cc:333] stopping tablet replica
W20260709 13:17:53.399842  4976 consensus_peers.cc:597] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.400002 29718 raft_consensus.cc:2243] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.400929 29718 raft_consensus.cc:2272] T 408af3f61ed34eed834a306bc4e6a465 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.403684 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.404426 29718 raft_consensus.cc:2243] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.404918 29718 raft_consensus.cc:2272] T 261bba9d86af4a97a43b900a29cda09e P 7e2c2c6ff9224614b4b24e53c472d346 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.407001 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.407518 29718 raft_consensus.cc:2243] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.408259 29718 raft_consensus.cc:2272] T 281e91779b14462aa4fb6af62998cd20 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.410192 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.410688 29718 raft_consensus.cc:2243] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.411083 29718 raft_consensus.cc:2272] T 53aee4bd1aa94a5f9275d30815804a88 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.413216 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.413762 29718 raft_consensus.cc:2243] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.414530 29718 raft_consensus.cc:2272] T ba09625c6e454229af67996d21b2d4dc P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.417006 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:17:53.417508 29718 raft_consensus.cc:2243] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.417872 29718 raft_consensus.cc:2272] T 769e6ebd88db4a45830d07ff3d7b6b12 P 7e2c2c6ff9224614b4b24e53c472d346 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.436040  4976 consensus_peers.cc:597] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.465201  5050 consensus_peers.cc:597] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.469945  4976 consensus_peers.cc:597] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.475518  5124 consensus_peers.cc:597] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.491122  4976 consensus_peers.cc:597] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.491463 29718 tablet_server.cc:196] TabletServer@127.29.5.129:36057 shutdown complete.
W20260709 13:17:53.492061  5050 consensus_peers.cc:597] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.502070  4976 consensus_peers.cc:597] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.513545  5050 consensus_peers.cc:597] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.553050  5050 consensus_peers.cc:597] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.554895  4976 consensus_peers.cc:597] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.578163  5124 consensus_peers.cc:597] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.579844 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
W20260709 13:17:53.581007  5050 consensus_peers.cc:597] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.586504  5049 consensus_peers.cc:597] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.623641  5050 consensus_peers.cc:597] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.626541  5050 consensus_peers.cc:597] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.631610 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:17:53.633107  5124 consensus_peers.cc:597] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.633281 29718 tablet_replica.cc:333] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.634073 29718 raft_consensus.cc:2243] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.634706 29718 raft_consensus.cc:2272] T b0550850ae264c03b931a289b670c061 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.635824  5049 consensus_peers.cc:597] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.637604 29718 tablet_replica.cc:333] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.638365 29718 raft_consensus.cc:2243] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.638861 29718 raft_consensus.cc:2272] T f4c75efa2c834642afd84dcbcec453b9 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.639981  4976 consensus_peers.cc:597] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.641307 29718 tablet_replica.cc:333] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.641948 29718 raft_consensus.cc:2243] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.642372 29718 raft_consensus.cc:2272] T d65fd895041c443299524ba293a442c5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.645089 29718 tablet_replica.cc:333] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.645877 29718 raft_consensus.cc:2243] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.646400 29718 raft_consensus.cc:2272] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.648609 29718 tablet_replica.cc:333] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.649212 29718 raft_consensus.cc:2243] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.649626 29718 raft_consensus.cc:2272] T 780f1c1303f94a6d8b8b407d2392d1e7 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.652505 29718 tablet_replica.cc:333] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.653317 29718 raft_consensus.cc:2243] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.653837 29718 raft_consensus.cc:2272] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.656476 29718 tablet_replica.cc:333] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.657246 29718 raft_consensus.cc:2243] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:53.657315  5124 consensus_peers.cc:597] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.657823 29718 raft_consensus.cc:2272] T e110c0e66ae646dbba07c2ca28fd5631 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.660306 29718 tablet_replica.cc:333] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.660975 29718 raft_consensus.cc:2243] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.662003 29718 raft_consensus.cc:2272] T 21d1ce843f5a4a4d82a4c35768da1639 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.664963 29718 tablet_replica.cc:333] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
W20260709 13:17:53.665830  5049 consensus_peers.cc:597] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.665834 29718 raft_consensus.cc:2243] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.666616 29718 raft_consensus.cc:2272] T 53d5ffde8fa846f7a2031a39ee4129ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.669319 29718 tablet_replica.cc:333] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.670077 29718 raft_consensus.cc:2243] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.670571 29718 raft_consensus.cc:2272] T 597b56d5b0084f239a472638315fdb19 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.673529 29718 tablet_replica.cc:333] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.674074 29718 raft_consensus.cc:2243] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.674823 29718 raft_consensus.cc:2272] T cea73967d5ce4c81b9f43fc970d37f88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.676736 29718 tablet_replica.cc:333] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.677291 29718 raft_consensus.cc:2243] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.677690 29718 raft_consensus.cc:2272] T ba09625c6e454229af67996d21b2d4dc P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.679595 29718 tablet_replica.cc:333] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.680122 29718 raft_consensus.cc:2243] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.680878 29718 raft_consensus.cc:2272] T 53aee4bd1aa94a5f9275d30815804a88 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.682631 29718 tablet_replica.cc:333] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.683204 29718 raft_consensus.cc:2243] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.683627 29718 raft_consensus.cc:2272] T 969b73f3d2bc408aafcf19ab23755ee5 P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.685356 29718 tablet_replica.cc:333] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.685920 29718 raft_consensus.cc:2243] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.686340 29718 raft_consensus.cc:2272] T 084dd96ef5764ccc9fa9d83933389f62 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.688613 29718 tablet_replica.cc:333] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.689292 29718 raft_consensus.cc:2243] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.690346 29718 raft_consensus.cc:2272] T 8cf3fbfd93384fd8ba4351d1330239ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.693765 29718 tablet_replica.cc:333] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.694515 29718 raft_consensus.cc:2243] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.695834 29718 raft_consensus.cc:2272] T 795eacb4ba194dc8a9811b3471aae575 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.696179  5049 consensus_peers.cc:597] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.698046 29718 tablet_replica.cc:333] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.698699 29718 raft_consensus.cc:2243] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.699167 29718 raft_consensus.cc:2272] T b80fa21498e64631ad2657c5021c55e1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.701581 29718 tablet_replica.cc:333] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.702314 29718 raft_consensus.cc:2243] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.702812 29718 raft_consensus.cc:2272] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.705003 29718 tablet_replica.cc:333] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.705703 29718 raft_consensus.cc:2243] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.706127 29718 raft_consensus.cc:2272] T f1034335eb97407db28e1bb34a99a838 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.708222 29718 tablet_replica.cc:333] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.708770 29718 raft_consensus.cc:2243] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.709494 29718 raft_consensus.cc:2272] T 2357ff63d6a543a8bb0105adfdd10a8e P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.711323 29718 tablet_replica.cc:333] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.711931 29718 raft_consensus.cc:2243] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.712356 29718 raft_consensus.cc:2272] T 20b3651a051845f49844d453fa92f074 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.714455 29718 tablet_replica.cc:333] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.715075 29718 raft_consensus.cc:2243] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.716063 29718 raft_consensus.cc:2272] T 418c40cbfa1e482bac10f761a5a39a30 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.716023  5123 consensus_peers.cc:597] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.718823 29718 tablet_replica.cc:333] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.719509 29718 raft_consensus.cc:2243] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.720547 29718 raft_consensus.cc:2272] T 7f56ea8740b747e0b6ee12d6e2333b6b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.723057 29718 tablet_replica.cc:333] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.723824 29718 raft_consensus.cc:2243] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.724308 29718 raft_consensus.cc:2272] T d49d805bf2f2496ba8e8f3db24871482 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.726943 29718 tablet_replica.cc:333] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.727698 29718 raft_consensus.cc:2243] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.728693 29718 raft_consensus.cc:2272] T 453a7f2f432e4b6d83de031143ba6238 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.731249 29718 tablet_replica.cc:333] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.732038 29718 raft_consensus.cc:2243] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:53.732671  5124 consensus_peers.cc:597] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.732950 29718 raft_consensus.cc:2272] T 36a37190f2bf45f0bdf40239c84eb18c P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.732757  5123 consensus_peers.cc:597] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.735502 29718 tablet_replica.cc:333] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.736299 29718 raft_consensus.cc:2243] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.736740 29718 raft_consensus.cc:2272] T bc62241274be438184b329dc0635e9d1 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.737453  5124 consensus_peers.cc:597] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae -> Peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Couldn't send request to peer 7e2c2c6ff9224614b4b24e53c472d346. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.738734 29718 tablet_replica.cc:333] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.739322 29718 raft_consensus.cc:2243] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.740082 29718 raft_consensus.cc:2272] T 3b51f860fd714a01b39a1a9fb6db5974 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.741902 29718 tablet_replica.cc:333] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.742435 29718 raft_consensus.cc:2243] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.742854 29718 raft_consensus.cc:2272] T 4d965e514c434894bda41987fdad0b73 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.744864 29718 tablet_replica.cc:333] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.745494 29718 raft_consensus.cc:2243] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.745889 29718 raft_consensus.cc:2272] T 184945b6c18c46b4b5a242903e4df7ad P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.747882 29718 tablet_replica.cc:333] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.748380 29718 raft_consensus.cc:2243] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.748764 29718 raft_consensus.cc:2272] T eac4779ad927429881b9f59f0f356abb P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.750517 29718 tablet_replica.cc:333] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.751019 29718 raft_consensus.cc:2243] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.751398 29718 raft_consensus.cc:2272] T 408af3f61ed34eed834a306bc4e6a465 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.753129 29718 tablet_replica.cc:333] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.753652 29718 raft_consensus.cc:2243] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.754083 29718 raft_consensus.cc:2272] T dd62f735924d4523b0a0b4061cb40814 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.755966 29718 tablet_replica.cc:333] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.756489 29718 raft_consensus.cc:2243] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.757421 29718 raft_consensus.cc:2272] T 4a71d181490848c0888d12dc4b65cc0d P 561ca9eb1a1a4421b17518a3ff3725dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.759457 29718 tablet_replica.cc:333] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.760010 29718 raft_consensus.cc:2243] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.760385 29718 raft_consensus.cc:2272] T 896e123c38644e439ea2de7c32690f10 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.762112 29718 tablet_replica.cc:333] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.762622 29718 raft_consensus.cc:2243] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.763021 29718 raft_consensus.cc:2272] T a8d34906755246e3b3f0d4c435283a5a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.765118 29718 tablet_replica.cc:333] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.765594 29718 raft_consensus.cc:2243] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.766031 29718 raft_consensus.cc:2272] T 769e6ebd88db4a45830d07ff3d7b6b12 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.768599 29718 tablet_replica.cc:333] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.769083 29718 raft_consensus.cc:2243] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.769966 29718 raft_consensus.cc:2272] T 15cb77576c214fada45083baabff5c2d P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.772416  5049 consensus_peers.cc:597] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.772748 29718 tablet_replica.cc:333] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.773531 29718 raft_consensus.cc:2243] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.774017 29718 raft_consensus.cc:2272] T 1b77438d30f849be8959ef2a5aea7f5b P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.777024 29718 tablet_replica.cc:333] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.777520 29718 raft_consensus.cc:2243] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.778378 29718 raft_consensus.cc:2272] T f494c1d883684e3285f3d2e4ad7c0c97 P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.780469 29718 tablet_replica.cc:333] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.780936 29718 raft_consensus.cc:2243] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:53.782091 29718 raft_consensus.cc:2272] T 261bba9d86af4a97a43b900a29cda09e P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.784466 29718 tablet_replica.cc:333] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.784955 29718 raft_consensus.cc:2243] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.785346 29718 raft_consensus.cc:2272] T 281e91779b14462aa4fb6af62998cd20 P 561ca9eb1a1a4421b17518a3ff3725dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.787045 29718 tablet_replica.cc:333] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc: stopping tablet replica
I20260709 13:17:53.787539 29718 raft_consensus.cc:2243] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.787940 29718 raft_consensus.cc:2272] T f7b2ed27eb764c4c8a356d249940b43a P 561ca9eb1a1a4421b17518a3ff3725dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:53.824262  5049 consensus_peers.cc:597] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.830058  5049 consensus_peers.cc:597] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.849586  5123 consensus_peers.cc:597] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.854503  5049 consensus_peers.cc:597] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.856760 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
W20260709 13:17:53.872493  5123 consensus_peers.cc:597] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.901371  5123 consensus_peers.cc:597] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:53.947943  5123 consensus_peers.cc:597] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:53.949641 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
I20260709 13:17:53.997267 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:53.998026 29718 tablet_replica.cc:333] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:53.998646 29718 raft_consensus.cc:2243] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:53.999109 29718 raft_consensus.cc:2272] T e840ef3c7b6a42b2a98b08ea3eb6b0db P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.001204 29718 tablet_replica.cc:333] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.001801 29718 raft_consensus.cc:2243] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.002571 29718 raft_consensus.cc:2272] T 969b73f3d2bc408aafcf19ab23755ee5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.004772 29718 tablet_replica.cc:333] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.005614 29718 raft_consensus.cc:2243] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.006126 29718 raft_consensus.cc:2272] T 615c5414ab724457a1049455f559bab4 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.008934 29718 tablet_replica.cc:333] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
W20260709 13:17:54.009552  5049 consensus_peers.cc:597] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.009758 29718 raft_consensus.cc:2243] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.010421 29718 raft_consensus.cc:2272] T 2dbedf50a3c84aecb67e73854339d8e3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.012571 29718 tablet_replica.cc:333] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.013104 29718 raft_consensus.cc:2243] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.013836 29718 raft_consensus.cc:2272] T d65fd895041c443299524ba293a442c5 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.015666 29718 tablet_replica.cc:333] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.016242 29718 raft_consensus.cc:2243] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.016633 29718 raft_consensus.cc:2272] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.018419 29718 tablet_replica.cc:333] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.019102 29718 raft_consensus.cc:2243] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.020007 29718 raft_consensus.cc:2272] T f4c75efa2c834642afd84dcbcec453b9 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.021878 29718 tablet_replica.cc:333] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.022428 29718 raft_consensus.cc:2243] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.022833 29718 raft_consensus.cc:2272] T 53d5ffde8fa846f7a2031a39ee4129ad P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.024719 29718 tablet_replica.cc:333] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.025249 29718 raft_consensus.cc:2243] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.025676 29718 raft_consensus.cc:2272] T 795eacb4ba194dc8a9811b3471aae575 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.027566 29718 tablet_replica.cc:333] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.028138 29718 raft_consensus.cc:2243] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.028518 29718 raft_consensus.cc:2272] T bb728a4f28ed48c082e7f2d65155bd4c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.030323 29718 tablet_replica.cc:333] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.030848 29718 raft_consensus.cc:2243] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.031240 29718 raft_consensus.cc:2272] T 5421978302744408a4763ff08b738c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.033028 29718 tablet_replica.cc:333] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.033572 29718 raft_consensus.cc:2243] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.034318 29718 raft_consensus.cc:2272] T 084dd96ef5764ccc9fa9d83933389f62 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.036512 29718 tablet_replica.cc:333] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.037032 29718 raft_consensus.cc:2243] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.037878 29718 raft_consensus.cc:2272] T dd62f735924d4523b0a0b4061cb40814 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.039740 29718 tablet_replica.cc:333] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.040297 29718 raft_consensus.cc:2243] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.040678 29718 raft_consensus.cc:2272] T 7f56ea8740b747e0b6ee12d6e2333b6b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.042522 29718 tablet_replica.cc:333] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.043046 29718 raft_consensus.cc:2243] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.043433 29718 raft_consensus.cc:2272] T ba09625c6e454229af67996d21b2d4dc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.045176 29718 tablet_replica.cc:333] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.045693 29718 raft_consensus.cc:2243] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.046177 29718 raft_consensus.cc:2272] T 53aee4bd1aa94a5f9275d30815804a88 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.048072 29718 tablet_replica.cc:333] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.048590 29718 raft_consensus.cc:2243] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.049017 29718 raft_consensus.cc:2272] T 0b9410663e6c48bf9ec25dc3b9c57805 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.051184 29718 tablet_replica.cc:333] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.051744 29718 raft_consensus.cc:2243] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:54.051976  5123 consensus_peers.cc:597] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.052599 29718 raft_consensus.cc:2272] T 07ee2e2aa9aa4bba9f078425f142e0fc P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.054589 29718 tablet_replica.cc:333] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.055123 29718 raft_consensus.cc:2243] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.055886 29718 raft_consensus.cc:2272] T e735d761e3064ffa967bf9214069af1b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.057700 29718 tablet_replica.cc:333] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.058418 29718 raft_consensus.cc:2243] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.059140 29718 raft_consensus.cc:2272] T 89005842f7624652bbcd94368c089cb3 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.061856 29718 tablet_replica.cc:333] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.062638 29718 raft_consensus.cc:2243] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:54.063125  5049 consensus_peers.cc:597] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.063138 29718 raft_consensus.cc:2272] T d49d805bf2f2496ba8e8f3db24871482 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.066006 29718 tablet_replica.cc:333] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.066598 29718 raft_consensus.cc:2243] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:54.066941  5123 consensus_peers.cc:597] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.067047 29718 raft_consensus.cc:2272] T 36a37190f2bf45f0bdf40239c84eb18c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.070114 29718 tablet_replica.cc:333] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.070906 29718 raft_consensus.cc:2243] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.071880 29718 raft_consensus.cc:2272] T bc62241274be438184b329dc0635e9d1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.074252 29718 tablet_replica.cc:333] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.074795 29718 raft_consensus.cc:2243] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.075317 29718 raft_consensus.cc:2272] T 3b51f860fd714a01b39a1a9fb6db5974 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.077968 29718 tablet_replica.cc:333] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.078611 29718 raft_consensus.cc:2243] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:17:54.078907  5123 consensus_peers.cc:597] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.079512 29718 raft_consensus.cc:2272] T 44b74d3e9edb492b8818ba89bf9d7ff7 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.081570 29718 tablet_replica.cc:333] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.082121 29718 raft_consensus.cc:2243] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.082504 29718 raft_consensus.cc:2272] T a60d1eac4c774fa9b9d2d947403a30c2 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.084434 29718 tablet_replica.cc:333] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
W20260709 13:17:54.088984  5123 consensus_peers.cc:597] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.084973 29718 raft_consensus.cc:2243] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.113608 29718 raft_consensus.cc:2272] T 21d1ce843f5a4a4d82a4c35768da1639 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.124248 29718 tablet_replica.cc:333] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.127555 29718 raft_consensus.cc:2243] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.128866 29718 raft_consensus.cc:2272] T f1034335eb97407db28e1bb34a99a838 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:54.130833  5049 consensus_peers.cc:597] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:54.131253  5123 consensus_peers.cc:597] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae -> Peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Couldn't send request to peer 561ca9eb1a1a4421b17518a3ff3725dc. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.134166 29718 tablet_replica.cc:333] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.136181 29718 raft_consensus.cc:2243] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.142541 29718 raft_consensus.cc:2272] T b80fa21498e64631ad2657c5021c55e1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.147871 29718 tablet_replica.cc:333] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
W20260709 13:17:54.148317  5123 consensus_peers.cc:597] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.149180 29718 raft_consensus.cc:2243] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.150683 29718 raft_consensus.cc:2272] T fd0db5a1497e4b73b5f7090a3e9bbf54 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.153402 29718 tablet_replica.cc:333] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.154263 29718 raft_consensus.cc:2243] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.155452 29718 raft_consensus.cc:2272] T 4d965e514c434894bda41987fdad0b73 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.158033 29718 tablet_replica.cc:333] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.158579 29718 raft_consensus.cc:2243] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.159113 29718 raft_consensus.cc:2272] T be904dd9747941818620fdde5b5e8dd8 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.162223 29718 tablet_replica.cc:333] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.163342 29718 raft_consensus.cc:2243] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.164297 29718 raft_consensus.cc:2272] T 1b77438d30f849be8959ef2a5aea7f5b P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.167956 29718 tablet_replica.cc:333] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.168694 29718 raft_consensus.cc:2243] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.169235 29718 raft_consensus.cc:2272] T f494c1d883684e3285f3d2e4ad7c0c97 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.171895 29718 tablet_replica.cc:333] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.172648 29718 raft_consensus.cc:2243] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.173266 29718 raft_consensus.cc:2272] T 23abed59564b473b8104457c3f04dbd1 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.175587 29718 tablet_replica.cc:333] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.176191 29718 raft_consensus.cc:2243] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.176759 29718 raft_consensus.cc:2272] T ebed353d692f4b5390b659b83f88dc16 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.179070 29718 tablet_replica.cc:333] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.179625 29718 raft_consensus.cc:2243] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.180239 29718 raft_consensus.cc:2272] T 5844863880a54fe9a4194162d5c8f72c P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.183626 29718 tablet_replica.cc:333] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.184392 29718 raft_consensus.cc:2243] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.185488 29718 raft_consensus.cc:2272] T 15cb77576c214fada45083baabff5c2d P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.190227 29718 tablet_replica.cc:333] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.191218 29718 raft_consensus.cc:2243] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.192412 29718 raft_consensus.cc:2272] T 2357ff63d6a543a8bb0105adfdd10a8e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.201499 29718 tablet_replica.cc:333] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.202617 29718 raft_consensus.cc:2243] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.203666 29718 raft_consensus.cc:2272] T ac3f70c10d7c4ab0aac5333f93491029 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.208069 29718 tablet_replica.cc:333] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.208730 29718 raft_consensus.cc:2243] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.210427 29718 raft_consensus.cc:2272] T a8d34906755246e3b3f0d4c435283a5a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.214260 29718 tablet_replica.cc:333] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.215113 29718 raft_consensus.cc:2243] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.217036 29718 raft_consensus.cc:2272] T 769e6ebd88db4a45830d07ff3d7b6b12 P c70fac7b468a4fa59ccb26ef6e6220f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.221381 29718 tablet_replica.cc:333] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.222213 29718 raft_consensus.cc:2243] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.223042 29718 raft_consensus.cc:2272] T 261bba9d86af4a97a43b900a29cda09e P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:54.226472  5123 consensus_peers.cc:597] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.227058 29718 tablet_replica.cc:333] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6: stopping tablet replica
I20260709 13:17:54.227797 29718 raft_consensus.cc:2243] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.228394 29718 raft_consensus.cc:2272] T f7b2ed27eb764c4c8a356d249940b43a P c70fac7b468a4fa59ccb26ef6e6220f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:54.273916  5123 consensus_peers.cc:597] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.330724 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
W20260709 13:17:54.342362  5123 consensus_peers.cc:597] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:54.344901  5123 consensus_peers.cc:597] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:54.345329  5123 consensus_peers.cc:597] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:54.362525  5123 consensus_peers.cc:597] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.425233  5874 raft_consensus.cc:493] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:54.425985  5874 raft_consensus.cc:515] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:54.428522  5874 leader_election.cc:290] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:54.428617 29718 tablet_server.cc:179] TabletServer@127.29.5.132:0 shutting down...
W20260709 13:17:54.434862  5124 leader_election.cc:336] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
W20260709 13:17:54.436622  5123 leader_election.cc:336] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111)
I20260709 13:17:54.437070  5123 leader_election.cc:304] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:54.438012  5874 raft_consensus.cc:2749] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:54.450420  5123 consensus_peers.cc:597] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:54.463135  5123 consensus_peers.cc:597] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae -> Peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Couldn't send request to peer c70fac7b468a4fa59ccb26ef6e6220f6. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:54.474479 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:54.475294 29718 tablet_replica.cc:333] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.476292 29718 raft_consensus.cc:2243] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.477434 29718 raft_consensus.cc:2272] T 1b77438d30f849be8959ef2a5aea7f5b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.479679 29718 tablet_replica.cc:333] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.480408 29718 raft_consensus.cc:2243] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.480937 29718 raft_consensus.cc:2272] T b0550850ae264c03b931a289b670c061 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.483165 29718 tablet_replica.cc:333] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.483886 29718 raft_consensus.cc:2243] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.484848 29718 raft_consensus.cc:2272] T e840ef3c7b6a42b2a98b08ea3eb6b0db P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.486804 29718 tablet_replica.cc:333] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.487470 29718 raft_consensus.cc:2243] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.488293 29718 raft_consensus.cc:2272] T e110c0e66ae646dbba07c2ca28fd5631 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.491226 29718 tablet_replica.cc:333] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.492002 29718 raft_consensus.cc:2243] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.492955 29718 raft_consensus.cc:2272] T 80b16d4ddd0e4ca2bc3cc095874dd0eb P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.495039 29718 tablet_replica.cc:333] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.495677 29718 raft_consensus.cc:2243] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.496270 29718 raft_consensus.cc:2272] T 780f1c1303f94a6d8b8b407d2392d1e7 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.496410  5874 raft_consensus.cc:493] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:54.497007  5874 raft_consensus.cc:515] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:54.499132  5874 leader_election.cc:290] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:54.499212 29718 tablet_replica.cc:333] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.500344 29718 raft_consensus.cc:2243] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.501084 29718 raft_consensus.cc:2272] T 23abed59564b473b8104457c3f04dbd1 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:54.503620  5124 leader_election.cc:336] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:54.504035 29718 tablet_replica.cc:333] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
W20260709 13:17:54.504168  5123 leader_election.cc:336] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111)
I20260709 13:17:54.504753  5123 leader_election.cc:304] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:54.505115 29718 raft_consensus.cc:2243] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.505556  6025 raft_consensus.cc:2749] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:54.506650 29718 raft_consensus.cc:2272] T ebed353d692f4b5390b659b83f88dc16 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.509684 29718 tablet_replica.cc:333] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.510279 29718 raft_consensus.cc:2243] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.510874 29718 raft_consensus.cc:2272] T 597b56d5b0084f239a472638315fdb19 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.513025 29718 tablet_replica.cc:333] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.513600 29718 raft_consensus.cc:2243] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.514458 29718 raft_consensus.cc:2272] T 53d5ffde8fa846f7a2031a39ee4129ad P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.516741 29718 tablet_replica.cc:333] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.517293 29718 raft_consensus.cc:2243] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.517766 29718 raft_consensus.cc:2272] T 8cf3fbfd93384fd8ba4351d1330239ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.519889 29718 tablet_replica.cc:333] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.520246  6001 raft_consensus.cc:493] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:54.520700 29718 raft_consensus.cc:2243] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.520881  6001 raft_consensus.cc:515] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c70fac7b468a4fa59ccb26ef6e6220f6" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45459 } } peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } }
I20260709 13:17:54.521461 29718 raft_consensus.cc:2272] T 281e91779b14462aa4fb6af62998cd20 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.523543  6001 leader_election.cc:290] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459), 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057)
I20260709 13:17:54.524613 29718 tablet_replica.cc:333] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.525609 29718 raft_consensus.cc:2243] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.526798 29718 raft_consensus.cc:2272] T f7b2ed27eb764c4c8a356d249940b43a P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:54.527297  5123 leader_election.cc:336] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c70fac7b468a4fa59ccb26ef6e6220f6 (127.29.5.131:45459): Network error: Client connection negotiation failed: client connection to 127.29.5.131:45459: connect: Connection refused (error 111)
W20260709 13:17:54.528879  5124 leader_election.cc:336] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:54.529539  5124 leader_election.cc:304] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 7e2c2c6ff9224614b4b24e53c472d346, c70fac7b468a4fa59ccb26ef6e6220f6
I20260709 13:17:54.530112 29718 tablet_replica.cc:333] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.530299  6001 raft_consensus.cc:2749] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:54.531140 29718 raft_consensus.cc:2243] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.531746 29718 raft_consensus.cc:2272] T 453a7f2f432e4b6d83de031143ba6238 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.534478 29718 tablet_replica.cc:333] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.535058 29718 raft_consensus.cc:2243] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.535470 29718 raft_consensus.cc:2272] T cea73967d5ce4c81b9f43fc970d37f88 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.536218  6001 raft_consensus.cc:493] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e2c2c6ff9224614b4b24e53c472d346)
I20260709 13:17:54.536690  6001 raft_consensus.cc:515] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "546aee349d8547699b9d86b3640f5aae" member_type: VOTER last_known_addr { host: "127.29.5.132" port: 34111 } } peers { permanent_uuid: "7e2c2c6ff9224614b4b24e53c472d346" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 36057 } } peers { permanent_uuid: "561ca9eb1a1a4421b17518a3ff3725dc" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 36371 } }
I20260709 13:17:54.537683 29718 tablet_replica.cc:333] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.538369 29718 raft_consensus.cc:2243] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.538599  6001 leader_election.cc:290] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057), 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371)
I20260709 13:17:54.539592 29718 raft_consensus.cc:2272] T 5421978302744408a4763ff08b738c2d P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:54.542408  5124 leader_election.cc:336] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e2c2c6ff9224614b4b24e53c472d346 (127.29.5.129:36057): Network error: Client connection negotiation failed: client connection to 127.29.5.129:36057: connect: Connection refused (error 111)
I20260709 13:17:54.542454 29718 tablet_replica.cc:333] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
W20260709 13:17:54.542933  5123 leader_election.cc:336] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 561ca9eb1a1a4421b17518a3ff3725dc (127.29.5.130:36371): Network error: Client connection negotiation failed: client connection to 127.29.5.130:36371: connect: Connection refused (error 111)
I20260709 13:17:54.543293  5123 leader_election.cc:304] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 546aee349d8547699b9d86b3640f5aae; no voters: 561ca9eb1a1a4421b17518a3ff3725dc, 7e2c2c6ff9224614b4b24e53c472d346
I20260709 13:17:54.543375 29718 raft_consensus.cc:2243] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.543975  6001 raft_consensus.cc:2749] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:54.544111 29718 raft_consensus.cc:2272] T 084dd96ef5764ccc9fa9d83933389f62 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.546432 29718 tablet_replica.cc:333] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.547115 29718 raft_consensus.cc:2243] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.547627 29718 raft_consensus.cc:2272] T 418c40cbfa1e482bac10f761a5a39a30 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.549837 29718 tablet_replica.cc:333] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.550382 29718 raft_consensus.cc:2243] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.550850 29718 raft_consensus.cc:2272] T 7f56ea8740b747e0b6ee12d6e2333b6b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.552804 29718 tablet_replica.cc:333] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.553349 29718 raft_consensus.cc:2243] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.553857 29718 raft_consensus.cc:2272] T 2357ff63d6a543a8bb0105adfdd10a8e P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.555886 29718 tablet_replica.cc:333] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.556403 29718 raft_consensus.cc:2243] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.556831 29718 raft_consensus.cc:2272] T 20b3651a051845f49844d453fa92f074 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.558755 29718 tablet_replica.cc:333] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.559290 29718 raft_consensus.cc:2243] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.559851 29718 raft_consensus.cc:2272] T a60d1eac4c774fa9b9d2d947403a30c2 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.561836 29718 tablet_replica.cc:333] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.562388 29718 raft_consensus.cc:2243] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.562856 29718 raft_consensus.cc:2272] T 44b74d3e9edb492b8818ba89bf9d7ff7 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.564834 29718 tablet_replica.cc:333] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.565371 29718 raft_consensus.cc:2243] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.566249 29718 raft_consensus.cc:2272] T 5844863880a54fe9a4194162d5c8f72c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.568105 29718 tablet_replica.cc:333] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.568636 29718 raft_consensus.cc:2243] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.569509 29718 raft_consensus.cc:2272] T f1034335eb97407db28e1bb34a99a838 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.571391 29718 tablet_replica.cc:333] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.572141 29718 raft_consensus.cc:2243] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.572692 29718 raft_consensus.cc:2272] T fd0db5a1497e4b73b5f7090a3e9bbf54 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.574713 29718 tablet_replica.cc:333] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.575217 29718 raft_consensus.cc:2243] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.576197 29718 raft_consensus.cc:2272] T 615c5414ab724457a1049455f559bab4 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.578492 29718 tablet_replica.cc:333] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.579118 29718 raft_consensus.cc:2243] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.580299 29718 raft_consensus.cc:2272] T 2dbedf50a3c84aecb67e73854339d8e3 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.582281 29718 tablet_replica.cc:333] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.582824 29718 raft_consensus.cc:2243] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.583391 29718 raft_consensus.cc:2272] T 4a71d181490848c0888d12dc4b65cc0d P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.585539 29718 tablet_replica.cc:333] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.586088 29718 raft_consensus.cc:2243] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.586650 29718 raft_consensus.cc:2272] T 896e123c38644e439ea2de7c32690f10 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.588842 29718 tablet_replica.cc:333] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.589375 29718 raft_consensus.cc:2243] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.589869 29718 raft_consensus.cc:2272] T 969b73f3d2bc408aafcf19ab23755ee5 P 546aee349d8547699b9d86b3640f5aae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.592665 29718 tablet_replica.cc:333] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.593492 29718 raft_consensus.cc:2243] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.594625 29718 raft_consensus.cc:2272] T bb728a4f28ed48c082e7f2d65155bd4c P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.597262 29718 tablet_replica.cc:333] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.597801 29718 raft_consensus.cc:2243] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.598670 29718 raft_consensus.cc:2272] T 184945b6c18c46b4b5a242903e4df7ad P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.600776 29718 tablet_replica.cc:333] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.601341 29718 raft_consensus.cc:2243] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.601814 29718 raft_consensus.cc:2272] T eac4779ad927429881b9f59f0f356abb P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.603929 29718 tablet_replica.cc:333] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.604462 29718 raft_consensus.cc:2243] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.605044 29718 raft_consensus.cc:2272] T dd62f735924d4523b0a0b4061cb40814 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.607103 29718 tablet_replica.cc:333] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.607672 29718 raft_consensus.cc:2243] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.608210 29718 raft_consensus.cc:2272] T 408af3f61ed34eed834a306bc4e6a465 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.610335 29718 tablet_replica.cc:333] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.610911 29718 raft_consensus.cc:2243] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.611413 29718 raft_consensus.cc:2272] T ac3f70c10d7c4ab0aac5333f93491029 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.613616 29718 tablet_replica.cc:333] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.614137 29718 raft_consensus.cc:2243] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.614684 29718 raft_consensus.cc:2272] T a8d34906755246e3b3f0d4c435283a5a P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.617082 29718 tablet_replica.cc:333] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.617645 29718 raft_consensus.cc:2243] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.618182 29718 raft_consensus.cc:2272] T bc62241274be438184b329dc0635e9d1 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.620738 29718 tablet_replica.cc:333] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.621232 29718 raft_consensus.cc:2243] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.622105 29718 raft_consensus.cc:2272] T be904dd9747941818620fdde5b5e8dd8 P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.624279 29718 tablet_replica.cc:333] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.624788 29718 raft_consensus.cc:2243] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.625231 29718 raft_consensus.cc:2272] T 07ee2e2aa9aa4bba9f078425f142e0fc P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.627337 29718 tablet_replica.cc:333] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.627929 29718 raft_consensus.cc:2243] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.628419 29718 raft_consensus.cc:2272] T e735d761e3064ffa967bf9214069af1b P 546aee349d8547699b9d86b3640f5aae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.630369 29718 tablet_replica.cc:333] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.630846 29718 raft_consensus.cc:2243] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.631753 29718 raft_consensus.cc:2272] T 0b9410663e6c48bf9ec25dc3b9c57805 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.633849 29718 tablet_replica.cc:333] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae: stopping tablet replica
I20260709 13:17:54.634337 29718 raft_consensus.cc:2243] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.634878 29718 raft_consensus.cc:2272] T 89005842f7624652bbcd94368c089cb3 P 546aee349d8547699b9d86b3640f5aae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.706862 29718 tablet_server.cc:196] TabletServer@127.29.5.132:0 shutdown complete.
I20260709 13:17:54.774513 29718 master.cc:562] Master@127.29.5.190:33299 shutting down...
I20260709 13:17:54.801265 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:54.801904 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:54.802266 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P c372735a2d724515b869797b948419e7: stopping tablet replica
I20260709 13:17:54.824529 29718 master.cc:584] Master@127.29.5.190:33299 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33450 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:17:54.918650 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:39253
I20260709 13:17:54.919783 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:54.925202  6030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:54.926966  6031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.927227 29718 server_base.cc:1061] running on GCE node
W20260709 13:17:54.927057  6033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:54.929625 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:54.929816 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:54.929929 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603074929917 us; error 0 us; skew 500 ppm
I20260709 13:17:54.930379 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:54.932689 29718 webserver.cc:533] Webserver started at http://127.29.5.190:36001/ using document root <none> and password file <none>
I20260709 13:17:54.933130 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:54.933279 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:54.933486 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:54.934651 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "e95e18980a0e458d87f012a589e8f080"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-kgkf"
I20260709 13:17:54.938925 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:54.942018  6038 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:54.942729 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:17:54.942960 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "e95e18980a0e458d87f012a589e8f080"
format_stamp: "Formatted at 2026-07-09 13:17:54 on dist-test-slave-kgkf"
I20260709 13:17:54.943187 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:54.964910 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:54.966063 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:55.003607 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:39253
I20260709 13:17:55.003715  6089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:39253 every 8 connection(s)
I20260709 13:17:55.007606  6090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.018771  6090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080: Bootstrap starting.
I20260709 13:17:55.023530  6090 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.027930  6090 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080: No bootstrap required, opened a new log
I20260709 13:17:55.030148  6090 raft_consensus.cc:359] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e95e18980a0e458d87f012a589e8f080" member_type: VOTER }
I20260709 13:17:55.030556  6090 raft_consensus.cc:385] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.030784  6090 raft_consensus.cc:740] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e95e18980a0e458d87f012a589e8f080, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.031458  6090 consensus_queue.cc:260] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e95e18980a0e458d87f012a589e8f080" member_type: VOTER }
I20260709 13:17:55.031939  6090 raft_consensus.cc:399] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:55.032150  6090 raft_consensus.cc:493] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:55.032451  6090 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.037135  6090 raft_consensus.cc:515] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e95e18980a0e458d87f012a589e8f080" member_type: VOTER }
I20260709 13:17:55.037640  6090 leader_election.cc:304] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e95e18980a0e458d87f012a589e8f080; no voters: 
I20260709 13:17:55.038779  6090 leader_election.cc:290] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:55.039115  6093 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.040597  6093 raft_consensus.cc:697] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 1 LEADER]: Becoming Leader. State: Replica: e95e18980a0e458d87f012a589e8f080, State: Running, Role: LEADER
I20260709 13:17:55.041244  6093 consensus_queue.cc:237] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e95e18980a0e458d87f012a589e8f080" member_type: VOTER }
I20260709 13:17:55.041775  6090 sys_catalog.cc:565] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:55.048262  6095 sys_catalog.cc:455] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e95e18980a0e458d87f012a589e8f080. Latest consensus state: current_term: 1 leader_uuid: "e95e18980a0e458d87f012a589e8f080" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e95e18980a0e458d87f012a589e8f080" member_type: VOTER } }
I20260709 13:17:55.047940  6094 sys_catalog.cc:455] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e95e18980a0e458d87f012a589e8f080" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e95e18980a0e458d87f012a589e8f080" member_type: VOTER } }
I20260709 13:17:55.049082  6095 sys_catalog.cc:458] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:55.049398  6094 sys_catalog.cc:458] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:55.051370  6101 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:55.059266  6101 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:55.060261 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:55.068301  6101 catalog_manager.cc:1383] Generated new cluster ID: f136a14c70a040a88e368a2d68a24550
I20260709 13:17:55.068600  6101 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:55.096916  6101 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:55.098304  6101 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:55.113890  6101 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080: Generated new TSK 0
I20260709 13:17:55.114535  6101 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:55.128010 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:55.134830  6111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:55.135474  6112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:55.137187  6114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:55.137511 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:55.138693 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:55.138908 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:55.139093 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603075139072 us; error 0 us; skew 500 ppm
I20260709 13:17:55.139653 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:55.142047 29718 webserver.cc:533] Webserver started at http://127.29.5.129:34979/ using document root <none> and password file <none>
I20260709 13:17:55.142562 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:55.142781 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:55.143050 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:55.144358 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "7c8689a013884d029b7feadd58d5ba91"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:17:55.149123 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:17:55.152621  6119 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.153514 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:17:55.153889 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "7c8689a013884d029b7feadd58d5ba91"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:17:55.154142 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:55.180029 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:55.181372 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:55.182971 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:55.185348 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:55.185607 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.185878 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:55.186072 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.227540 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:32965
I20260709 13:17:55.227638  6181 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:32965 every 8 connection(s)
I20260709 13:17:55.233426 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:55.241513  6186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:55.244997  6187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:55.248523  6182 heartbeater.cc:344] Connected to a master server at 127.29.5.190:39253
I20260709 13:17:55.249053  6182 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:55.249994  6182 heartbeater.cc:507] Master 127.29.5.190:39253 requested a full tablet report, sending...
I20260709 13:17:55.252810 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:55.253072  6055 ts_manager.cc:194] Registered new tserver with Master: 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965)
W20260709 13:17:55.253949  6189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:55.255085 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:55.255421 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:55.255604  6055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55694
I20260709 13:17:55.255693 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603075255599 us; error 0 us; skew 500 ppm
I20260709 13:17:55.256825 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:55.259524 29718 webserver.cc:533] Webserver started at http://127.29.5.130:34119/ using document root <none> and password file <none>
I20260709 13:17:55.260110 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:55.260321 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:55.260633 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:55.261966 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:17:55.266980 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:17:55.270787  6194 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.271992 29718 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:55.272383 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:17:55.272801 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:55.285459 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:55.286613 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:55.288061 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:55.290238 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:55.290437 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.290684 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:55.290824 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.330652 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:35249
I20260709 13:17:55.330761  6256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:35249 every 8 connection(s)
I20260709 13:17:55.335529 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:55.342245  6260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:55.344569  6261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:55.345507  6263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:55.347301 29718 server_base.cc:1061] running on GCE node
I20260709 13:17:55.348209  6257 heartbeater.cc:344] Connected to a master server at 127.29.5.190:39253
I20260709 13:17:55.348546 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:17:55.348626  6257 heartbeater.cc:461] Registering TS with master...
W20260709 13:17:55.348839 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:55.349066 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603075349049 us; error 0 us; skew 500 ppm
I20260709 13:17:55.349689  6257 heartbeater.cc:507] Master 127.29.5.190:39253 requested a full tablet report, sending...
I20260709 13:17:55.349699 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:55.352269  6055 ts_manager.cc:194] Registered new tserver with Master: e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:55.352813 29718 webserver.cc:533] Webserver started at http://127.29.5.131:39321/ using document root <none> and password file <none>
I20260709 13:17:55.353466 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:55.353652 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:55.353951 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:55.353957  6055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55698
I20260709 13:17:55.355294 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "4a63ac02eaf04a859475a69224e32076"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:17:55.359875 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:17:55.363485  6268 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.364409 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:17:55.364766 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "4a63ac02eaf04a859475a69224e32076"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:17:55.365082 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:55.376828 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:55.378034 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:55.379917 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:55.382381 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:55.382640 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.382899 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:55.383086 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:55.425096 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:43701
I20260709 13:17:55.425195  6330 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:43701 every 8 connection(s)
I20260709 13:17:55.439472  6331 heartbeater.cc:344] Connected to a master server at 127.29.5.190:39253
I20260709 13:17:55.439914  6331 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:55.440654  6331 heartbeater.cc:507] Master 127.29.5.190:39253 requested a full tablet report, sending...
I20260709 13:17:55.442654  6055 ts_manager.cc:194] Registered new tserver with Master: 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:55.443114 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014678371s
I20260709 13:17:55.444113  6055 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55704
I20260709 13:17:55.467938  6055 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55712:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:55.470798  6055 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:55.546658  6146 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3fbef214d94e1ebef9ab2051c2745f (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:55.547008  6147 tablet_service.cc:1511] Processing CreateTablet for tablet d6b9330b8d6c4de29a5132a2f6d83300 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:55.548267  6146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3fbef214d94e1ebef9ab2051c2745f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.547050  6145 tablet_service.cc:1511] Processing CreateTablet for tablet 383748d8d1c847b7ae4924f149f87b95 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:55.549458  6147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b9330b8d6c4de29a5132a2f6d83300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.550112  6145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383748d8d1c847b7ae4924f149f87b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.554085  6296 tablet_service.cc:1511] Processing CreateTablet for tablet d6b9330b8d6c4de29a5132a2f6d83300 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:55.555523  6296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b9330b8d6c4de29a5132a2f6d83300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.556900  6144 tablet_service.cc:1511] Processing CreateTablet for tablet 7022f3c9cf624a1ca07505da165cbe54 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:55.558444  6144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7022f3c9cf624a1ca07505da165cbe54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.558843  6294 tablet_service.cc:1511] Processing CreateTablet for tablet 383748d8d1c847b7ae4924f149f87b95 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:55.556774  6295 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3fbef214d94e1ebef9ab2051c2745f (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:55.561028  6294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383748d8d1c847b7ae4924f149f87b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.563024  6295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3fbef214d94e1ebef9ab2051c2745f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.573375  6293 tablet_service.cc:1511] Processing CreateTablet for tablet 7022f3c9cf624a1ca07505da165cbe54 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:55.575332  6293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7022f3c9cf624a1ca07505da165cbe54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.588689  6143 tablet_service.cc:1511] Processing CreateTablet for tablet d131513b686d430abcc83e090de12692 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:55.589071  6221 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3fbef214d94e1ebef9ab2051c2745f (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:17:55.590260  6143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d131513b686d430abcc83e090de12692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.590355  6221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3fbef214d94e1ebef9ab2051c2745f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.592913  6220 tablet_service.cc:1511] Processing CreateTablet for tablet 383748d8d1c847b7ae4924f149f87b95 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:17:55.594281  6220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383748d8d1c847b7ae4924f149f87b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.596946  6219 tablet_service.cc:1511] Processing CreateTablet for tablet 7022f3c9cf624a1ca07505da165cbe54 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:17:55.598400  6219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7022f3c9cf624a1ca07505da165cbe54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.587625  6222 tablet_service.cc:1511] Processing CreateTablet for tablet d6b9330b8d6c4de29a5132a2f6d83300 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:17:55.601064  6222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b9330b8d6c4de29a5132a2f6d83300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.604676  6292 tablet_service.cc:1511] Processing CreateTablet for tablet d131513b686d430abcc83e090de12692 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:55.605477  6218 tablet_service.cc:1511] Processing CreateTablet for tablet d131513b686d430abcc83e090de12692 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:17:55.606582  6292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d131513b686d430abcc83e090de12692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.606899  6218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d131513b686d430abcc83e090de12692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.620097  6142 tablet_service.cc:1511] Processing CreateTablet for tablet 82ac476ffc5e450f802def75539d16dc (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:55.621604  6142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ac476ffc5e450f802def75539d16dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.628381  6217 tablet_service.cc:1511] Processing CreateTablet for tablet 82ac476ffc5e450f802def75539d16dc (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:55.629890  6217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ac476ffc5e450f802def75539d16dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.644440  6291 tablet_service.cc:1511] Processing CreateTablet for tablet 82ac476ffc5e450f802def75539d16dc (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:17:55.646562  6291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ac476ffc5e450f802def75539d16dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.665961  6216 tablet_service.cc:1511] Processing CreateTablet for tablet 0147d6ee371d4b5484512955cdaca6b4 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:55.667402  6216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0147d6ee371d4b5484512955cdaca6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.671126  6290 tablet_service.cc:1511] Processing CreateTablet for tablet 0147d6ee371d4b5484512955cdaca6b4 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:55.672490  6290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0147d6ee371d4b5484512955cdaca6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.675935  6144 tablet_service.cc:1511] Processing CreateTablet for tablet 0147d6ee371d4b5484512955cdaca6b4 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:17:55.677249  6144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0147d6ee371d4b5484512955cdaca6b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.691804  6143 tablet_service.cc:1511] Processing CreateTablet for tablet ebab6d77eb5d485ea8e17200459380be (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:55.693876  6143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebab6d77eb5d485ea8e17200459380be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.705101  6347 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:55.708920  6215 tablet_service.cc:1511] Processing CreateTablet for tablet ebab6d77eb5d485ea8e17200459380be (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:55.710865  6215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebab6d77eb5d485ea8e17200459380be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.713153  6347 tablet_bootstrap.cc:654] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.728302  6295 tablet_service.cc:1511] Processing CreateTablet for tablet ebab6d77eb5d485ea8e17200459380be (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:17:55.730180  6295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebab6d77eb5d485ea8e17200459380be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.740388  6346 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:55.749815  6347 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:55.753942  6347 ts_tablet_manager.cc:1403] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.011s
I20260709 13:17:55.751981  6144 tablet_service.cc:1511] Processing CreateTablet for tablet ec103f49f27145a2952f3da243c2e155 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:55.755111  6144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec103f49f27145a2952f3da243c2e155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.744587  6146 tablet_service.cc:1511] Processing CreateTablet for tablet 6165bbfad906416c83c9fc0e50cab16e (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:55.757293  6146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6165bbfad906416c83c9fc0e50cab16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.757731  6347 raft_consensus.cc:359] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.758527  6347 raft_consensus.cc:385] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.758805  6347 raft_consensus.cc:740] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.759565  6347 consensus_queue.cc:260] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.749372  6348 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:55.767009  6222 tablet_service.cc:1511] Processing CreateTablet for tablet 6165bbfad906416c83c9fc0e50cab16e (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:55.767740  6331 heartbeater.cc:499] Master 127.29.5.190:39253 was elected leader, sending a full tablet report...
I20260709 13:17:55.768822  6347 ts_tablet_manager.cc:1434] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 13:17:55.773368  6347 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:55.774313  6350 raft_consensus.cc:493] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.768772  6296 tablet_service.cc:1511] Processing CreateTablet for tablet 6165bbfad906416c83c9fc0e50cab16e (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:17:55.786806  6350 raft_consensus.cc:515] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.787743  6296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6165bbfad906416c83c9fc0e50cab16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.789637  6350 leader_election.cc:290] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:55.776669  6222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6165bbfad906416c83c9fc0e50cab16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.779227  6219 tablet_service.cc:1511] Processing CreateTablet for tablet ec103f49f27145a2952f3da243c2e155 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:55.779896  6347 tablet_bootstrap.cc:654] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.800594  6219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec103f49f27145a2952f3da243c2e155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.780561  6346 tablet_bootstrap.cc:654] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.781616  6294 tablet_service.cc:1511] Processing CreateTablet for tablet ec103f49f27145a2952f3da243c2e155 (DEFAULT_TABLE table=test-workload [id=5f242de5c7b2450d8b3ea4a2f241d476]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:17:55.803335  6294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec103f49f27145a2952f3da243c2e155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:55.805642  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
W20260709 13:17:55.807427  6270 leader_election.cc:343] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.782377  6348 tablet_bootstrap.cc:654] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.815809  6347 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:55.816460  6347 ts_tablet_manager.cc:1403] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 13:17:55.819351  6347 raft_consensus.cc:359] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.820176  6347 raft_consensus.cc:385] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.820544  6347 raft_consensus.cc:740] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.824494  6347 consensus_queue.cc:260] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.830534  6348 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:55.831094  6348 ts_tablet_manager.cc:1403] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 13:17:55.832914  6346 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:55.833436  6346 ts_tablet_manager.cc:1403] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.093s	user 0.001s	sys 0.017s
I20260709 13:17:55.834223  6348 raft_consensus.cc:359] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.835165  6348 raft_consensus.cc:385] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.835464  6348 raft_consensus.cc:740] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.836284  6347 ts_tablet_manager.cc:1434] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:17:55.836198  6348 consensus_queue.cc:260] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.836585  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:55.837344  6347 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:55.837271  6232 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:55.839278  6269 leader_election.cc:304] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 7c8689a013884d029b7feadd58d5ba91
I20260709 13:17:55.840878  6350 raft_consensus.cc:2804] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.841338  6350 raft_consensus.cc:493] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.841768  6350 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.844563  6347 tablet_bootstrap.cc:654] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.844257  6346 raft_consensus.cc:359] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.845506  6346 raft_consensus.cc:385] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.845917  6346 raft_consensus.cc:740] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.846793  6346 consensus_queue.cc:260] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.851533  6257 heartbeater.cc:499] Master 127.29.5.190:39253 was elected leader, sending a full tablet report...
I20260709 13:17:55.851969  6348 ts_tablet_manager.cc:1434] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.015s
I20260709 13:17:55.853303  6348 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:55.859894  6348 tablet_bootstrap.cc:654] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.873507  6350 raft_consensus.cc:515] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.877864  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:55.878720  6157 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.892302  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:55.893218  6232 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.905211  6182 heartbeater.cc:499] Master 127.29.5.190:39253 was elected leader, sending a full tablet report...
I20260709 13:17:55.906121  6346 ts_tablet_manager.cc:1434] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.072s	user 0.041s	sys 0.023s
I20260709 13:17:55.907697  6346 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:55.909981  6350 leader_election.cc:290] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:55.912437  6157 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:55.916911  6346 tablet_bootstrap.cc:654] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:55.929536  6332 tablet.cc:2406] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:55.939716  6232 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:55.946758  6270 leader_election.cc:304] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:55.949249  6350 raft_consensus.cc:2804] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.952250  6347 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:55.952853  6347 ts_tablet_manager.cc:1403] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.116s	user 0.048s	sys 0.060s
I20260709 13:17:55.953982  6348 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:55.954555  6348 ts_tablet_manager.cc:1403] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.101s	user 0.054s	sys 0.040s
I20260709 13:17:55.956115  6347 raft_consensus.cc:359] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.957010  6347 raft_consensus.cc:385] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.957273  6347 raft_consensus.cc:740] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.957631  6348 raft_consensus.cc:359] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:55.958348  6348 raft_consensus.cc:385] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.958067  6347 consensus_queue.cc:260] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.958633  6348 raft_consensus.cc:740] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.959908  6350 raft_consensus.cc:697] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:55.959403  6348 consensus_queue.cc:260] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:55.961100  6350 consensus_queue.cc:237] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.962463  6348 ts_tablet_manager.cc:1434] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:55.963043  6347 ts_tablet_manager.cc:1434] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:17:55.963474  6348 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:55.964079  6347 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:55.970469  6348 tablet_bootstrap.cc:654] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.970738  6347 tablet_bootstrap.cc:654] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.980031  6053 catalog_manager.cc:5697] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.983551  6347 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:55.983564  6348 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:55.984377  6347 ts_tablet_manager.cc:1403] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260709 13:17:55.984400  6348 ts_tablet_manager.cc:1403] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:17:55.984517  6346 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:55.985244  6346 ts_tablet_manager.cc:1403] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.015s
I20260709 13:17:55.987607  6348 raft_consensus.cc:359] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.988420  6348 raft_consensus.cc:385] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.988291  6346 raft_consensus.cc:359] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:55.988857  6348 raft_consensus.cc:740] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.988617  6347 raft_consensus.cc:359] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.989101  6346 raft_consensus.cc:385] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.989719  6348 consensus_queue.cc:260] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:55.989359  6347 raft_consensus.cc:385] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.992244  6346 raft_consensus.cc:740] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.993873  6348 ts_tablet_manager.cc:1434] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:17:55.992436  6347 raft_consensus.cc:740] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.998050  6346 consensus_queue.cc:260] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:55.998451  6348 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:55.998437  6347 consensus_queue.cc:260] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.001211  6347 ts_tablet_manager.cc:1434] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:17:56.002668  6347 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:56.003242  6346 ts_tablet_manager.cc:1434] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:17:56.004357  6346 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.006174  6348 tablet_bootstrap.cc:654] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.009840  6347 tablet_bootstrap.cc:654] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.010854  6346 tablet_bootstrap.cc:654] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.042771  6347 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:56.042861  6348 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.043311  6347 ts_tablet_manager.cc:1403] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.019s
I20260709 13:17:56.043497  6348 ts_tablet_manager.cc:1403] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.021s
I20260709 13:17:56.043744  6346 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.044390  6346 ts_tablet_manager.cc:1403] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.031s
I20260709 13:17:56.045964  6347 raft_consensus.cc:359] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.046599  6347 raft_consensus.cc:385] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.046881  6347 raft_consensus.cc:740] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.046712  6348 raft_consensus.cc:359] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.047588  6348 raft_consensus.cc:385] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.047379  6346 raft_consensus.cc:359] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.047977  6348 raft_consensus.cc:740] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.048280  6346 raft_consensus.cc:385] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.047922  6347 consensus_queue.cc:260] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.048661  6346 raft_consensus.cc:740] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.049018  6348 consensus_queue.cc:260] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.049579  6346 consensus_queue.cc:260] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.051318  6348 ts_tablet_manager.cc:1434] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:56.052289  6347 ts_tablet_manager.cc:1434] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:17:56.052390  6348 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:56.053258  6357 raft_consensus.cc:493] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.053548  6347 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:56.053783  6357 raft_consensus.cc:515] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
W20260709 13:17:56.056921  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:56.057706  6357 leader_election.cc:290] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.060739  6347 tablet_bootstrap.cc:654] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.060886  6348 tablet_bootstrap.cc:654] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.065604  6346 ts_tablet_manager.cc:1434] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:17:56.067008  6346 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.075624  6350 raft_consensus.cc:493] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.076443  6348 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.076212  6350 raft_consensus.cc:515] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.079397  6348 ts_tablet_manager.cc:1403] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:17:56.082324  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d131513b686d430abcc83e090de12692" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:56.083055  6232 raft_consensus.cc:2468] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.082698  6348 raft_consensus.cc:359] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.083389  6346 tablet_bootstrap.cc:654] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.083621  6348 raft_consensus.cc:385] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.084008  6348 raft_consensus.cc:740] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.084431  6269 leader_election.cc:304] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.085804  6360 raft_consensus.cc:2804] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.086203  6360 raft_consensus.cc:493] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.086639  6360 raft_consensus.cc:3060] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.087498  6350 leader_election.cc:290] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.076146  6347 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:56.088485  6347 ts_tablet_manager.cc:1403] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.008s
I20260709 13:17:56.096771  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d131513b686d430abcc83e090de12692" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.096864  6347 raft_consensus.cc:359] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.097879  6347 raft_consensus.cc:385] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.098251  6347 raft_consensus.cc:740] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
W20260709 13:17:56.098461  6270 leader_election.cc:343] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.099031  6347 consensus_queue.cc:260] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.084889  6348 consensus_queue.cc:260] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.100126  6346 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.100672  6346 ts_tablet_manager.cc:1403] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 13:17:56.101889  6347 ts_tablet_manager.cc:1434] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:17:56.102188  6348 ts_tablet_manager.cc:1434] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:17:56.102962  6347 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:56.103258  6348 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:56.103789  6346 raft_consensus.cc:359] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.104570  6346 raft_consensus.cc:385] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.104873  6346 raft_consensus.cc:740] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.105855  6346 consensus_queue.cc:260] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.110453  6347 tablet_bootstrap.cc:654] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.110870  6360 raft_consensus.cc:515] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.113672  6346 ts_tablet_manager.cc:1434] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:17:56.113891  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d131513b686d430abcc83e090de12692" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.114794  6346 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
W20260709 13:17:56.115371  6270 leader_election.cc:343] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.117579  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d131513b686d430abcc83e090de12692" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:56.118194  6232 raft_consensus.cc:3060] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.122026  6346 tablet_bootstrap.cc:654] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.128284  6232 raft_consensus.cc:2468] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.130302  6269 leader_election.cc:304] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 7c8689a013884d029b7feadd58d5ba91
I20260709 13:17:56.131469  6350 raft_consensus.cc:2804] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.134420  6346 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.135166  6346 ts_tablet_manager.cc:1403] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 13:17:56.137374  6360 leader_election.cc:290] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.138990  6346 raft_consensus.cc:359] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.140215  6346 raft_consensus.cc:385] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.140542  6346 raft_consensus.cc:740] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.141847  6350 raft_consensus.cc:697] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:56.142369  6346 consensus_queue.cc:260] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.142843  6350 consensus_queue.cc:237] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.110514  6348 tablet_bootstrap.cc:654] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.148131  6346 ts_tablet_manager.cc:1434] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:17:56.149338  6346 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.155681  6348 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.156268  6348 ts_tablet_manager.cc:1403] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.004s
I20260709 13:17:56.158576  6346 tablet_bootstrap.cc:654] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.161163  6374 raft_consensus.cc:493] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.159735  6348 raft_consensus.cc:359] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.164651  6348 raft_consensus.cc:385] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.164402  6374 raft_consensus.cc:515] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.164994  6348 raft_consensus.cc:740] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.165961  6348 consensus_queue.cc:260] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.166755  6374 leader_election.cc:290] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.169355  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.170049  6157 raft_consensus.cc:2468] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.171063  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
W20260709 13:17:56.172581  6269 leader_election.cc:343] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.173633  6270 leader_election.cc:304] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:17:56.174808  6374 raft_consensus.cc:2804] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.175325  6374 raft_consensus.cc:493] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.175582  6348 ts_tablet_manager.cc:1434] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:17:56.175693  6374 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.174248  6052 catalog_manager.cc:5697] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.179473  6348 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:56.183929  6374 raft_consensus.cc:515] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.186760  6348 tablet_bootstrap.cc:654] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.187072  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.187740  6157 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.199069  6157 raft_consensus.cc:2468] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.200834  6270 leader_election.cc:304] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:56.201949  6350 raft_consensus.cc:2804] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.202455  6350 raft_consensus.cc:697] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:56.203313  6350 consensus_queue.cc:237] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.203992  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:56.205329  6374 leader_election.cc:290] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
W20260709 13:17:56.206244  6269 leader_election.cc:343] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.206568  6360 raft_consensus.cc:493] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.207296  6360 raft_consensus.cc:515] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.211606  6346 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.211953  6360 leader_election.cc:290] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.213716  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:56.214655  6232 raft_consensus.cc:2468] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.216216  6269 leader_election.cc:304] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.212314  6346 ts_tablet_manager.cc:1403] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.000s
I20260709 13:17:56.213059  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.220758  6360 raft_consensus.cc:2804] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:17:56.221230  6270 leader_election.cc:343] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.221300  6360 raft_consensus.cc:493] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.223201  6346 raft_consensus.cc:359] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.224227  6346 raft_consensus.cc:385] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.224606  6346 raft_consensus.cc:740] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.223265  6360 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.233816  6346 consensus_queue.cc:260] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.238121  6054 catalog_manager.cc:5697] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.241441  6355 raft_consensus.cc:493] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.247669  6355 raft_consensus.cc:515] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:56.250573  6355 leader_election.cc:290] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.239465  6346 ts_tablet_manager.cc:1434] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:17:56.253145  6346 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.256019  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "7c8689a013884d029b7feadd58d5ba91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076" is_pre_election: true
I20260709 13:17:56.252933  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "7c8689a013884d029b7feadd58d5ba91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
W20260709 13:17:56.259038  6120 leader_election.cc:343] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.259372  6347 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:56.259930  6347 ts_tablet_manager.cc:1403] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.157s	user 0.054s	sys 0.095s
I20260709 13:17:56.261344  6122 leader_election.cc:304] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91; no voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:17:56.262636  6357 raft_consensus.cc:2749] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.265883  6346 tablet_bootstrap.cc:654] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.263108  6347 raft_consensus.cc:359] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:56.270710  6347 raft_consensus.cc:385] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.271118  6347 raft_consensus.cc:740] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.271971  6347 consensus_queue.cc:260] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:56.274329  6347 ts_tablet_manager.cc:1434] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:17:56.275666  6347 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:56.281965  6347 tablet_bootstrap.cc:654] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.285739  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076" is_pre_election: true
I20260709 13:17:56.286628  6306 raft_consensus.cc:2468] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 0.
I20260709 13:17:56.288440  6197 leader_election.cc:304] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.289515  6355 raft_consensus.cc:2804] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.289907  6355 raft_consensus.cc:493] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.290237  6355 raft_consensus.cc:3060] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.243741  6360 raft_consensus.cc:515] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.295178  6360 leader_election.cc:290] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.295903  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
W20260709 13:17:56.297452  6270 leader_election.cc:343] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:56.297797  6348 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.298105  6355 raft_consensus.cc:515] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:56.298584  6348 ts_tablet_manager.cc:1403] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.119s	user 0.028s	sys 0.027s
I20260709 13:17:56.301560  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:17:56.302178  6306 raft_consensus.cc:3060] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.303960  6355 leader_election.cc:290] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.303072  6348 raft_consensus.cc:359] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.305006  6348 raft_consensus.cc:385] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.305455  6348 raft_consensus.cc:740] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.306619  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:56.307343  6232 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.306638  6348 consensus_queue.cc:260] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.309959  6348 ts_tablet_manager.cc:1434] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:17:56.310472  6306 raft_consensus.cc:2468] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 1.
I20260709 13:17:56.311115  6348 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:56.311833  6197 leader_election.cc:304] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.314965  6157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.315644  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.315933  6157 raft_consensus.cc:2468] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 0.
I20260709 13:17:56.322543  6355 raft_consensus.cc:2804] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.335692  6355 raft_consensus.cc:697] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:17:56.336879  6355 consensus_queue.cc:237] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:17:56.334475  6232 raft_consensus.cc:2468] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.351049  6269 leader_election.cc:304] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 7c8689a013884d029b7feadd58d5ba91
I20260709 13:17:56.352231  6360 raft_consensus.cc:2804] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.353350  6360 raft_consensus.cc:697] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:56.354159  6384 raft_consensus.cc:493] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.354537  6360 consensus_queue.cc:237] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.354724  6384 raft_consensus.cc:515] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.357031  6346 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.357342  6347 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:56.357640  6346 ts_tablet_manager.cc:1403] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.009s
I20260709 13:17:56.357894  6347 ts_tablet_manager.cc:1403] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.082s	user 0.041s	sys 0.028s
I20260709 13:17:56.358076  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.358783  6156 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 0.
I20260709 13:17:56.360034  6196 leader_election.cc:304] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.360951  6346 raft_consensus.cc:359] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.361730  6346 raft_consensus.cc:385] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.362257  6384 leader_election.cc:290] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.362490  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076" is_pre_election: true
I20260709 13:17:56.362797  6384 raft_consensus.cc:2804] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.362986  6348 tablet_bootstrap.cc:654] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.363127  6306 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 0.
I20260709 13:17:56.364288  6347 raft_consensus.cc:359] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.365093  6347 raft_consensus.cc:385] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.365444  6347 raft_consensus.cc:740] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.362052  6346 raft_consensus.cc:740] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.366454  6346 consensus_queue.cc:260] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.363166  6384 raft_consensus.cc:493] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.368356  6346 ts_tablet_manager.cc:1434] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:17:56.368322  6384 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.369585  6346 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.373464  6347 consensus_queue.cc:260] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.375880  6347 ts_tablet_manager.cc:1434] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:17:56.376900  6347 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:56.377074  6346 tablet_bootstrap.cc:654] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.377017  6384 raft_consensus.cc:515] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.380609  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.381404  6156 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.382926  6347 tablet_bootstrap.cc:654] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.389992  6357 raft_consensus.cc:493] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.390678  6357 raft_consensus.cc:515] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.391579  6386 raft_consensus.cc:493] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.390334  6052 catalog_manager.cc:5697] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.391680  6384 leader_election.cc:290] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.392226  6386 raft_consensus.cc:515] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.394250  6156 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 1.
I20260709 13:17:56.394747  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "7c8689a013884d029b7feadd58d5ba91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076" is_pre_election: true
I20260709 13:17:56.395459  6306 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c8689a013884d029b7feadd58d5ba91 in term 0.
I20260709 13:17:56.396601  6386 leader_election.cc:290] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.397061  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "7c8689a013884d029b7feadd58d5ba91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:56.397354  6122 leader_election.cc:304] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:56.397800  6232 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c8689a013884d029b7feadd58d5ba91 in term 0.
I20260709 13:17:56.397692  6305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:17:56.398926  6305 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.398852  6196 leader_election.cc:304] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.399814  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076" is_pre_election: true
I20260709 13:17:56.400471  6386 raft_consensus.cc:2804] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.401000  6386 raft_consensus.cc:697] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:17:56.401702  6357 leader_election.cc:290] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.402343  6357 raft_consensus.cc:2804] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.401927  6386 consensus_queue.cc:237] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.402781  6357 raft_consensus.cc:493] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.403198  6357 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.415333  6348 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.416438  6348 ts_tablet_manager.cc:1403] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.007s
I20260709 13:17:56.415333  6346 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.419706  6346 ts_tablet_manager.cc:1403] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.004s
I20260709 13:17:56.419466  6348 raft_consensus.cc:359] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.420239  6348 raft_consensus.cc:385] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.420549  6348 raft_consensus.cc:740] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.421231  6348 consensus_queue.cc:260] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.421623  6054 catalog_manager.cc:5697] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.422638  6346 raft_consensus.cc:359] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.423388  6346 raft_consensus.cc:385] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.423507  6348 ts_tablet_manager.cc:1434] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:56.424899  6348 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:56.425774  6305 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 1.
I20260709 13:17:56.426693  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.427502  6156 raft_consensus.cc:2393] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in current term 1: Already voted for candidate 4a63ac02eaf04a859475a69224e32076 in this term.
I20260709 13:17:56.423693  6346 raft_consensus.cc:740] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.428719  6196 leader_election.cc:304] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91
I20260709 13:17:56.429612  6386 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.429387  6346 consensus_queue.cc:260] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.431510  6346 ts_tablet_manager.cc:1434] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:17:56.432443  6348 tablet_bootstrap.cc:654] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.441442  6357 raft_consensus.cc:515] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.444070  6357 leader_election.cc:290] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 election: Requested vote from peers e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.444279  6052 catalog_manager.cc:5697] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.447497  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "7c8689a013884d029b7feadd58d5ba91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:56.448215  6232 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.449229  6346 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.448995  6305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "7c8689a013884d029b7feadd58d5ba91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:17:56.449782  6305 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.454849  6386 raft_consensus.cc:2749] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:56.456902  6346 tablet_bootstrap.cc:654] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.459473  6305 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8689a013884d029b7feadd58d5ba91 in term 1.
I20260709 13:17:56.460852  6122 leader_election.cc:304] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:56.459312  6232 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c8689a013884d029b7feadd58d5ba91 in term 1.
I20260709 13:17:56.463616  6348 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.464417  6348 ts_tablet_manager.cc:1403] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.003s
I20260709 13:17:56.465121  6347 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:56.465721  6347 ts_tablet_manager.cc:1403] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.011s
I20260709 13:17:56.468928  6347 raft_consensus.cc:359] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.469481  6347 raft_consensus.cc:385] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.469739  6347 raft_consensus.cc:740] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.470357  6347 consensus_queue.cc:260] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.468957  6348 raft_consensus.cc:359] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.471271  6348 raft_consensus.cc:385] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.471567  6348 raft_consensus.cc:740] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.471946  6357 raft_consensus.cc:2804] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.472553  6357 raft_consensus.cc:697] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 LEADER]: Becoming Leader. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Running, Role: LEADER
I20260709 13:17:56.472365  6348 consensus_queue.cc:260] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.473449  6346 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.473441  6357 consensus_queue.cc:237] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.474107  6346 ts_tablet_manager.cc:1403] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:17:56.474918  6347 ts_tablet_manager.cc:1434] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:17:56.475869  6348 ts_tablet_manager.cc:1434] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:17:56.476038  6347 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: Bootstrap starting.
I20260709 13:17:56.476784  6348 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: Bootstrap starting.
I20260709 13:17:56.477453  6346 raft_consensus.cc:359] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.478143  6346 raft_consensus.cc:385] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.478380  6346 raft_consensus.cc:740] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.479117  6346 consensus_queue.cc:260] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.481544  6346 ts_tablet_manager.cc:1434] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:17:56.482450  6346 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:17:56.482512  6347 tablet_bootstrap.cc:654] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.483817  6348 tablet_bootstrap.cc:654] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.490535  6346 tablet_bootstrap.cc:654] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:56.496819  6054 catalog_manager.cc:5697] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7c8689a013884d029b7feadd58d5ba91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.497838  6348 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: No bootstrap required, opened a new log
I20260709 13:17:56.498340  6348 ts_tablet_manager.cc:1403] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:17:56.501410  6348 raft_consensus.cc:359] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.502091  6348 raft_consensus.cc:385] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.502405  6348 raft_consensus.cc:740] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.503386  6348 consensus_queue.cc:260] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.506743  6348 ts_tablet_manager.cc:1434] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:17:56.516975  6346 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: No bootstrap required, opened a new log
I20260709 13:17:56.517434  6346 ts_tablet_manager.cc:1403] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.010s
I20260709 13:17:56.517793  6347 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: No bootstrap required, opened a new log
I20260709 13:17:56.518325  6347 ts_tablet_manager.cc:1403] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.016s
I20260709 13:17:56.520320  6346 raft_consensus.cc:359] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.521073  6346 raft_consensus.cc:385] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.521351  6346 raft_consensus.cc:740] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.521543  6347 raft_consensus.cc:359] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.522330  6347 raft_consensus.cc:385] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:56.522663  6347 raft_consensus.cc:740] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Initialized, Role: FOLLOWER
I20260709 13:17:56.522140  6346 consensus_queue.cc:260] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.523397  6347 consensus_queue.cc:260] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.525753  6347 ts_tablet_manager.cc:1434] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:17:56.526557  6346 ts_tablet_manager.cc:1434] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:17:56.530696  6360 consensus_queue.cc:1048] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:56.546705  6156 raft_consensus.cc:3060] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.555276  6360 consensus_queue.cc:1048] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.572081  6374 consensus_queue.cc:1048] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.572813  6360 consensus_queue.cc:1048] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.603606  6350 raft_consensus.cc:493] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.604151  6350 raft_consensus.cc:515] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.605787  6350 leader_election.cc:290] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.606716  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.607007  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:56.607410  6156 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.607704  6232 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.608754  6270 leader_election.cc:304] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:56.609509  6350 raft_consensus.cc:2804] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.609930  6350 raft_consensus.cc:493] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.610234  6350 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.615492  6350 raft_consensus.cc:515] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.617302  6350 leader_election.cc:290] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.618163  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.618423  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:56.618888  6156 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.619014  6232 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.626654  6232 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.626659  6156 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.628091  6270 leader_election.cc:304] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:56.628822  6350 raft_consensus.cc:2804] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.629320  6350 raft_consensus.cc:697] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:56.630178  6350 consensus_queue.cc:237] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.637470  6053 catalog_manager.cc:5697] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.638406  6350 raft_consensus.cc:493] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.638942  6350 raft_consensus.cc:515] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.641088  6350 leader_election.cc:290] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.641832  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.642184  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:56.643540  6156 raft_consensus.cc:2468] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.643630  6232 raft_consensus.cc:2468] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 0.
I20260709 13:17:56.644718  6270 leader_election.cc:304] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:17:56.646190  6350 raft_consensus.cc:2804] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.646525  6350 raft_consensus.cc:493] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.646834  6350 raft_consensus.cc:3060] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.652092  6350 raft_consensus.cc:515] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.653914  6350 leader_election.cc:290] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:56.654839  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.655153  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:56.655750  6232 raft_consensus.cc:3060] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.655828  6156 raft_consensus.cc:3060] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.662830  6232 raft_consensus.cc:2468] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.662830  6156 raft_consensus.cc:2468] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:56.664263  6269 leader_election.cc:304] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.664971  6350 raft_consensus.cc:2804] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.665383  6350 raft_consensus.cc:697] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:56.666170  6350 consensus_queue.cc:237] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.669623  6386 raft_consensus.cc:493] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.670158  6386 raft_consensus.cc:515] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.672267  6386 leader_election.cc:290] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.672802  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6165bbfad906416c83c9fc0e50cab16e" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91" is_pre_election: true
I20260709 13:17:56.673463  6156 raft_consensus.cc:2468] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 0.
I20260709 13:17:56.673622  6305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6165bbfad906416c83c9fc0e50cab16e" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076" is_pre_election: true
I20260709 13:17:56.674316  6305 raft_consensus.cc:2468] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 0.
I20260709 13:17:56.674690  6196 leader_election.cc:304] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.674427  6053 catalog_manager.cc:5697] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:56.675529  6386 raft_consensus.cc:2804] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:56.675948  6386 raft_consensus.cc:493] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.676277  6386 raft_consensus.cc:3060] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.681877  6386 raft_consensus.cc:515] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.683909  6386 leader_election.cc:290] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:17:56.684546  6156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6165bbfad906416c83c9fc0e50cab16e" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:17:56.684935  6305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6165bbfad906416c83c9fc0e50cab16e" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:17:56.685242  6156 raft_consensus.cc:3060] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.685567  6305 raft_consensus.cc:3060] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.692353  6156 raft_consensus.cc:2468] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 1.
I20260709 13:17:56.692353  6305 raft_consensus.cc:2468] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 1.
I20260709 13:17:56.693737  6197 leader_election.cc:304] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:56.694367  6386 raft_consensus.cc:2804] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:56.694880  6386 raft_consensus.cc:697] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:17:56.695545  6386 consensus_queue.cc:237] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:56.702298  6053 catalog_manager.cc:5697] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.758140  6156 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.759675  6350 consensus_queue.cc:1048] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.765489  6350 consensus_queue.cc:1048] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.771952  6350 consensus_queue.cc:1048] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.789222  6374 consensus_queue.cc:1048] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.793052  6157 raft_consensus.cc:3060] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:56.802537  6386 consensus_queue.cc:1048] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:56.815855  6355 consensus_queue.cc:1048] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.816861  6384 consensus_queue.cc:1048] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.837231  6417 consensus_queue.cc:1048] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.866321  6357 consensus_queue.cc:1048] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:56.876788  6420 consensus_queue.cc:1048] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:56.922981 29718 ts_manager.cc:295] Set tserver state for 7c8689a013884d029b7feadd58d5ba91 to MAINTENANCE_MODE
I20260709 13:17:56.923755 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
I20260709 13:17:56.946256 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:17:56.947085 29718 tablet_replica.cc:333] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.947744 29718 raft_consensus.cc:2243] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.948232 29718 raft_consensus.cc:2272] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.950453 29718 tablet_replica.cc:333] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.950995 29718 raft_consensus.cc:2243] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.951373 29718 raft_consensus.cc:2272] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.953125 29718 tablet_replica.cc:333] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.953694 29718 raft_consensus.cc:2243] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.954111 29718 raft_consensus.cc:2272] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.956547 29718 tablet_replica.cc:333] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.957100 29718 raft_consensus.cc:2243] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.957502 29718 raft_consensus.cc:2272] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.959869 29718 tablet_replica.cc:333] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.960433 29718 raft_consensus.cc:2243] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.960983 29718 raft_consensus.cc:2272] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.963706 29718 tablet_replica.cc:333] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.964300 29718 raft_consensus.cc:2243] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.964699 29718 raft_consensus.cc:2272] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.966805 29718 tablet_replica.cc:333] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.967442 29718 raft_consensus.cc:2243] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:17:56.968305 29718 raft_consensus.cc:2272] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.970440 29718 tablet_replica.cc:333] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.970964 29718 raft_consensus.cc:2243] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.971355 29718 raft_consensus.cc:2272] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:56.972572  6270 consensus_peers.cc:597] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.973639 29718 tablet_replica.cc:333] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.974224 29718 raft_consensus.cc:2243] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.974599 29718 raft_consensus.cc:2272] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:56.976619 29718 tablet_replica.cc:333] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: stopping tablet replica
I20260709 13:17:56.977094 29718 raft_consensus.cc:2243] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:56.977483 29718 raft_consensus.cc:2272] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:57.009979 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
I20260709 13:17:57.028909  6374 consensus_queue.cc:1048] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:57.046576  6270 consensus_peers.cc:597] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:57.047114  6270 consensus_peers.cc:597] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:57.057861  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:57.151304  6196 consensus_peers.cc:597] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:57.244452  6196 consensus_peers.cc:597] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:57.244936  6270 consensus_peers.cc:597] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.253558  6417 consensus_queue.cc:1048] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:57.265255  6270 consensus_peers.cc:597] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:57.274881  6350 consensus_queue.cc:1048] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:17:57.367400  6270 consensus_peers.cc:597] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:57.381064  6196 consensus_peers.cc:597] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:17:58.058894  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:58.256168  6196 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111) [suppressed 122 similar messages]
I20260709 13:17:58.375811  6429 raft_consensus.cc:493] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7c8689a013884d029b7feadd58d5ba91)
I20260709 13:17:58.376320  6429 raft_consensus.cc:515] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:58.378324  6429 leader_election.cc:290] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:58.379530  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" is_pre_election: true
I20260709 13:17:58.380223  6232 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 1.
I20260709 13:17:58.381237  6269 leader_election.cc:304] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:17:58.381922  6429 raft_consensus.cc:2804] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:58.382298  6429 raft_consensus.cc:493] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7c8689a013884d029b7feadd58d5ba91)
W20260709 13:17:58.382478  6270 leader_election.cc:336] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111)
I20260709 13:17:58.382637  6429 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:58.387756  6429 raft_consensus.cc:515] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:58.389346  6429 leader_election.cc:290] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:17:58.390345  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:17:58.390902  6232 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:58.393292  6270 leader_election.cc:336] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111)
I20260709 13:17:58.396013  6232 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 2.
I20260709 13:17:58.397047  6269 leader_election.cc:304] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 7c8689a013884d029b7feadd58d5ba91
I20260709 13:17:58.397723  6429 raft_consensus.cc:2804] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:58.398154  6429 raft_consensus.cc:697] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:17:58.398952  6429 consensus_queue.cc:237] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:17:58.405478  6054 catalog_manager.cc:5697] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 1 to 2, leader changed from 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:58.953415  6270 consensus_peers.cc:597] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:58.999542  6232 raft_consensus.cc:1275] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:59.000917  6429 consensus_queue.cc:1048] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:59.059917  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:17:59.374960  6270 consensus_peers.cc:597] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.438194  6270 consensus_peers.cc:597] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.511857  6270 consensus_peers.cc:597] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.679867  6270 consensus_peers.cc:597] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.747251  6196 consensus_peers.cc:597] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.801599  6196 consensus_peers.cc:597] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.840736  6196 consensus_peers.cc:597] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.884608  6270 consensus_peers.cc:597] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:17:59.981040  6270 consensus_peers.cc:597] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:00.061033  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:01.062147  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:18:01.360011  6270 consensus_peers.cc:597] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:01.821705  6270 consensus_peers.cc:597] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:01.901513  6270 consensus_peers.cc:597] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:02.029217 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:02.036464  6444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:02.037701  6445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:02.041108  6447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:02.044983 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:02.050354 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:02.050588 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:02.050778 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603082050760 us; error 0 us; skew 500 ppm
I20260709 13:18:02.051376 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:02.053936 29718 webserver.cc:533] Webserver started at http://127.29.5.129:34979/ using document root <none> and password file <none>
I20260709 13:18:02.054435 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:02.054621 29718 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:18:02.058964 29718 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:18:02.062686  6452 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:18:02.063030  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:02.063589 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:02.064004 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "7c8689a013884d029b7feadd58d5ba91"
format_stamp: "Formatted at 2026-07-09 13:17:55 on dist-test-slave-kgkf"
I20260709 13:18:02.064299 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:02.102144 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:02.103335 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:02.104880 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:02.108464  6459 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:18:02.158617 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:18:02.158979 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:18:02.159337 29718 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:18:02.164285  6459 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
W20260709 13:18:02.176973  6270 consensus_peers.cc:597] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:02.181795  6459 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.182955  6459 tablet_bootstrap.cc:492] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.183665  6459 ts_tablet_manager.cc:1403] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:18:02.186703  6459 raft_consensus.cc:359] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:18:02.187431  6459 raft_consensus.cc:740] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.188231  6459 consensus_queue.cc:260] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:18:02.191053  6459 ts_tablet_manager.cc:1434] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:02.191991  6459 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.206408  6459 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.207357  6459 tablet_bootstrap.cc:492] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.208143  6459 ts_tablet_manager.cc:1403] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:18:02.210886  6459 raft_consensus.cc:359] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.211617  6459 raft_consensus.cc:740] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.212405 29718 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:18:02.212853 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.054s	user 0.053s	sys 0.001s
I20260709 13:18:02.212386  6459 consensus_queue.cc:260] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.214859  6459 ts_tablet_manager.cc:1434] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:02.215794  6459 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.231755  6459 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.233088  6459 tablet_bootstrap.cc:492] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.233906  6459 ts_tablet_manager.cc:1403] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:18:02.237175  6459 raft_consensus.cc:359] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.238036  6459 raft_consensus.cc:740] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
W20260709 13:18:02.238571  6196 consensus_peers.cc:597] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:02.239151  6459 consensus_queue.cc:260] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.242007  6459 ts_tablet_manager.cc:1434] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:18:02.243003  6459 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.258536  6459 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.259611  6459 tablet_bootstrap.cc:492] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.260602  6459 ts_tablet_manager.cc:1403] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:18:02.262704  6459 raft_consensus.cc:359] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.263252  6459 raft_consensus.cc:740] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.263943  6459 consensus_queue.cc:260] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.265501  6459 ts_tablet_manager.cc:1434] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:02.266288  6459 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.280416  6459 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.281260  6459 tablet_bootstrap.cc:492] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.281836  6459 ts_tablet_manager.cc:1403] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:18:02.283900  6459 raft_consensus.cc:359] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.284448  6459 raft_consensus.cc:740] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.285068  6459 consensus_queue.cc:260] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.285636 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:32965
I20260709 13:18:02.285792  6522 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:32965 every 8 connection(s)
I20260709 13:18:02.286731  6459 ts_tablet_manager.cc:1434] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:18:02.287505  6459 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.290547 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.309263  6523 heartbeater.cc:344] Connected to a master server at 127.29.5.190:39253
I20260709 13:18:02.309434  6459 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.309718  6523 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:02.310364  6459 tablet_bootstrap.cc:492] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.310701  6523 heartbeater.cc:507] Master 127.29.5.190:39253 requested a full tablet report, sending...
I20260709 13:18:02.310897  6459 ts_tablet_manager.cc:1403] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 13:18:02.313465  6459 raft_consensus.cc:359] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.313970  6459 raft_consensus.cc:740] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.314569  6459 consensus_queue.cc:260] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.316721  6459 ts_tablet_manager.cc:1434] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:18:02.317559  6459 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.318097  6052 ts_manager.cc:194] Re-registered known tserver with Master: 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965)
I20260709 13:18:02.318722  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:02.319454  6306 raft_consensus.cc:606] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:02.324426  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:02.325016  6306 raft_consensus.cc:606] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:02.328918  6052 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60740
I20260709 13:18:02.333321  6523 heartbeater.cc:499] Master 127.29.5.190:39253 was elected leader, sending a full tablet report...
I20260709 13:18:02.334216  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:02.334993  6306 raft_consensus.cc:606] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:02.340385 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:02.340543  6459 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.341161 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:02.341605  6459 tablet_bootstrap.cc:492] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.342053 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.342360  6459 ts_tablet_manager.cc:1403] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:18:02.346020  6459 raft_consensus.cc:359] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.346671  6459 raft_consensus.cc:740] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.347508  6459 consensus_queue.cc:260] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.349787  6459 ts_tablet_manager.cc:1434] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:18:02.350667  6459 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.365830  6459 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.366843  6459 tablet_bootstrap.cc:492] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.367508  6459 ts_tablet_manager.cc:1403] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:18:02.369431  6459 raft_consensus.cc:359] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.369872  6459 raft_consensus.cc:740] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.370414  6459 consensus_queue.cc:260] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.371832  6459 ts_tablet_manager.cc:1434] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:02.372681  6459 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.380910  6442 raft_consensus.cc:993] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:02.381469  6460 raft_consensus.cc:1081] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:02.383316  6232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:02.383879  6232 raft_consensus.cc:493] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.384230  6232 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.385416  6459 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.386303  6459 tablet_bootstrap.cc:492] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.386963  6459 ts_tablet_manager.cc:1403] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:18:02.389428  6459 raft_consensus.cc:359] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.390069  6459 raft_consensus.cc:740] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.390715  6459 consensus_queue.cc:260] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.391170  6232 raft_consensus.cc:515] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.392716  6459 ts_tablet_manager.cc:1434] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:18:02.393561  6459 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Bootstrap starting.
I20260709 13:18:02.394204  6496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:02.394354  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:02.394913  6496 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.394999  6306 raft_consensus.cc:3055] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.395442  6306 raft_consensus.cc:740] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:02.396296  6306 consensus_queue.cc:260] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.397517  6306 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.402693  6496 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:02.404218  6196 leader_election.cc:304] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:02.405066  6443 raft_consensus.cc:2804] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.405481  6232 leader_election.cc:290] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:02.413600  6306 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:02.417615  6443 raft_consensus.cc:697] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:02.418581  6443 consensus_queue.cc:237] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.421180  6459 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:02.422276  6459 tablet_bootstrap.cc:492] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Bootstrap complete.
I20260709 13:18:02.422890  6459 ts_tablet_manager.cc:1403] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.018s
I20260709 13:18:02.425347  6459 raft_consensus.cc:359] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.426025  6459 raft_consensus.cc:740] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c8689a013884d029b7feadd58d5ba91, State: Initialized, Role: FOLLOWER
I20260709 13:18:02.426683  6459 consensus_queue.cc:260] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.427412  6052 catalog_manager.cc:5697] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 1 to 2, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.428681  6459 ts_tablet_manager.cc:1434] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:18:02.471031  6442 raft_consensus.cc:993] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:02.471529  6460 raft_consensus.cc:1081] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:02.473430  6232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:02.474037  6232 raft_consensus.cc:493] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.474368  6232 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.480406  6232 raft_consensus.cc:515] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.483259  6232 leader_election.cc:290] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:02.483457  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:02.483174  6496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:02.484194  6306 raft_consensus.cc:3055] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.484562  6306 raft_consensus.cc:740] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:02.484575  6496 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.485464  6306 consensus_queue.cc:260] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.486822  6306 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.490269  6496 raft_consensus.cc:2468] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:02.491343  6196 leader_election.cc:304] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:02.492156  6443 raft_consensus.cc:2804] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.492668  6443 raft_consensus.cc:697] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:02.492676  6306 raft_consensus.cc:2468] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:02.493595  6443 consensus_queue.cc:237] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.500599  6052 catalog_manager.cc:5697] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 1 to 2, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.509006  6496 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.613104  6460 raft_consensus.cc:993] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:02.613613  6442 raft_consensus.cc:1081] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:02.615520  6232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:02.616102  6232 raft_consensus.cc:493] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.616410  6232 raft_consensus.cc:3060] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.621227  6232 raft_consensus.cc:515] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.622845  6232 leader_election.cc:290] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:02.623751  6496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:02.623972  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebab6d77eb5d485ea8e17200459380be" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:02.624506  6496 raft_consensus.cc:3060] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.624536  6306 raft_consensus.cc:3055] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.625114  6306 raft_consensus.cc:740] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:02.626055  6306 consensus_queue.cc:260] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.627303  6306 raft_consensus.cc:3060] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.634478  6306 raft_consensus.cc:2468] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:02.634480  6496 raft_consensus.cc:2468] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:02.635710  6196 leader_election.cc:304] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:02.636447  6443 raft_consensus.cc:2804] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.636868  6443 raft_consensus.cc:697] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:02.637545  6443 consensus_queue.cc:237] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:02.643935  6052 catalog_manager.cc:5697] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 1 to 2, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.819144  6496 raft_consensus.cc:1275] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:02.820524  6538 consensus_queue.cc:1048] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:02.831250  6306 raft_consensus.cc:1275] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:02.832660  6538 consensus_queue.cc:1048] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:02.974422  6306 raft_consensus.cc:1275] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:02.975860  6538 consensus_queue.cc:1048] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:02.984368  6496 raft_consensus.cc:1275] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:02.986084  6443 consensus_queue.cc:1048] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:03.064235  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:03.125509  6306 raft_consensus.cc:1275] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:03.126845  6443 consensus_queue.cc:1048] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:03.135752  6496 raft_consensus.cc:1275] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:03.137709  6443 consensus_queue.cc:1048] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:03.360280 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:03.377545  6232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
mode: GRACEFUL
new_leader_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:41476
I20260709 13:18:03.378104  6232 raft_consensus.cc:606] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Received request to transfer leadership to TS 4a63ac02eaf04a859475a69224e32076
I20260709 13:18:03.380666  6232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
mode: GRACEFUL
new_leader_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:41476
I20260709 13:18:03.381110  6232 raft_consensus.cc:606] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Received request to transfer leadership to TS 4a63ac02eaf04a859475a69224e32076
I20260709 13:18:03.382061 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:03.382498 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:03.383001 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:03.432400  6538 raft_consensus.cc:993] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: : Instructing follower 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:03.433043  6443 raft_consensus.cc:1081] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Signalling peer 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:03.434577  6306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:35492
I20260709 13:18:03.435163  6306 raft_consensus.cc:493] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.435461  6306 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.441505  6306 raft_consensus.cc:515] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:03.442555  6538 raft_consensus.cc:993] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: : Instructing follower 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:03.443215  6443 raft_consensus.cc:1081] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Signalling peer 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:03.444468  6306 leader_election.cc:290] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:18:03.444612  6496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:03.445315  6496 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.445765  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3fbef214d94e1ebef9ab2051c2745f" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:18:03.446359  6232 raft_consensus.cc:3055] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.446252  6306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:35492
I20260709 13:18:03.446772  6232 raft_consensus.cc:740] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:03.447028  6306 raft_consensus.cc:493] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.447542  6306 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.447808  6232 consensus_queue.cc:260] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:03.449177  6232 raft_consensus.cc:3060] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.452888  6496 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:03.454113  6270 leader_election.cc:304] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:18:03.454466  6306 raft_consensus.cc:515] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:03.455035  6442 raft_consensus.cc:2804] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.456440  6232 raft_consensus.cc:2468] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:03.456787  6306 leader_election.cc:290] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:18:03.457584  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:03.458209  6495 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.458204  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:18:03.458832  6442 raft_consensus.cc:697] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:03.458905  6232 raft_consensus.cc:3055] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:03.459405  6232 raft_consensus.cc:740] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:03.459859  6442 consensus_queue.cc:237] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:03.460191  6232 consensus_queue.cc:260] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:03.461442  6232 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:03.465847  6495 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 2.
I20260709 13:18:03.467247  6270 leader_election.cc:304] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:18:03.467008  6054 catalog_manager.cc:5697] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 2 to 3, leader changed from e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.468119  6442 raft_consensus.cc:2804] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:03.468420  6232 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 2.
I20260709 13:18:03.468652  6442 raft_consensus.cc:697] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:03.469631  6442 consensus_queue.cc:237] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:03.482097  6054 catalog_manager.cc:5697] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 1 to 2, leader changed from e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.872041  6232 raft_consensus.cc:1275] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:03.873375  6442 consensus_queue.cc:1048] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:03.884498  6495 raft_consensus.cc:1275] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:03.886013  6442 consensus_queue.cc:1048] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:03.927039  6495 raft_consensus.cc:1275] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:03.928296  6442 consensus_queue.cc:1048] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:03.936494  6232 raft_consensus.cc:1275] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:03.938115  6442 consensus_queue.cc:1048] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:04.065280  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:04.389689 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:04.399842  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:04.400553  6306 raft_consensus.cc:606] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:04.404007  6231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
mode: GRACEFUL
new_leader_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:41476
I20260709 13:18:04.404592  6231 raft_consensus.cc:606] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Received request to transfer leadership to TS 4a63ac02eaf04a859475a69224e32076
I20260709 13:18:04.407366  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:04.407953  6306 raft_consensus.cc:606] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:04.409109 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:04.409608 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:04.410377 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:04.454651  6574 raft_consensus.cc:993] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:04.455235  6566 raft_consensus.cc:1081] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:04.456894  6231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:04.457455  6231 raft_consensus.cc:493] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.457808  6231 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.466467  6231 raft_consensus.cc:515] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:04.468942  6231 leader_election.cc:290] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:04.470161  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:04.470185  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:04.471149  6495 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.471259  6306 raft_consensus.cc:3055] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.471616  6306 raft_consensus.cc:740] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:04.472589  6306 consensus_queue.cc:260] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:04.473659  6306 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.478487  6495 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:04.480105  6196 leader_election.cc:304] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:04.481053  6443 raft_consensus.cc:2804] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.481626  6306 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:04.482025  6443 raft_consensus.cc:697] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:04.483530  6443 consensus_queue.cc:237] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:04.491629  6054 catalog_manager.cc:5697] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 1 to 2, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.609728  6574 raft_consensus.cc:993] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:04.610201  6566 raft_consensus.cc:1081] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:04.611683  6231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:04.612277  6231 raft_consensus.cc:493] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.612581  6231 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.618607  6231 raft_consensus.cc:515] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:04.620317  6231 leader_election.cc:290] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:04.621326  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:04.621505  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:04.622067  6495 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.622169  6306 raft_consensus.cc:3055] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.622627  6306 raft_consensus.cc:740] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:04.623526  6306 consensus_queue.cc:260] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:04.624704  6306 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.627657  6495 raft_consensus.cc:2468] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:04.628980  6196 leader_election.cc:304] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:04.629724  6443 raft_consensus.cc:2804] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.630121  6443 raft_consensus.cc:697] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:04.630333  6306 raft_consensus.cc:2468] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:04.631233  6443 consensus_queue.cc:237] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:04.639135  6054 catalog_manager.cc:5697] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 1 to 2, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.747035  6575 raft_consensus.cc:993] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: : Instructing follower 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:04.747543  6443 raft_consensus.cc:1081] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Signalling peer 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:04.749090  6306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:35492
I20260709 13:18:04.749595  6306 raft_consensus.cc:493] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.749945  6306 raft_consensus.cc:3060] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.755404  6306 raft_consensus.cc:515] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:18:04.757401  6306 leader_election.cc:290] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:18:04.758236  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:04.758504  6231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b9330b8d6c4de29a5132a2f6d83300" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:18:04.758996  6495 raft_consensus.cc:3060] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.759097  6231 raft_consensus.cc:3055] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:04.759528  6231 raft_consensus.cc:740] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:04.760401  6231 consensus_queue.cc:260] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:18:04.761464  6231 raft_consensus.cc:3060] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:04.764194  6495 raft_consensus.cc:2468] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 2.
I20260709 13:18:04.765211  6270 leader_election.cc:304] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:18:04.765928  6566 raft_consensus.cc:2804] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:04.766427  6566 raft_consensus.cc:697] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:04.767876  6231 raft_consensus.cc:2468] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 2.
I20260709 13:18:04.767575  6566 consensus_queue.cc:237] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } }
I20260709 13:18:04.776650  6054 catalog_manager.cc:5697] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 1 to 2, leader changed from e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:04.910006  6496 raft_consensus.cc:1275] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:04.911296  6443 consensus_queue.cc:1048] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:04.924577  6306 raft_consensus.cc:1275] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:04.926075  6586 consensus_queue.cc:1048] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:05.066670  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:05.126083  6306 raft_consensus.cc:1275] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:05.127496  6586 consensus_queue.cc:1048] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:05.134316  6496 raft_consensus.cc:1275] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:05.137272  6586 consensus_queue.cc:1048] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:05.231510  6496 raft_consensus.cc:1275] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:05.232730  6566 consensus_queue.cc:1048] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:05.248773  6231 raft_consensus.cc:1275] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:05.250270  6574 consensus_queue.cc:1048] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:05.417759 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:05.425976  6231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
mode: GRACEFUL
new_leader_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:41476
I20260709 13:18:05.426592  6231 raft_consensus.cc:606] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Received request to transfer leadership to TS 4a63ac02eaf04a859475a69224e32076
I20260709 13:18:05.429085  6231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
mode: GRACEFUL
new_leader_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:41476
I20260709 13:18:05.429579  6231 raft_consensus.cc:606] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Received request to transfer leadership to TS 4a63ac02eaf04a859475a69224e32076
I20260709 13:18:05.431945  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d131513b686d430abcc83e090de12692"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:05.432430  6306 raft_consensus.cc:606] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:05.433578 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:05.434094 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:05.434713 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:05.488452  6586 raft_consensus.cc:993] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: : Instructing follower 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:05.489025  6443 raft_consensus.cc:1081] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Signalling peer 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:05.490463  6306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:35492
I20260709 13:18:05.490906  6306 raft_consensus.cc:493] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:05.491189  6306 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.496220  6306 raft_consensus.cc:515] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.497601  6306 leader_election.cc:290] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:18:05.498560  6231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:18:05.498569  6496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7022f3c9cf624a1ca07505da165cbe54" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:05.499514  6231 raft_consensus.cc:3055] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.499620  6496 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.499899  6231 raft_consensus.cc:740] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:05.500824  6231 consensus_queue.cc:260] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.502044  6231 raft_consensus.cc:3060] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.505921  6496 raft_consensus.cc:2468] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:05.507026  6270 leader_election.cc:304] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:18:05.507699  6574 raft_consensus.cc:2804] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:05.508145  6574 raft_consensus.cc:697] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:05.508240  6231 raft_consensus.cc:2468] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:05.509217  6574 consensus_queue.cc:237] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.515870  6052 catalog_manager.cc:5697] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 2 to 3, leader changed from e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.602792  6586 raft_consensus.cc:993] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: : Instructing follower 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:05.603318  6443 raft_consensus.cc:1081] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Signalling peer 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:05.604751  6306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:35492
I20260709 13:18:05.605279  6306 raft_consensus.cc:493] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:05.605626  6306 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.606570  6566 raft_consensus.cc:993] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:05.607093  6574 raft_consensus.cc:1081] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:05.608536  6231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d131513b686d430abcc83e090de12692"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:05.609071  6231 raft_consensus.cc:493] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:05.609427  6231 raft_consensus.cc:3060] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.612329  6306 raft_consensus.cc:515] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.614320  6306 leader_election.cc:290] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:18:05.615077  6496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:05.615552  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0147d6ee371d4b5484512955cdaca6b4" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:18:05.615782  6496 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.616205  6232 raft_consensus.cc:3055] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:05.616537  6232 raft_consensus.cc:740] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:05.616884  6231 raft_consensus.cc:515] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.617345  6232 consensus_queue.cc:260] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.618649  6232 raft_consensus.cc:3060] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:05.619864  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d131513b686d430abcc83e090de12692" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:05.620527  6231 leader_election.cc:290] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:05.620554  6495 raft_consensus.cc:3060] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.621909  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d131513b686d430abcc83e090de12692" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:05.622552  6306 raft_consensus.cc:3055] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:05.622867  6306 raft_consensus.cc:740] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:05.622913  6496 raft_consensus.cc:2468] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:05.624061  6306 consensus_queue.cc:260] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.624711  6270 leader_election.cc:304] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:18:05.625402  6306 raft_consensus.cc:3060] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:05.625697  6574 raft_consensus.cc:2804] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:05.626950  6574 raft_consensus.cc:697] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:05.627205  6232 raft_consensus.cc:2468] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:05.627866  6574 consensus_queue.cc:237] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.630069  6495 raft_consensus.cc:2468] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:05.631222  6306 raft_consensus.cc:2468] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 2.
I20260709 13:18:05.631449  6196 leader_election.cc:304] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:05.632318  6443 raft_consensus.cc:2804] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:05.632795  6443 raft_consensus.cc:697] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:05.633800  6443 consensus_queue.cc:237] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:05.636530  6052 catalog_manager.cc:5697] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 2 to 3, leader changed from e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.641994  6054 catalog_manager.cc:5697] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 1 to 2, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.012269  6232 raft_consensus.cc:1275] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:06.013572  6566 consensus_queue.cc:1048] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:06.026239  6495 raft_consensus.cc:1275] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:06.027799  6574 consensus_queue.cc:1048] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:06.059419  6306 raft_consensus.cc:1275] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.060992  6443 consensus_queue.cc:1048] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:06.067857  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:06.073694  6495 raft_consensus.cc:1275] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.075244  6608 consensus_queue.cc:1048] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.080813  6496 raft_consensus.cc:1275] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:06.082692  6574 consensus_queue.cc:1048] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:06.090425  6232 raft_consensus.cc:1275] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:06.092659  6566 consensus_queue.cc:1048] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:06.441340 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:06.448935  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:06.449442  6306 raft_consensus.cc:606] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:06.451726  6306 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
mode: GRACEFUL
new_leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:39140
I20260709 13:18:06.452183  6306 raft_consensus.cc:606] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Received request to transfer leadership to TS e4415f1c8a6e4e4e824f3b7c7d56d842
I20260709 13:18:06.454355  6232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
mode: GRACEFUL
new_leader_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:41476
I20260709 13:18:06.454770  6232 raft_consensus.cc:606] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Received request to transfer leadership to TS 4a63ac02eaf04a859475a69224e32076
I20260709 13:18:06.455801 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:06.456296 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:06.456861 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:06.613948  6608 raft_consensus.cc:993] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: : Instructing follower 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:06.615262  6608 raft_consensus.cc:1081] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Signalling peer 4a63ac02eaf04a859475a69224e32076 to start an election
I20260709 13:18:06.618645  6306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155"
dest_uuid: "4a63ac02eaf04a859475a69224e32076"
 from {username='slave'} at 127.0.0.1:35492
I20260709 13:18:06.619171  6306 raft_consensus.cc:493] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.619482  6306 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.624526  6306 raft_consensus.cc:515] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.626359  6306 leader_election.cc:290] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249)
I20260709 13:18:06.626875  6232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
I20260709 13:18:06.626879  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec103f49f27145a2952f3da243c2e155" candidate_uuid: "4a63ac02eaf04a859475a69224e32076" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:06.627876  6232 raft_consensus.cc:3055] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:06.627926  6495 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.628180  6232 raft_consensus.cc:740] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:06.629074  6232 consensus_queue.cc:260] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.630019  6232 raft_consensus.cc:3060] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.633668  6495 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:06.634773  6232 raft_consensus.cc:2468] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a63ac02eaf04a859475a69224e32076 in term 3.
I20260709 13:18:06.634924  6270 leader_election.cc:304] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a63ac02eaf04a859475a69224e32076, 7c8689a013884d029b7feadd58d5ba91; no voters: 
I20260709 13:18:06.635829  6600 raft_consensus.cc:2804] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:06.636445  6600 raft_consensus.cc:697] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Becoming Leader. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:06.637270  6600 consensus_queue.cc:237] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.644904  6052 catalog_manager.cc:5697] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 reported cstate change: term changed from 2 to 3, leader changed from e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130) to 4a63ac02eaf04a859475a69224e32076 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "4a63ac02eaf04a859475a69224e32076" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.750212  6566 raft_consensus.cc:993] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:06.750669  6600 raft_consensus.cc:1081] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:06.752038  6232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:06.752440  6232 raft_consensus.cc:493] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.752699  6232 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.757355  6232 raft_consensus.cc:515] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.758846  6232 leader_election.cc:290] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 3 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:06.759646  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:06.759868  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383748d8d1c847b7ae4924f149f87b95" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:06.760418  6495 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.760447  6306 raft_consensus.cc:3055] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:06.761155  6306 raft_consensus.cc:740] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:06.762073  6306 consensus_queue.cc:260] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.763284  6306 raft_consensus.cc:3060] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.767892  6495 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 3.
I20260709 13:18:06.769040  6196 leader_election.cc:304] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:06.769716  6610 raft_consensus.cc:2804] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:06.769853  6306 raft_consensus.cc:2468] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 3.
I20260709 13:18:06.770162  6610 raft_consensus.cc:697] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:06.771262  6610 consensus_queue.cc:237] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.778591  6052 catalog_manager.cc:5697] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 2 to 3, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.867146  6566 raft_consensus.cc:993] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: : Instructing follower e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:06.867638  6600 raft_consensus.cc:1081] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Signalling peer e4415f1c8a6e4e4e824f3b7c7d56d842 to start an election
I20260709 13:18:06.869127  6232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc"
dest_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842"
 from {username='slave'} at 127.0.0.1:34508
I20260709 13:18:06.869621  6232 raft_consensus.cc:493] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.869903  6232 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.874715  6232 raft_consensus.cc:515] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.876281  6232 leader_election.cc:290] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 3 election: Requested vote from peers 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965), 4a63ac02eaf04a859475a69224e32076 (127.29.5.131:43701)
I20260709 13:18:06.877261  6306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a63ac02eaf04a859475a69224e32076"
I20260709 13:18:06.877296  6495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ac476ffc5e450f802def75539d16dc" candidate_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c8689a013884d029b7feadd58d5ba91"
I20260709 13:18:06.877851  6306 raft_consensus.cc:3055] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:06.878067  6495 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.878221  6306 raft_consensus.cc:740] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a63ac02eaf04a859475a69224e32076, State: Running, Role: LEADER
I20260709 13:18:06.879097  6306 consensus_queue.cc:260] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.880203  6306 raft_consensus.cc:3060] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:06.883586  6495 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 3.
I20260709 13:18:06.884657  6196 leader_election.cc:304] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c8689a013884d029b7feadd58d5ba91, e4415f1c8a6e4e4e824f3b7c7d56d842; no voters: 
I20260709 13:18:06.884727  6306 raft_consensus.cc:2468] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4415f1c8a6e4e4e824f3b7c7d56d842 in term 3.
I20260709 13:18:06.885448  6610 raft_consensus.cc:2804] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:06.885890  6610 raft_consensus.cc:697] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 LEADER]: Becoming Leader. State: Replica: e4415f1c8a6e4e4e824f3b7c7d56d842, State: Running, Role: LEADER
I20260709 13:18:06.886760  6610 consensus_queue.cc:237] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } }
I20260709 13:18:06.894968  6052 catalog_manager.cc:5697] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 reported cstate change: term changed from 2 to 3, leader changed from 4a63ac02eaf04a859475a69224e32076 (127.29.5.131) to e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130). New cstate: current_term: 3 leader_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.025527  6232 raft_consensus.cc:1275] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.026757  6600 consensus_queue.cc:1048] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4415f1c8a6e4e4e824f3b7c7d56d842" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.035833  6495 raft_consensus.cc:1275] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Refusing update from remote peer 4a63ac02eaf04a859475a69224e32076: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.037967  6600 consensus_queue.cc:1048] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:07.068943  6103 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:18:07.226598  6306 raft_consensus.cc:1275] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.227984  6610 consensus_queue.cc:1048] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.237593  6495 raft_consensus.cc:1275] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.239603  6627 consensus_queue.cc:1048] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:07.362998  6495 raft_consensus.cc:1275] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.364269  6610 consensus_queue.cc:1048] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c8689a013884d029b7feadd58d5ba91" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 32965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.373380  6306 raft_consensus.cc:1275] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Refusing update from remote peer e4415f1c8a6e4e4e824f3b7c7d56d842: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:07.374881  6610 consensus_queue.cc:1048] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a63ac02eaf04a859475a69224e32076" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 43701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.463393 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:07.494341 29718 tablet_server.cc:179] TabletServer@127.29.5.129:32965 shutting down...
W20260709 13:18:07.508723  6270 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
W20260709 13:18:07.512400  6270 consensus_peers.cc:597] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.519447 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:07.520375 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.521157 29718 raft_consensus.cc:2243] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.521643 29718 raft_consensus.cc:2272] T ec103f49f27145a2952f3da243c2e155 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.525168 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.525992 29718 raft_consensus.cc:2243] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.526484 29718 raft_consensus.cc:2272] T 383748d8d1c847b7ae4924f149f87b95 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.530342 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.531160 29718 raft_consensus.cc:2243] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.531670 29718 raft_consensus.cc:2272] T 82ac476ffc5e450f802def75539d16dc P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.534821 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.535534 29718 raft_consensus.cc:2243] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.536082 29718 raft_consensus.cc:2272] T 5e3fbef214d94e1ebef9ab2051c2745f P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.538848 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.539479 29718 raft_consensus.cc:2243] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.539992 29718 raft_consensus.cc:2272] T d131513b686d430abcc83e090de12692 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.542340 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.542945 29718 raft_consensus.cc:2243] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.543480 29718 raft_consensus.cc:2272] T 0147d6ee371d4b5484512955cdaca6b4 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.546324 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.546888 29718 raft_consensus.cc:2243] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.547339 29718 raft_consensus.cc:2272] T ebab6d77eb5d485ea8e17200459380be P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.550034 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.550669 29718 raft_consensus.cc:2243] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.551129 29718 raft_consensus.cc:2272] T d6b9330b8d6c4de29a5132a2f6d83300 P 7c8689a013884d029b7feadd58d5ba91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.553886 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.554443 29718 raft_consensus.cc:2243] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.554950 29718 raft_consensus.cc:2272] T 6165bbfad906416c83c9fc0e50cab16e P 7c8689a013884d029b7feadd58d5ba91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.558032 29718 tablet_replica.cc:333] stopping tablet replica
I20260709 13:18:07.558537 29718 raft_consensus.cc:2243] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.558997 29718 raft_consensus.cc:2272] T 7022f3c9cf624a1ca07505da165cbe54 P 7c8689a013884d029b7feadd58d5ba91 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.595186 29718 tablet_server.cc:196] TabletServer@127.29.5.129:32965 shutdown complete.
W20260709 13:18:07.595825  6270 consensus_peers.cc:597] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.622701 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
I20260709 13:18:07.651197 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:07.651968 29718 tablet_replica.cc:333] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.652663 29718 raft_consensus.cc:2243] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.653225 29718 raft_consensus.cc:2272] T ec103f49f27145a2952f3da243c2e155 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.656499 29718 tablet_replica.cc:333] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.657176 29718 raft_consensus.cc:2243] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:18:07.657367  6269 consensus_peers.cc:597] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 -> Peer e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249): Couldn't send request to peer e4415f1c8a6e4e4e824f3b7c7d56d842. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.658118 29718 raft_consensus.cc:2272] T ebab6d77eb5d485ea8e17200459380be P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.660487 29718 tablet_replica.cc:333] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.661095 29718 raft_consensus.cc:2243] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.661561 29718 raft_consensus.cc:2272] T 7022f3c9cf624a1ca07505da165cbe54 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.663679 29718 tablet_replica.cc:333] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.664357 29718 raft_consensus.cc:2243] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.665138 29718 raft_consensus.cc:2272] T 383748d8d1c847b7ae4924f149f87b95 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.667896 29718 tablet_replica.cc:333] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.668463 29718 raft_consensus.cc:2243] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.669234 29718 raft_consensus.cc:2272] T d131513b686d430abcc83e090de12692 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.671191 29718 tablet_replica.cc:333] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.671734 29718 raft_consensus.cc:2243] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.672199 29718 raft_consensus.cc:2272] T 0147d6ee371d4b5484512955cdaca6b4 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.674149 29718 tablet_replica.cc:333] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.674724 29718 raft_consensus.cc:2243] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.675175 29718 raft_consensus.cc:2272] T 5e3fbef214d94e1ebef9ab2051c2745f P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.677331 29718 tablet_replica.cc:333] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.677935 29718 raft_consensus.cc:2243] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.678987 29718 raft_consensus.cc:2272] T 82ac476ffc5e450f802def75539d16dc P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.682161 29718 tablet_replica.cc:333] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.682737 29718 raft_consensus.cc:2243] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:18:07.683092  6270 consensus_peers.cc:597] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 -> Peer 7c8689a013884d029b7feadd58d5ba91 (127.29.5.129:32965): Couldn't send request to peer 7c8689a013884d029b7feadd58d5ba91. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:32965: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.683799 29718 raft_consensus.cc:2272] T 6165bbfad906416c83c9fc0e50cab16e P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.686079 29718 tablet_replica.cc:333] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842: stopping tablet replica
I20260709 13:18:07.686565 29718 raft_consensus.cc:2243] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.686990 29718 raft_consensus.cc:2272] T d6b9330b8d6c4de29a5132a2f6d83300 P e4415f1c8a6e4e4e824f3b7c7d56d842 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:07.692240  6269 consensus_peers.cc:597] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 -> Peer e4415f1c8a6e4e4e824f3b7c7d56d842 (127.29.5.130:35249): Couldn't send request to peer e4415f1c8a6e4e4e824f3b7c7d56d842. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:07.719538 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
I20260709 13:18:07.746075 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
I20260709 13:18:07.774694 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:07.775370 29718 tablet_replica.cc:333] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.776021 29718 raft_consensus.cc:2243] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.776854 29718 raft_consensus.cc:2272] T ec103f49f27145a2952f3da243c2e155 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.779368 29718 tablet_replica.cc:333] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.780004 29718 raft_consensus.cc:2243] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.780503 29718 raft_consensus.cc:2272] T ebab6d77eb5d485ea8e17200459380be P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.782595 29718 tablet_replica.cc:333] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.783154 29718 raft_consensus.cc:2243] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.783569 29718 raft_consensus.cc:2272] T 6165bbfad906416c83c9fc0e50cab16e P 4a63ac02eaf04a859475a69224e32076 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.785672 29718 tablet_replica.cc:333] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.786149 29718 raft_consensus.cc:2243] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.786885 29718 raft_consensus.cc:2272] T d6b9330b8d6c4de29a5132a2f6d83300 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.789091 29718 tablet_replica.cc:333] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.789575 29718 raft_consensus.cc:2243] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.789947 29718 raft_consensus.cc:2272] T 383748d8d1c847b7ae4924f149f87b95 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.792567 29718 tablet_replica.cc:333] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.793066 29718 raft_consensus.cc:2243] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.793423 29718 raft_consensus.cc:2272] T d131513b686d430abcc83e090de12692 P 4a63ac02eaf04a859475a69224e32076 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.795251 29718 tablet_replica.cc:333] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.795711 29718 raft_consensus.cc:2243] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.796453 29718 raft_consensus.cc:2272] T 0147d6ee371d4b5484512955cdaca6b4 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.798467 29718 tablet_replica.cc:333] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.798923 29718 raft_consensus.cc:2243] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.799643 29718 raft_consensus.cc:2272] T 5e3fbef214d94e1ebef9ab2051c2745f P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.801873 29718 tablet_replica.cc:333] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.802305 29718 raft_consensus.cc:2243] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:07.802646 29718 raft_consensus.cc:2272] T 82ac476ffc5e450f802def75539d16dc P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.805070 29718 tablet_replica.cc:333] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076: stopping tablet replica
I20260709 13:18:07.805528 29718 raft_consensus.cc:2243] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.806202 29718 raft_consensus.cc:2272] T 7022f3c9cf624a1ca07505da165cbe54 P 4a63ac02eaf04a859475a69224e32076 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.841249 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
I20260709 13:18:07.867225 29718 master.cc:562] Master@127.29.5.190:39253 shutting down...
I20260709 13:18:07.894165 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:07.894785 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:07.895153 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P e95e18980a0e458d87f012a589e8f080: stopping tablet replica
I20260709 13:18:07.916465 29718 master.cc:584] Master@127.29.5.190:39253 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13043 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:18:07.962311 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:41493
I20260709 13:18:07.963415 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:07.969249  6639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.969344  6638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:07.970117  6641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:07.971712 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:07.972703 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:07.972916 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:07.973075 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603087973042 us; error 0 us; skew 500 ppm
I20260709 13:18:07.973595 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:07.976171 29718 webserver.cc:533] Webserver started at http://127.29.5.190:41975/ using document root <none> and password file <none>
I20260709 13:18:07.976704 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:07.976904 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:07.977174 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:07.978320 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "016db6e546cb4a3f90c153a7dd1a81e0"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-kgkf"
I20260709 13:18:07.982896 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:07.986305  6646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:07.987134 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:07.987426 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "016db6e546cb4a3f90c153a7dd1a81e0"
format_stamp: "Formatted at 2026-07-09 13:18:07 on dist-test-slave-kgkf"
I20260709 13:18:07.987715 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:08.007144 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:08.008405 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:08.046030 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:41493
I20260709 13:18:08.046132  6697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:41493 every 8 connection(s)
I20260709 13:18:08.049994  6698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.061064  6698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0: Bootstrap starting.
I20260709 13:18:08.065902  6698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.069926  6698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0: No bootstrap required, opened a new log
I20260709 13:18:08.072088  6698 raft_consensus.cc:359] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" member_type: VOTER }
I20260709 13:18:08.072440  6698 raft_consensus.cc:385] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.072618  6698 raft_consensus.cc:740] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016db6e546cb4a3f90c153a7dd1a81e0, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.073215  6698 consensus_queue.cc:260] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" member_type: VOTER }
I20260709 13:18:08.073613  6698 raft_consensus.cc:399] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:08.073807  6698 raft_consensus.cc:493] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:08.074021  6698 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.078544  6698 raft_consensus.cc:515] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" member_type: VOTER }
I20260709 13:18:08.079101  6698 leader_election.cc:304] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 016db6e546cb4a3f90c153a7dd1a81e0; no voters: 
I20260709 13:18:08.080245  6698 leader_election.cc:290] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:08.080570  6701 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.081977  6701 raft_consensus.cc:697] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 1 LEADER]: Becoming Leader. State: Replica: 016db6e546cb4a3f90c153a7dd1a81e0, State: Running, Role: LEADER
I20260709 13:18:08.082581  6701 consensus_queue.cc:237] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" member_type: VOTER }
I20260709 13:18:08.083225  6698 sys_catalog.cc:565] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:08.087054  6703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 016db6e546cb4a3f90c153a7dd1a81e0. Latest consensus state: current_term: 1 leader_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" member_type: VOTER } }
I20260709 13:18:08.087914  6703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:08.087800  6702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016db6e546cb4a3f90c153a7dd1a81e0" member_type: VOTER } }
I20260709 13:18:08.088500  6702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:08.090422  6708 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:08.098567  6708 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:08.099538 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:08.107524  6708 catalog_manager.cc:1383] Generated new cluster ID: c7d1ec4c0ce04ab398acfe07d6c36c62
I20260709 13:18:08.107849  6708 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:08.145419  6708 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:08.146713  6708 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:08.172194  6708 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0: Generated new TSK 0
I20260709 13:18:08.172832  6708 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:08.231434 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:08.238193  6719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:08.239440  6720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:08.242033  6722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:08.242875 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:08.243983 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:08.244217 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:08.244398 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603088244374 us; error 0 us; skew 500 ppm
I20260709 13:18:08.244956 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:08.247383 29718 webserver.cc:533] Webserver started at http://127.29.5.129:41563/ using document root <none> and password file <none>
I20260709 13:18:08.247969 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:08.248183 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:08.248484 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:08.249632 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
format_stamp: "Formatted at 2026-07-09 13:18:08 on dist-test-slave-kgkf"
I20260709 13:18:08.255074 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:18:08.258641  6727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.259400 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:08.259721 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
format_stamp: "Formatted at 2026-07-09 13:18:08 on dist-test-slave-kgkf"
I20260709 13:18:08.260056 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:08.280251 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:08.281653 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:08.283217 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:08.285763 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:08.285989 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.286262 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:08.286482 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.328501 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:41185
I20260709 13:18:08.328611  6789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:41185 every 8 connection(s)
I20260709 13:18:08.333717 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:08.341089  6794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:08.345537  6795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:08.348793 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:08.349617  6790 heartbeater.cc:344] Connected to a master server at 127.29.5.190:41493
I20260709 13:18:08.350031  6790 heartbeater.cc:461] Registering TS with master...
W20260709 13:18:08.350389  6797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:08.350880  6790 heartbeater.cc:507] Master 127.29.5.190:41493 requested a full tablet report, sending...
I20260709 13:18:08.351460 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:08.351716 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:08.351967 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603088351945 us; error 0 us; skew 500 ppm
I20260709 13:18:08.352656 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:08.353267  6663 ts_manager.cc:194] Registered new tserver with Master: 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185)
I20260709 13:18:08.355649 29718 webserver.cc:533] Webserver started at http://127.29.5.130:44399/ using document root <none> and password file <none>
I20260709 13:18:08.356109  6663 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54248
I20260709 13:18:08.356387 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:08.356698 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:08.357030 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:08.358306 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
format_stamp: "Formatted at 2026-07-09 13:18:08 on dist-test-slave-kgkf"
I20260709 13:18:08.363190 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:18:08.366698  6802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.367473 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:08.367825 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
format_stamp: "Formatted at 2026-07-09 13:18:08 on dist-test-slave-kgkf"
I20260709 13:18:08.368122 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:08.385061 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:08.386346 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:08.388015 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:08.390404 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:08.390642 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.390898 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:08.391072 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.432204 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:42417
I20260709 13:18:08.432305  6864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:42417 every 8 connection(s)
I20260709 13:18:08.437274 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:08.446076  6869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:08.446236  6868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:08.449962  6865 heartbeater.cc:344] Connected to a master server at 127.29.5.190:41493
W20260709 13:18:08.450315  6871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:08.450434  6865 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:08.450814 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:08.451712  6865 heartbeater.cc:507] Master 127.29.5.190:41493 requested a full tablet report, sending...
I20260709 13:18:08.452021 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:08.452319 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:08.452524 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603088452505 us; error 0 us; skew 500 ppm
I20260709 13:18:08.453204 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:08.454281  6663 ts_manager.cc:194] Registered new tserver with Master: 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417)
I20260709 13:18:08.456059 29718 webserver.cc:533] Webserver started at http://127.29.5.131:35555/ using document root <none> and password file <none>
I20260709 13:18:08.456343  6663 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54250
I20260709 13:18:08.456789 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:08.457091 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:08.457419 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:08.458598 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "c5b47ec115ed4d94b55051314c824af5"
format_stamp: "Formatted at 2026-07-09 13:18:08 on dist-test-slave-kgkf"
I20260709 13:18:08.463003 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:18:08.466284  6876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.467018 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:08.467342 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "c5b47ec115ed4d94b55051314c824af5"
format_stamp: "Formatted at 2026-07-09 13:18:08 on dist-test-slave-kgkf"
I20260709 13:18:08.467629 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:08.477726 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:08.478843 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:08.480383 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:08.482554 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:08.482779 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.483027 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:08.483207 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:08.523510 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:45543
I20260709 13:18:08.523626  6938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:45543 every 8 connection(s)
I20260709 13:18:08.537883  6939 heartbeater.cc:344] Connected to a master server at 127.29.5.190:41493
I20260709 13:18:08.538424  6939 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:08.539171  6939 heartbeater.cc:507] Master 127.29.5.190:41493 requested a full tablet report, sending...
I20260709 13:18:08.541278  6663 ts_manager.cc:194] Registered new tserver with Master: c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:08.541752 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014858261s
I20260709 13:18:08.542589  6663 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54254
I20260709 13:18:08.571391  6663 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54268:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:08.574024  6663 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:08.631541  6904 tablet_service.cc:1511] Processing CreateTablet for tablet 3321f104f724461c98a47f7463c3b068 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=693bffd73a2a47eabfc49f46deb9ed06]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:08.632064  6903 tablet_service.cc:1511] Processing CreateTablet for tablet d881e43bb53d4fa0b11fc68f85c506d4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=693bffd73a2a47eabfc49f46deb9ed06]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:08.633251  6904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3321f104f724461c98a47f7463c3b068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.633940  6903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d881e43bb53d4fa0b11fc68f85c506d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.641250  6755 tablet_service.cc:1511] Processing CreateTablet for tablet 3321f104f724461c98a47f7463c3b068 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=693bffd73a2a47eabfc49f46deb9ed06]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:08.641507  6754 tablet_service.cc:1511] Processing CreateTablet for tablet d881e43bb53d4fa0b11fc68f85c506d4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=693bffd73a2a47eabfc49f46deb9ed06]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:08.641659  6830 tablet_service.cc:1511] Processing CreateTablet for tablet 3321f104f724461c98a47f7463c3b068 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=693bffd73a2a47eabfc49f46deb9ed06]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:08.642812  6755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3321f104f724461c98a47f7463c3b068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.643260  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3321f104f724461c98a47f7463c3b068. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.644402  6754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d881e43bb53d4fa0b11fc68f85c506d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.649048  6829 tablet_service.cc:1511] Processing CreateTablet for tablet d881e43bb53d4fa0b11fc68f85c506d4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=693bffd73a2a47eabfc49f46deb9ed06]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:08.650652  6829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d881e43bb53d4fa0b11fc68f85c506d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.661458  6954 tablet_bootstrap.cc:492] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5: Bootstrap starting.
I20260709 13:18:08.671185  6954 tablet_bootstrap.cc:654] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.685859  6954 tablet_bootstrap.cc:492] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5: No bootstrap required, opened a new log
I20260709 13:18:08.686523  6954 ts_tablet_manager.cc:1403] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:18:08.687160  6955 tablet_bootstrap.cc:492] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Bootstrap starting.
I20260709 13:18:08.689071  6957 tablet_bootstrap.cc:492] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff: Bootstrap starting.
I20260709 13:18:08.690343  6954 raft_consensus.cc:359] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.691275  6954 raft_consensus.cc:385] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.691690  6954 raft_consensus.cc:740] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b47ec115ed4d94b55051314c824af5, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.692765  6954 consensus_queue.cc:260] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.695127  6955 tablet_bootstrap.cc:654] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.695680  6939 heartbeater.cc:499] Master 127.29.5.190:41493 was elected leader, sending a full tablet report...
I20260709 13:18:08.696234  6954 ts_tablet_manager.cc:1434] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:18:08.696796  6957 tablet_bootstrap.cc:654] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.697350  6954 tablet_bootstrap.cc:492] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5: Bootstrap starting.
I20260709 13:18:08.706768  6954 tablet_bootstrap.cc:654] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.708611  6955 tablet_bootstrap.cc:492] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: No bootstrap required, opened a new log
I20260709 13:18:08.709466  6955 ts_tablet_manager.cc:1403] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:18:08.714582  6957 tablet_bootstrap.cc:492] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff: No bootstrap required, opened a new log
I20260709 13:18:08.714646  6955 raft_consensus.cc:359] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.716023  6955 raft_consensus.cc:385] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.716045  6957 ts_tablet_manager.cc:1403] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.010s
I20260709 13:18:08.716547  6955 raft_consensus.cc:740] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.717837  6954 tablet_bootstrap.cc:492] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5: No bootstrap required, opened a new log
I20260709 13:18:08.717725  6955 consensus_queue.cc:260] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.718437  6954 ts_tablet_manager.cc:1403] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:18:08.719700  6957 raft_consensus.cc:359] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.720517  6957 raft_consensus.cc:385] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.720811  6957 raft_consensus.cc:740] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.721577  6957 consensus_queue.cc:260] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.721709  6954 raft_consensus.cc:359] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.722394  6954 raft_consensus.cc:385] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.722729  6954 raft_consensus.cc:740] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b47ec115ed4d94b55051314c824af5, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.723830  6954 consensus_queue.cc:260] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.724740  6865 heartbeater.cc:499] Master 127.29.5.190:41493 was elected leader, sending a full tablet report...
I20260709 13:18:08.724975  6957 ts_tablet_manager.cc:1434] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:08.726027  6954 ts_tablet_manager.cc:1434] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:08.726325  6957 tablet_bootstrap.cc:492] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff: Bootstrap starting.
I20260709 13:18:08.727700  6955 ts_tablet_manager.cc:1434] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:18:08.728495  6790 heartbeater.cc:499] Master 127.29.5.190:41493 was elected leader, sending a full tablet report...
I20260709 13:18:08.729426  6955 tablet_bootstrap.cc:492] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Bootstrap starting.
I20260709 13:18:08.733186  6957 tablet_bootstrap.cc:654] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.736186  6955 tablet_bootstrap.cc:654] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.752529  6957 tablet_bootstrap.cc:492] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff: No bootstrap required, opened a new log
I20260709 13:18:08.752985  6955 tablet_bootstrap.cc:492] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: No bootstrap required, opened a new log
I20260709 13:18:08.753067  6957 ts_tablet_manager.cc:1403] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.013s
I20260709 13:18:08.753696  6955 ts_tablet_manager.cc:1403] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.010s
I20260709 13:18:08.756382  6957 raft_consensus.cc:359] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.756625  6955 raft_consensus.cc:359] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.757220  6957 raft_consensus.cc:385] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.757284  6955 raft_consensus.cc:385] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.757671  6955 raft_consensus.cc:740] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.757582  6957 raft_consensus.cc:740] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.758508  6955 consensus_queue.cc:260] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.758759  6957 consensus_queue.cc:260] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.760790  6955 ts_tablet_manager.cc:1434] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:08.762622  6957 ts_tablet_manager.cc:1434] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:18:08.780329  6962 raft_consensus.cc:493] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.780759  6962 raft_consensus.cc:515] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.783012  6962 leader_election.cc:290] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543), 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417)
I20260709 13:18:08.793473  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3321f104f724461c98a47f7463c3b068" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5" is_pre_election: true
I20260709 13:18:08.794046  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3321f104f724461c98a47f7463c3b068" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" is_pre_election: true
I20260709 13:18:08.794332  6914 raft_consensus.cc:2468] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 0.
I20260709 13:18:08.794823  6840 raft_consensus.cc:2468] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 0.
I20260709 13:18:08.795722  6731 leader_election.cc:304] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, c5b47ec115ed4d94b55051314c824af5; no voters: 
I20260709 13:18:08.796622  6962 raft_consensus.cc:2804] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.796968  6962 raft_consensus.cc:493] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.797205  6962 raft_consensus.cc:3060] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.802527  6962 raft_consensus.cc:515] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.804251  6962 leader_election.cc:290] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 election: Requested vote from peers c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543), 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417)
I20260709 13:18:08.805088  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3321f104f724461c98a47f7463c3b068" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:08.805325  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3321f104f724461c98a47f7463c3b068" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
I20260709 13:18:08.805820  6914 raft_consensus.cc:3060] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.805891  6840 raft_consensus.cc:3060] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.813717  6914 raft_consensus.cc:2468] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 1.
I20260709 13:18:08.813717  6840 raft_consensus.cc:2468] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 1.
I20260709 13:18:08.815217  6730 leader_election.cc:304] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:08.816001  6962 raft_consensus.cc:2804] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.817087  6962 raft_consensus.cc:697] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Becoming Leader. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Running, Role: LEADER
I20260709 13:18:08.817987  6962 consensus_queue.cc:237] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } }
I20260709 13:18:08.826505  6663 catalog_manager.cc:5697] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.836941  6962 raft_consensus.cc:493] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.837415  6962 raft_consensus.cc:515] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.839007  6962 leader_election.cc:290] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:08.839740  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" is_pre_election: true
I20260709 13:18:08.840092  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5" is_pre_election: true
I20260709 13:18:08.840409  6840 raft_consensus.cc:2468] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 0.
I20260709 13:18:08.840728  6914 raft_consensus.cc:2468] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 0.
I20260709 13:18:08.841450  6730 leader_election.cc:304] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:08.842247  6962 raft_consensus.cc:2804] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:08.842561  6962 raft_consensus.cc:493] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.842829  6962 raft_consensus.cc:3060] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.848191  6962 raft_consensus.cc:515] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.849805  6962 leader_election.cc:290] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 election: Requested vote from peers 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:08.850726  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
I20260709 13:18:08.850880  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:08.851300  6840 raft_consensus.cc:3060] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.851534  6914 raft_consensus.cc:3060] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:08.856302  6840 raft_consensus.cc:2468] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 1.
I20260709 13:18:08.857134  6914 raft_consensus.cc:2468] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 1.
I20260709 13:18:08.857488  6730 leader_election.cc:304] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:08.858436  6962 raft_consensus.cc:2804] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:08.858870  6962 raft_consensus.cc:697] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Becoming Leader. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Running, Role: LEADER
I20260709 13:18:08.859562  6962 consensus_queue.cc:237] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.867087  6663 catalog_manager.cc:5697] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:08.905668  6663 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44754:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:08.907604  6663 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:08.931304  6754 tablet_service.cc:1511] Processing CreateTablet for tablet 60680977d2304fdaa5141bfd7f1e8bd2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=12dd5c2c263147ba906ac344aff3254c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:08.932612  6754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60680977d2304fdaa5141bfd7f1e8bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.932439  6830 tablet_service.cc:1511] Processing CreateTablet for tablet 60680977d2304fdaa5141bfd7f1e8bd2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=12dd5c2c263147ba906ac344aff3254c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:08.933492  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60680977d2304fdaa5141bfd7f1e8bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.937814  6903 tablet_service.cc:1511] Processing CreateTablet for tablet 60680977d2304fdaa5141bfd7f1e8bd2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=12dd5c2c263147ba906ac344aff3254c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:18:08.939172  6903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60680977d2304fdaa5141bfd7f1e8bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.940223  6755 tablet_service.cc:1511] Processing CreateTablet for tablet 3a8f2aa288ab4acbaed865dbcae498c2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=12dd5c2c263147ba906ac344aff3254c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:08.941520  6755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8f2aa288ab4acbaed865dbcae498c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.951287  6957 tablet_bootstrap.cc:492] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: Bootstrap starting.
I20260709 13:18:08.953178  6955 tablet_bootstrap.cc:492] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Bootstrap starting.
I20260709 13:18:08.954900  6954 tablet_bootstrap.cc:492] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: Bootstrap starting.
I20260709 13:18:08.955175  6829 tablet_service.cc:1511] Processing CreateTablet for tablet 3a8f2aa288ab4acbaed865dbcae498c2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=12dd5c2c263147ba906ac344aff3254c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:08.956524  6829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8f2aa288ab4acbaed865dbcae498c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.958662  6957 tablet_bootstrap.cc:654] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.962067  6954 tablet_bootstrap.cc:654] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.959735  6955 tablet_bootstrap.cc:654] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:08.966214  6957 tablet_bootstrap.cc:492] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: No bootstrap required, opened a new log
I20260709 13:18:08.966785  6957 ts_tablet_manager.cc:1403] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:18:08.970045  6957 raft_consensus.cc:359] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.970181  6903 tablet_service.cc:1511] Processing CreateTablet for tablet 3a8f2aa288ab4acbaed865dbcae498c2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=12dd5c2c263147ba906ac344aff3254c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:18:08.970894  6957 raft_consensus.cc:385] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.971320  6957 raft_consensus.cc:740] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.971906  6903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8f2aa288ab4acbaed865dbcae498c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:08.972223  6957 consensus_queue.cc:260] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.980192  6957 ts_tablet_manager.cc:1434] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:18:08.982765  6954 tablet_bootstrap.cc:492] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: No bootstrap required, opened a new log
I20260709 13:18:08.983592  6954 ts_tablet_manager.cc:1403] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.007s
I20260709 13:18:08.986894  6955 tablet_bootstrap.cc:492] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: No bootstrap required, opened a new log
I20260709 13:18:08.987502  6955 ts_tablet_manager.cc:1403] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.010s
I20260709 13:18:08.987239  6954 raft_consensus.cc:359] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.988175  6954 raft_consensus.cc:385] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.988560  6954 raft_consensus.cc:740] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b47ec115ed4d94b55051314c824af5, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.989564  6954 consensus_queue.cc:260] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.990795  6957 tablet_bootstrap.cc:492] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: Bootstrap starting.
I20260709 13:18:08.993517  6955 raft_consensus.cc:359] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.994343  6955 raft_consensus.cc:385] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:08.994756  6955 raft_consensus.cc:740] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Initialized, Role: FOLLOWER
I20260709 13:18:08.995554  6955 consensus_queue.cc:260] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:08.997942  6955 ts_tablet_manager.cc:1434] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:08.999051  6955 tablet_bootstrap.cc:492] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Bootstrap starting.
I20260709 13:18:08.999586  6954 ts_tablet_manager.cc:1434] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:18:09.001689  6957 tablet_bootstrap.cc:654] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.003314  6954 tablet_bootstrap.cc:492] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5: Bootstrap starting.
I20260709 13:18:09.007400  6955 tablet_bootstrap.cc:654] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.010654  6954 tablet_bootstrap.cc:654] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:09.021234  6955 tablet_bootstrap.cc:492] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: No bootstrap required, opened a new log
I20260709 13:18:09.022858  6955 ts_tablet_manager.cc:1403] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:18:09.024443  6954 tablet_bootstrap.cc:492] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5: No bootstrap required, opened a new log
I20260709 13:18:09.024886  6957 tablet_bootstrap.cc:492] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: No bootstrap required, opened a new log
I20260709 13:18:09.025029  6954 ts_tablet_manager.cc:1403] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:18:09.025472  6957 ts_tablet_manager.cc:1403] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.007s
I20260709 13:18:09.025520  6955 raft_consensus.cc:359] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.026296  6955 raft_consensus.cc:385] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.026536  6955 raft_consensus.cc:740] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.027220  6955 consensus_queue.cc:260] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.028178  6954 raft_consensus.cc:359] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.028968  6954 raft_consensus.cc:385] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.029270  6954 raft_consensus.cc:740] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b47ec115ed4d94b55051314c824af5, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.029364  6955 ts_tablet_manager.cc:1434] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:09.029981  6957 raft_consensus.cc:359] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.030174  6954 consensus_queue.cc:260] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.030844  6957 raft_consensus.cc:385] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:09.031239  6957 raft_consensus.cc:740] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Initialized, Role: FOLLOWER
I20260709 13:18:09.032526  6954 ts_tablet_manager.cc:1434] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:09.032208  6957 consensus_queue.cc:260] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.034929  6957 ts_tablet_manager.cc:1434] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
W20260709 13:18:09.094076  6711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:09.127648  6963 raft_consensus.cc:493] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.128283  6963 raft_consensus.cc:515] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.130379  6963 leader_election.cc:290] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.140379  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" is_pre_election: true
I20260709 13:18:09.140729  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5" is_pre_election: true
I20260709 13:18:09.141104  6765 raft_consensus.cc:2468] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 0.
I20260709 13:18:09.141441  6914 raft_consensus.cc:2468] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 0.
I20260709 13:18:09.142311  6803 leader_election.cc:304] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:09.143028  6963 raft_consensus.cc:2804] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.143397  6963 raft_consensus.cc:493] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.143687  6963 raft_consensus.cc:3060] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.148939  6963 raft_consensus.cc:515] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.150547  6963 leader_election.cc:290] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 election: Requested vote from peers 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.151364  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
I20260709 13:18:09.151551  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:09.151971  6765 raft_consensus.cc:3060] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.152161  6914 raft_consensus.cc:3060] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.157668  6765 raft_consensus.cc:2468] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 1.
I20260709 13:18:09.157678  6914 raft_consensus.cc:2468] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 1.
I20260709 13:18:09.158871  6803 leader_election.cc:304] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:09.159732  6963 raft_consensus.cc:2804] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.160653  6963 raft_consensus.cc:697] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Becoming Leader. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Running, Role: LEADER
I20260709 13:18:09.161449  6963 consensus_queue.cc:237] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.168784  6662 catalog_manager.cc:5697] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130). New cstate: current_term: 1 leader_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.244338  6962 consensus_queue.cc:1048] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.262377  6967 consensus_queue.cc:1048] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.291491  6963 raft_consensus.cc:493] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.291980  6963 raft_consensus.cc:515] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.293952  6963 leader_election.cc:290] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.294791  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" is_pre_election: true
I20260709 13:18:09.295053  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5" is_pre_election: true
I20260709 13:18:09.295548  6765 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 0.
I20260709 13:18:09.295698  6914 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 0.
I20260709 13:18:09.296700  6803 leader_election.cc:304] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:09.297380  6963 raft_consensus.cc:2804] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:09.297679  6963 raft_consensus.cc:493] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.297956  6963 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.303354  6963 raft_consensus.cc:515] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.305088  6963 leader_election.cc:290] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 election: Requested vote from peers 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.305786  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
I20260709 13:18:09.306098  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:09.306452  6765 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.306708  6914 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:09.313506  6914 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 1.
I20260709 13:18:09.313506  6765 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 1.
I20260709 13:18:09.314662  6806 leader_election.cc:304] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, c5b47ec115ed4d94b55051314c824af5; no voters: 
I20260709 13:18:09.315383  6963 raft_consensus.cc:2804] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:09.315861  6963 raft_consensus.cc:697] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Becoming Leader. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Running, Role: LEADER
I20260709 13:18:09.316664  6963 consensus_queue.cc:237] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.323071  6662 catalog_manager.cc:5697] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130). New cstate: current_term: 1 leader_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.352507  6765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4"
dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
mode: GRACEFUL
new_leader_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:09.353070  6765 raft_consensus.cc:606] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Received request to transfer leadership to TS 0c6597e6f3ce4353bea678fd2070f6ff
I20260709 13:18:09.366654  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2"
dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
mode: GRACEFUL
new_leader_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
 from {username='slave'} at 127.0.0.1:45516
I20260709 13:18:09.367179  6840 raft_consensus.cc:606] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Received request to transfer leadership to TS 7ca71dfe0e8b4bab94e4a0ee4cba7a99
I20260709 13:18:09.372295  6840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2"
dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
mode: GRACEFUL
new_leader_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
 from {username='slave'} at 127.0.0.1:45516
I20260709 13:18:09.372776  6840 raft_consensus.cc:606] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Received request to transfer leadership to TS 7ca71dfe0e8b4bab94e4a0ee4cba7a99
I20260709 13:18:09.394444  6962 consensus_queue.cc:1048] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.406298  6987 consensus_queue.cc:1048] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.560937  6963 consensus_queue.cc:1048] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.575444  6963 consensus_queue.cc:1048] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.584662  6997 raft_consensus.cc:993] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: : Instructing follower 7ca71dfe0e8b4bab94e4a0ee4cba7a99 to start an election
I20260709 13:18:09.585220  6963 raft_consensus.cc:1081] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Signalling peer 7ca71dfe0e8b4bab94e4a0ee4cba7a99 to start an election
I20260709 13:18:09.586761  6765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2"
dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
 from {username='slave'} at 127.0.0.1:46284
I20260709 13:18:09.587286  6765 raft_consensus.cc:493] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.587677  6765 raft_consensus.cc:3060] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.593804  6765 raft_consensus.cc:515] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.595459  6765 leader_election.cc:290] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 2 election: Requested vote from peers 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.596447  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
I20260709 13:18:09.596661  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a8f2aa288ab4acbaed865dbcae498c2" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:09.597139  6840 raft_consensus.cc:3055] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.597205  6914 raft_consensus.cc:3060] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.597616  6840 raft_consensus.cc:740] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Running, Role: LEADER
I20260709 13:18:09.598476  6840 consensus_queue.cc:260] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.599822  6840 raft_consensus.cc:3060] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.602970  6914 raft_consensus.cc:2468] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 2.
I20260709 13:18:09.604086  6731 leader_election.cc:304] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, c5b47ec115ed4d94b55051314c824af5; no voters: 
I20260709 13:18:09.604815  6962 raft_consensus.cc:2804] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.605291  6840 raft_consensus.cc:2468] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 2.
I20260709 13:18:09.605319  6962 raft_consensus.cc:697] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Becoming Leader. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Running, Role: LEADER
I20260709 13:18:09.606603  6962 consensus_queue.cc:237] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.612717  6663 catalog_manager.cc:5697] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 reported cstate change: term changed from 1 to 2, leader changed from 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130) to 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.814604  6987 raft_consensus.cc:993] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: : Instructing follower 0c6597e6f3ce4353bea678fd2070f6ff to start an election
I20260709 13:18:09.815164  6962 raft_consensus.cc:1081] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Signalling peer 0c6597e6f3ce4353bea678fd2070f6ff to start an election
I20260709 13:18:09.816896  6840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4"
dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
 from {username='slave'} at 127.0.0.1:45506
I20260709 13:18:09.817481  6840 raft_consensus.cc:493] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.817793  6840 raft_consensus.cc:3060] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.824303  6840 raft_consensus.cc:515] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.827054  6765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
I20260709 13:18:09.827735  6765 raft_consensus.cc:3055] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.828099  6765 raft_consensus.cc:740] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Running, Role: LEADER
I20260709 13:18:09.829061  6914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d881e43bb53d4fa0b11fc68f85c506d4" candidate_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:09.828876  6765 consensus_queue.cc:260] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.829658  6914 raft_consensus.cc:3060] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.830047  6765 raft_consensus.cc:3060] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.826426  6840 leader_election.cc:290] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 2 election: Requested vote from peers 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.836963  6765 raft_consensus.cc:2468] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 2.
I20260709 13:18:09.836963  6914 raft_consensus.cc:2468] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c6597e6f3ce4353bea678fd2070f6ff in term 2.
I20260709 13:18:09.838371  6803 leader_election.cc:304] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c6597e6f3ce4353bea678fd2070f6ff, 7ca71dfe0e8b4bab94e4a0ee4cba7a99; no voters: 
I20260709 13:18:09.839113  6963 raft_consensus.cc:2804] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.839550  6963 raft_consensus.cc:697] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 LEADER]: Becoming Leader. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Running, Role: LEADER
I20260709 13:18:09.840412  6963 consensus_queue.cc:237] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.842516  6997 consensus_queue.cc:1048] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:09.848253  6663 catalog_manager.cc:5697] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff reported cstate change: term changed from 1 to 2, leader changed from 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129) to 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130). New cstate: current_term: 2 leader_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:09.849687  6963 raft_consensus.cc:993] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: : Instructing follower 7ca71dfe0e8b4bab94e4a0ee4cba7a99 to start an election
I20260709 13:18:09.850371  6963 raft_consensus.cc:1081] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Signalling peer 7ca71dfe0e8b4bab94e4a0ee4cba7a99 to start an election
I20260709 13:18:09.853392  6764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2"
dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
 from {username='slave'} at 127.0.0.1:46284
I20260709 13:18:09.854753  6764 raft_consensus.cc:493] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.855145  6764 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.855396  6963 consensus_queue.cc:1048] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:09.863674  6764 raft_consensus.cc:515] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.866881  6764 leader_election.cc:290] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 2 election: Requested vote from peers 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417), c5b47ec115ed4d94b55051314c824af5 (127.29.5.131:45543)
I20260709 13:18:09.867285  6913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
I20260709 13:18:09.868027  6913 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:09.866849  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
I20260709 13:18:09.868834  6840 raft_consensus.cc:3055] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:09.869362  6840 raft_consensus.cc:740] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c6597e6f3ce4353bea678fd2070f6ff, State: Running, Role: LEADER
I20260709 13:18:09.870457  6840 consensus_queue.cc:260] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.871629  6840 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:09.872102  7000 consensus_queue.cc:1175] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5b47ec115ed4d94b55051314c824af5" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:18:09.876123  6913 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 2.
I20260709 13:18:09.878577  6840 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca71dfe0e8b4bab94e4a0ee4cba7a99 in term 2.
I20260709 13:18:09.878613  6731 leader_election.cc:304] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, c5b47ec115ed4d94b55051314c824af5; no voters: 
I20260709 13:18:09.880164  6962 raft_consensus.cc:2804] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:09.880596  6962 raft_consensus.cc:697] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Becoming Leader. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Running, Role: LEADER
I20260709 13:18:09.881392  6962 consensus_queue.cc:237] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:09.887041  6663 catalog_manager.cc:5697] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 reported cstate change: term changed from 1 to 2, leader changed from 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130) to 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.054186  6840 raft_consensus.cc:1275] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Refusing update from remote peer 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.055474  6962 consensus_queue.cc:1048] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.063324  6913 raft_consensus.cc:1275] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Refusing update from remote peer 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.064994  6962 consensus_queue.cc:1048] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.105145 29718 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:18:10.106703 29718 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:18:10.107134 29718 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:18:10.119216  6764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2"
dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
mode: GRACEFUL
new_leader_uuid: "c5b47ec115ed4d94b55051314c824af5"
 from {username='slave'} at 127.0.0.1:46296
I20260709 13:18:10.119844  6764 raft_consensus.cc:606] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Received request to transfer leadership to TS c5b47ec115ed4d94b55051314c824af5
I20260709 13:18:10.121078 29718 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:18:10.253611  6913 raft_consensus.cc:1275] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Refusing update from remote peer 0c6597e6f3ce4353bea678fd2070f6ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.255070  7000 consensus_queue.cc:1048] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.263065  6764 raft_consensus.cc:1275] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Refusing update from remote peer 0c6597e6f3ce4353bea678fd2070f6ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.264797  6983 consensus_queue.cc:1048] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.289296  6913 raft_consensus.cc:1275] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Refusing update from remote peer 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.290597  6987 consensus_queue.cc:1048] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:10.295327  6962 raft_consensus.cc:993] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: : Instructing follower c5b47ec115ed4d94b55051314c824af5 to start an election
I20260709 13:18:10.295962  7002 raft_consensus.cc:1081] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Signalling peer c5b47ec115ed4d94b55051314c824af5 to start an election
I20260709 13:18:10.297775  6914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2"
dest_uuid: "c5b47ec115ed4d94b55051314c824af5"
 from {username='slave'} at 127.0.0.1:34712
I20260709 13:18:10.298525  6914 raft_consensus.cc:493] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.298915  6914 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.304663  6840 raft_consensus.cc:1275] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Refusing update from remote peer 7ca71dfe0e8b4bab94e4a0ee4cba7a99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:10.306123  6987 consensus_queue.cc:1048] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:10.306113  6914 raft_consensus.cc:515] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:10.320187  6914 leader_election.cc:290] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [CANDIDATE]: Term 3 election: Requested vote from peers 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129:41185), 0c6597e6f3ce4353bea678fd2070f6ff (127.29.5.130:42417)
I20260709 13:18:10.322772  6764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "c5b47ec115ed4d94b55051314c824af5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99"
I20260709 13:18:10.323696  6764 raft_consensus.cc:3055] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:10.324492  6764 raft_consensus.cc:740] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, State: Running, Role: LEADER
I20260709 13:18:10.325470  6764 consensus_queue.cc:260] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:10.326583  6764 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.332072  6840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60680977d2304fdaa5141bfd7f1e8bd2" candidate_uuid: "c5b47ec115ed4d94b55051314c824af5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c6597e6f3ce4353bea678fd2070f6ff"
I20260709 13:18:10.332831  6840 raft_consensus.cc:3060] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.337146  6764 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b47ec115ed4d94b55051314c824af5 in term 3.
I20260709 13:18:10.338423  6877 leader_election.cc:304] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ca71dfe0e8b4bab94e4a0ee4cba7a99, c5b47ec115ed4d94b55051314c824af5; no voters: 
I20260709 13:18:10.339470  6958 raft_consensus.cc:2804] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:10.340063  6840 raft_consensus.cc:2468] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b47ec115ed4d94b55051314c824af5 in term 3.
I20260709 13:18:10.340838  6958 raft_consensus.cc:697] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 3 LEADER]: Becoming Leader. State: Replica: c5b47ec115ed4d94b55051314c824af5, State: Running, Role: LEADER
I20260709 13:18:10.341755  6958 consensus_queue.cc:237] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } }
I20260709 13:18:10.347831  6660 catalog_manager.cc:5697] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 reported cstate change: term changed from 2 to 3, leader changed from 7ca71dfe0e8b4bab94e4a0ee4cba7a99 (127.29.5.129) to c5b47ec115ed4d94b55051314c824af5 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "c5b47ec115ed4d94b55051314c824af5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ca71dfe0e8b4bab94e4a0ee4cba7a99" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 41185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c6597e6f3ce4353bea678fd2070f6ff" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5b47ec115ed4d94b55051314c824af5" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 45543 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.477082 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
I20260709 13:18:10.496443 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:10.497113 29718 tablet_replica.cc:333] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: stopping tablet replica
I20260709 13:18:10.497704 29718 raft_consensus.cc:2243] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:10.498555 29718 raft_consensus.cc:2272] T 3a8f2aa288ab4acbaed865dbcae498c2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.501065 29718 tablet_replica.cc:333] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: stopping tablet replica
I20260709 13:18:10.501614 29718 raft_consensus.cc:2243] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:10.502416 29718 raft_consensus.cc:2272] T 3321f104f724461c98a47f7463c3b068 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.504379 29718 tablet_replica.cc:333] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: stopping tablet replica
I20260709 13:18:10.504897 29718 raft_consensus.cc:2243] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.505414 29718 raft_consensus.cc:2272] T 60680977d2304fdaa5141bfd7f1e8bd2 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.507637 29718 tablet_replica.cc:333] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99: stopping tablet replica
I20260709 13:18:10.508186 29718 raft_consensus.cc:2243] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.508610 29718 raft_consensus.cc:2272] T d881e43bb53d4fa0b11fc68f85c506d4 P 7ca71dfe0e8b4bab94e4a0ee4cba7a99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.532202 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
I20260709 13:18:10.544257 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
I20260709 13:18:10.562461 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:10.563056 29718 tablet_replica.cc:333] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff: stopping tablet replica
I20260709 13:18:10.563565 29718 raft_consensus.cc:2243] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.564100 29718 raft_consensus.cc:2272] T 3a8f2aa288ab4acbaed865dbcae498c2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.566231 29718 tablet_replica.cc:333] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff: stopping tablet replica
I20260709 13:18:10.566761 29718 raft_consensus.cc:2243] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.567210 29718 raft_consensus.cc:2272] T 60680977d2304fdaa5141bfd7f1e8bd2 P 0c6597e6f3ce4353bea678fd2070f6ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.569296 29718 tablet_replica.cc:333] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff: stopping tablet replica
I20260709 13:18:10.569991 29718 raft_consensus.cc:2243] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:10.570802 29718 raft_consensus.cc:2272] T d881e43bb53d4fa0b11fc68f85c506d4 P 0c6597e6f3ce4353bea678fd2070f6ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.573266 29718 tablet_replica.cc:333] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff: stopping tablet replica
I20260709 13:18:10.573781 29718 raft_consensus.cc:2243] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.574225 29718 raft_consensus.cc:2272] T 3321f104f724461c98a47f7463c3b068 P 0c6597e6f3ce4353bea678fd2070f6ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.596956 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
I20260709 13:18:10.609450 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
I20260709 13:18:10.628670 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:10.629341 29718 tablet_replica.cc:333] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5: stopping tablet replica
I20260709 13:18:10.629927 29718 raft_consensus.cc:2243] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.630427 29718 raft_consensus.cc:2272] T 3a8f2aa288ab4acbaed865dbcae498c2 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.632985 29718 tablet_replica.cc:333] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: stopping tablet replica
I20260709 13:18:10.633528 29718 raft_consensus.cc:2243] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:10.634173 29718 pending_rounds.cc:70] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: Trying to abort 1 pending ops.
I20260709 13:18:10.634361 29718 pending_rounds.cc:77] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638258047193088 op_type: NO_OP noop_request { }
I20260709 13:18:10.634692 29718 raft_consensus.cc:2889] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:18:10.634984 29718 raft_consensus.cc:2272] T 60680977d2304fdaa5141bfd7f1e8bd2 P c5b47ec115ed4d94b55051314c824af5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.637301 29718 tablet_replica.cc:333] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5: stopping tablet replica
I20260709 13:18:10.637830 29718 raft_consensus.cc:2243] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.638257 29718 raft_consensus.cc:2272] T d881e43bb53d4fa0b11fc68f85c506d4 P c5b47ec115ed4d94b55051314c824af5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.640475 29718 tablet_replica.cc:333] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5: stopping tablet replica
I20260709 13:18:10.640966 29718 raft_consensus.cc:2243] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.641373 29718 raft_consensus.cc:2272] T 3321f104f724461c98a47f7463c3b068 P c5b47ec115ed4d94b55051314c824af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.653627 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
I20260709 13:18:10.665434 29718 master.cc:562] Master@127.29.5.190:41493 shutting down...
I20260709 13:18:10.680192 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:10.680703 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.680975 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P 016db6e546cb4a3f90c153a7dd1a81e0: stopping tablet replica
I20260709 13:18:10.699380 29718 master.cc:584] Master@127.29.5.190:41493 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2763 ms)
[----------] 6 tests from LeaderRebalancerTest (286671 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:18:10.726219 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:41103
I20260709 13:18:10.727360 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:10.732297  7010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:10.732319  7011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:10.734879  7013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:10.734911 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:10.735980 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:10.736182 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:10.736347 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603090736314 us; error 0 us; skew 500 ppm
I20260709 13:18:10.736886 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:10.739033 29718 webserver.cc:533] Webserver started at http://127.29.5.190:45321/ using document root <none> and password file <none>
I20260709 13:18:10.739511 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:10.739667 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:10.740216 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:10.741282 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "60e0f0ddbf10408d9f62278f64ef81ac"
format_stamp: "Formatted at 2026-07-09 13:18:10 on dist-test-slave-kgkf"
I20260709 13:18:10.745553 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:10.748891  7018 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:10.749783 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:10.750041 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "60e0f0ddbf10408d9f62278f64ef81ac"
format_stamp: "Formatted at 2026-07-09 13:18:10 on dist-test-slave-kgkf"
I20260709 13:18:10.750268 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:10.764590 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:10.765556 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:10.800714 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:41103
I20260709 13:18:10.800802  7069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:41103 every 8 connection(s)
I20260709 13:18:10.804600  7070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:10.815294  7070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac: Bootstrap starting.
I20260709 13:18:10.819872  7070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:10.823940  7070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac: No bootstrap required, opened a new log
I20260709 13:18:10.826007  7070 raft_consensus.cc:359] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" member_type: VOTER }
I20260709 13:18:10.826396  7070 raft_consensus.cc:385] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:10.826623  7070 raft_consensus.cc:740] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e0f0ddbf10408d9f62278f64ef81ac, State: Initialized, Role: FOLLOWER
I20260709 13:18:10.827260  7070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" member_type: VOTER }
I20260709 13:18:10.827739  7070 raft_consensus.cc:399] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:10.828007  7070 raft_consensus.cc:493] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:10.828290  7070 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:10.832881  7070 raft_consensus.cc:515] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" member_type: VOTER }
I20260709 13:18:10.833374  7070 leader_election.cc:304] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60e0f0ddbf10408d9f62278f64ef81ac; no voters: 
I20260709 13:18:10.834542  7070 leader_election.cc:290] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:10.834875  7073 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:10.836467  7073 raft_consensus.cc:697] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 1 LEADER]: Becoming Leader. State: Replica: 60e0f0ddbf10408d9f62278f64ef81ac, State: Running, Role: LEADER
I20260709 13:18:10.837139  7073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" member_type: VOTER }
I20260709 13:18:10.837522  7070 sys_catalog.cc:565] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:10.840178  7074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" member_type: VOTER } }
I20260709 13:18:10.840215  7075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60e0f0ddbf10408d9f62278f64ef81ac. Latest consensus state: current_term: 1 leader_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e0f0ddbf10408d9f62278f64ef81ac" member_type: VOTER } }
I20260709 13:18:10.841091  7074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:10.841212  7075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:10.844595  7079 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:10.853566  7079 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:10.861678 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:10.863894  7079 catalog_manager.cc:1383] Generated new cluster ID: 1d6db009b4e34064a6f44ed4545da8c5
I20260709 13:18:10.864166  7079 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:10.875011  7079 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:10.876287  7079 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:10.892154  7079 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac: Generated new TSK 0
I20260709 13:18:10.892797  7079 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:10.928678 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:10.934762  7091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:10.936280  7092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:10.937943 29718 server_base.cc:1061] running on GCE node
W20260709 13:18:10.937872  7094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:10.939320 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:10.939527 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:10.939661 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603090939649 us; error 0 us; skew 500 ppm
I20260709 13:18:10.940248 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:10.942600 29718 webserver.cc:533] Webserver started at http://127.29.5.129:46065/ using document root <none> and password file <none>
I20260709 13:18:10.943069 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:10.943243 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:10.943485 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:10.944669 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "16f325bf8ca844cd9dc056daecf0e251"
format_stamp: "Formatted at 2026-07-09 13:18:10 on dist-test-slave-kgkf"
I20260709 13:18:10.949244 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:18:10.952962  7099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:10.953812 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:18:10.954135 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "16f325bf8ca844cd9dc056daecf0e251"
format_stamp: "Formatted at 2026-07-09 13:18:10 on dist-test-slave-kgkf"
I20260709 13:18:10.954437 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:11.001106 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:11.002416 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:11.004056 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:11.006589 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:11.006829 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.007097 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:11.007302 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.049983 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:37291
I20260709 13:18:11.050069  7161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:37291 every 8 connection(s)
I20260709 13:18:11.055378 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:11.062937  7166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:11.064553  7167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:11.066372 29718 server_base.cc:1061] running on GCE node
W20260709 13:18:11.067193  7169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:11.068473 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:11.068677 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:11.068919 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603091068880 us; error 0 us; skew 500 ppm
I20260709 13:18:11.069630 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:11.069799  7162 heartbeater.cc:344] Connected to a master server at 127.29.5.190:41103
I20260709 13:18:11.070273  7162 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:11.071136  7162 heartbeater.cc:507] Master 127.29.5.190:41103 requested a full tablet report, sending...
I20260709 13:18:11.072309 29718 webserver.cc:533] Webserver started at http://127.29.5.130:35403/ using document root <none> and password file <none>
I20260709 13:18:11.073091 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:11.073351 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:11.073552  7035 ts_manager.cc:194] Registered new tserver with Master: 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291)
I20260709 13:18:11.073721 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:11.075387 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "9c8319591e9b44beae48a55a48d9ef81"
format_stamp: "Formatted at 2026-07-09 13:18:11 on dist-test-slave-kgkf"
I20260709 13:18:11.076257  7035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45986
I20260709 13:18:11.080830 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:11.084515  7174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.085332 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:18:11.085677 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "9c8319591e9b44beae48a55a48d9ef81"
format_stamp: "Formatted at 2026-07-09 13:18:11 on dist-test-slave-kgkf"
I20260709 13:18:11.086036 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:11.102761 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:11.103964 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:11.105479 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:11.107887 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:11.108120 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.108392 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:11.108572 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.146363 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:33239
I20260709 13:18:11.146479  7236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:33239 every 8 connection(s)
I20260709 13:18:11.151134 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:11.159161  7240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:11.160389  7241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:11.164279  7237 heartbeater.cc:344] Connected to a master server at 127.29.5.190:41103
W20260709 13:18:11.164278  7243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:11.164368 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:11.165066  7237 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:11.165824 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:11.165952  7237 heartbeater.cc:507] Master 127.29.5.190:41103 requested a full tablet report, sending...
W20260709 13:18:11.166066 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:11.166421 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603091166404 us; error 0 us; skew 500 ppm
I20260709 13:18:11.167083 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:11.168421  7035 ts_manager.cc:194] Registered new tserver with Master: 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:11.169766 29718 webserver.cc:533] Webserver started at http://127.29.5.131:33635/ using document root <none> and password file <none>
I20260709 13:18:11.170318  7035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46002
I20260709 13:18:11.170451 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:11.170847 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:11.171193 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:11.172686 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "69f68cad86bb493291b46335b3989eea"
format_stamp: "Formatted at 2026-07-09 13:18:11 on dist-test-slave-kgkf"
I20260709 13:18:11.177026 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:11.180284  7248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.181238 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:18:11.181500 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "69f68cad86bb493291b46335b3989eea"
format_stamp: "Formatted at 2026-07-09 13:18:11 on dist-test-slave-kgkf"
I20260709 13:18:11.181775 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:11.200584 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:11.201632 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:11.203037 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:11.205359 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:11.205545 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.205852 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:11.206012 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:11.252897  7310 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:39211 every 8 connection(s)
I20260709 13:18:11.252951 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:39211
I20260709 13:18:11.272591  7311 heartbeater.cc:344] Connected to a master server at 127.29.5.190:41103
I20260709 13:18:11.273022  7311 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:11.274058  7311 heartbeater.cc:507] Master 127.29.5.190:41103 requested a full tablet report, sending...
I20260709 13:18:11.276577  7035 ts_manager.cc:194] Registered new tserver with Master: 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.277324 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01926677s
I20260709 13:18:11.278059  7035 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46010
I20260709 13:18:11.302080  7035 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46016:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:11.304702  7035 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:11.368800  7127 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8c9b2d30614aeea62a7713107722ce (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:11.370169  7127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8c9b2d30614aeea62a7713107722ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.370427  7125 tablet_service.cc:1511] Processing CreateTablet for tablet 28a8795c7faa4934af115277e1f67b5f (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:11.370947  7126 tablet_service.cc:1511] Processing CreateTablet for tablet 6313b5af1a1a46199cbd0d253e0f5e33 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:11.371873  7125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a8795c7faa4934af115277e1f67b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.372478  7126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6313b5af1a1a46199cbd0d253e0f5e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.373757  7202 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8c9b2d30614aeea62a7713107722ce (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:11.375039  7202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8c9b2d30614aeea62a7713107722ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.376845  7201 tablet_service.cc:1511] Processing CreateTablet for tablet 6313b5af1a1a46199cbd0d253e0f5e33 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:11.377686  7124 tablet_service.cc:1511] Processing CreateTablet for tablet 43ed194745d34f309da2d1cc8d3cca29 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:11.378218  7201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6313b5af1a1a46199cbd0d253e0f5e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.379000  7124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ed194745d34f309da2d1cc8d3cca29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.383219  7123 tablet_service.cc:1511] Processing CreateTablet for tablet 66354f947ee3445889cfc111f6c273c9 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:11.384645  7123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66354f947ee3445889cfc111f6c273c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.384892  7199 tablet_service.cc:1511] Processing CreateTablet for tablet 43ed194745d34f309da2d1cc8d3cca29 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:11.386207  7199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ed194745d34f309da2d1cc8d3cca29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.387027  7200 tablet_service.cc:1511] Processing CreateTablet for tablet 28a8795c7faa4934af115277e1f67b5f (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:11.387934  7121 tablet_service.cc:1511] Processing CreateTablet for tablet 6a82ae27b5d543b3b5b5cf3e6ef63dd0 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:11.389271  7121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82ae27b5d543b3b5b5cf3e6ef63dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.391546  7197 tablet_service.cc:1511] Processing CreateTablet for tablet eaa4a23d43704835aa188b111403ee9d (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:11.393793  7196 tablet_service.cc:1511] Processing CreateTablet for tablet 6a82ae27b5d543b3b5b5cf3e6ef63dd0 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:11.388402  7200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a8795c7faa4934af115277e1f67b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.398388  7119 tablet_service.cc:1511] Processing CreateTablet for tablet afcd7ee807b64106b29a1f2d9c43cc91 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:11.398555  7120 tablet_service.cc:1511] Processing CreateTablet for tablet afc3e56a4ecd4acb86ae504e26a67d5b (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:11.399636  7119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd7ee807b64106b29a1f2d9c43cc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.400584  7122 tablet_service.cc:1511] Processing CreateTablet for tablet eaa4a23d43704835aa188b111403ee9d (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:11.401876  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa4a23d43704835aa188b111403ee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.404474  7198 tablet_service.cc:1511] Processing CreateTablet for tablet 66354f947ee3445889cfc111f6c273c9 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:11.395990  7195 tablet_service.cc:1511] Processing CreateTablet for tablet afc3e56a4ecd4acb86ae504e26a67d5b (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:11.407074  7120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc3e56a4ecd4acb86ae504e26a67d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.412103  7198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66354f947ee3445889cfc111f6c273c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.412848  7195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc3e56a4ecd4acb86ae504e26a67d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.416079  7197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa4a23d43704835aa188b111403ee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.419734  7196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82ae27b5d543b3b5b5cf3e6ef63dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.453481  7194 tablet_service.cc:1511] Processing CreateTablet for tablet afcd7ee807b64106b29a1f2d9c43cc91 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:11.454959  7194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd7ee807b64106b29a1f2d9c43cc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.465962  7276 tablet_service.cc:1511] Processing CreateTablet for tablet 5d8c9b2d30614aeea62a7713107722ce (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:11.469571  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d8c9b2d30614aeea62a7713107722ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.472652  7326 tablet_bootstrap.cc:492] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.477424  7275 tablet_service.cc:1511] Processing CreateTablet for tablet 6313b5af1a1a46199cbd0d253e0f5e33 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:11.478736  7326 tablet_bootstrap.cc:654] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.478899  7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6313b5af1a1a46199cbd0d253e0f5e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.490039  7327 tablet_bootstrap.cc:492] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:11.508383  7269 tablet_service.cc:1511] Processing CreateTablet for tablet afc3e56a4ecd4acb86ae504e26a67d5b (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:11.508864  7274 tablet_service.cc:1511] Processing CreateTablet for tablet 28a8795c7faa4934af115277e1f67b5f (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:11.509891  7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc3e56a4ecd4acb86ae504e26a67d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.511041  7273 tablet_service.cc:1511] Processing CreateTablet for tablet 43ed194745d34f309da2d1cc8d3cca29 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:11.516978  7268 tablet_service.cc:1511] Processing CreateTablet for tablet afcd7ee807b64106b29a1f2d9c43cc91 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:11.517956  7270 tablet_service.cc:1511] Processing CreateTablet for tablet 6a82ae27b5d543b3b5b5cf3e6ef63dd0 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:11.516978  7271 tablet_service.cc:1511] Processing CreateTablet for tablet eaa4a23d43704835aa188b111403ee9d (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:11.521138  7272 tablet_service.cc:1511] Processing CreateTablet for tablet 66354f947ee3445889cfc111f6c273c9 (DEFAULT_TABLE table=test-workload [id=b6f571c7158449fca14b57873e003de2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:11.529040  7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a8795c7faa4934af115277e1f67b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.529778  7268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afcd7ee807b64106b29a1f2d9c43cc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.532757  7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ed194745d34f309da2d1cc8d3cca29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.536839  7270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82ae27b5d543b3b5b5cf3e6ef63dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.537241  7328 tablet_bootstrap.cc:492] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:11.537489  7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa4a23d43704835aa188b111403ee9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.539364  7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66354f947ee3445889cfc111f6c273c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:11.563066  7328 tablet_bootstrap.cc:654] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.577615  7326 tablet_bootstrap.cc:492] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.578183  7326 ts_tablet_manager.cc:1403] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.003s
I20260709 13:18:11.582623  7326 raft_consensus.cc:359] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.583362  7326 raft_consensus.cc:385] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.573323  7327 tablet_bootstrap.cc:654] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.583671  7326 raft_consensus.cc:740] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.586087  7326 consensus_queue.cc:260] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.588621  7328 tablet_bootstrap.cc:492] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:11.593061  7328 ts_tablet_manager.cc:1403] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.005s
I20260709 13:18:11.600147  7162 heartbeater.cc:499] Master 127.29.5.190:41103 was elected leader, sending a full tablet report...
I20260709 13:18:11.601229  7328 raft_consensus.cc:359] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.604981  7326 ts_tablet_manager.cc:1434] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.006s
I20260709 13:18:11.606091  7326 tablet_bootstrap.cc:492] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.602015  7328 raft_consensus.cc:385] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.610615  7328 raft_consensus.cc:740] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.612133  7326 tablet_bootstrap.cc:654] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.611629  7328 consensus_queue.cc:260] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.642166  7311 heartbeater.cc:499] Master 127.29.5.190:41103 was elected leader, sending a full tablet report...
I20260709 13:18:11.642665  7328 ts_tablet_manager.cc:1434] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.049s	user 0.022s	sys 0.011s
I20260709 13:18:11.643458  7327 tablet_bootstrap.cc:492] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:11.643896  7328 tablet_bootstrap.cc:492] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:11.644096  7327 ts_tablet_manager.cc:1403] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.007s
I20260709 13:18:11.645099  7326 tablet_bootstrap.cc:492] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.645740  7326 ts_tablet_manager.cc:1403] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.018s
I20260709 13:18:11.647224  7327 raft_consensus.cc:359] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.648072  7327 raft_consensus.cc:385] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.648376  7327 raft_consensus.cc:740] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.648777  7331 raft_consensus.cc:493] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.648602  7326 raft_consensus.cc:359] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.649778  7326 raft_consensus.cc:385] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.649482  7331 raft_consensus.cc:515] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.649578  7327 consensus_queue.cc:260] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.650041  7328 tablet_bootstrap.cc:654] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.650209  7326 raft_consensus.cc:740] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.651454  7326 consensus_queue.cc:260] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.655514  7331 leader_election.cc:290] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.672848  7327 ts_tablet_manager.cc:1434] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.009s
I20260709 13:18:11.674464  7237 heartbeater.cc:499] Master 127.29.5.190:41103 was elected leader, sending a full tablet report...
I20260709 13:18:11.695111  7327 tablet_bootstrap.cc:492] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:11.695284  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6313b5af1a1a46199cbd0d253e0f5e33" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:11.696079  7212 raft_consensus.cc:2468] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:11.697678  7103 leader_election.cc:304] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:11.698760  7331 raft_consensus.cc:2804] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.699167  7331 raft_consensus.cc:493] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.699508  7331 raft_consensus.cc:3060] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.701833  7326 ts_tablet_manager.cc:1434] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.043s
I20260709 13:18:11.702958  7326 tablet_bootstrap.cc:492] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.707175  7331 raft_consensus.cc:515] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.708801  7326 tablet_bootstrap.cc:654] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.710172  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6313b5af1a1a46199cbd0d253e0f5e33" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:11.710806  7212 raft_consensus.cc:3060] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.713443  7326 tablet_bootstrap.cc:492] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.713990  7326 ts_tablet_manager.cc:1403] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:18:11.710800  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6313b5af1a1a46199cbd0d253e0f5e33" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:11.716459  7327 tablet_bootstrap.cc:654] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.716858  7326 raft_consensus.cc:359] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
W20260709 13:18:11.717417  7103 leader_election.cc:343] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.717648  7326 raft_consensus.cc:385] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.717998  7326 raft_consensus.cc:740] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.718762  7326 consensus_queue.cc:260] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.720695  7326 ts_tablet_manager.cc:1434] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:11.721515  7326 tablet_bootstrap.cc:492] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.721791  7212 raft_consensus.cc:2468] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:11.722903  7103 leader_election.cc:304] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:11.723875  7336 raft_consensus.cc:2804] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.725147  7328 tablet_bootstrap.cc:492] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:11.725751  7328 ts_tablet_manager.cc:1403] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.019s
I20260709 13:18:11.727331  7326 tablet_bootstrap.cc:654] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.729164  7328 raft_consensus.cc:359] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.729933  7328 raft_consensus.cc:385] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.730248  7328 raft_consensus.cc:740] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.734894  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6313b5af1a1a46199cbd0d253e0f5e33" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:11.735663  7331 leader_election.cc:290] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.737149  7327 tablet_bootstrap.cc:492] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:11.737174  7328 consensus_queue.cc:260] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.737891  7327 ts_tablet_manager.cc:1403] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 13:18:11.738355  7286 raft_consensus.cc:3060] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.739724  7336 raft_consensus.cc:697] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:11.741088  7327 raft_consensus.cc:359] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.742017  7327 raft_consensus.cc:385] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.741089  7336 consensus_queue.cc:237] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.742324  7327 raft_consensus.cc:740] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.743341  7327 consensus_queue.cc:260] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.746273  7286 raft_consensus.cc:2468] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:11.747447  7327 ts_tablet_manager.cc:1434] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:11.748674  7327 tablet_bootstrap.cc:492] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:11.754287  7328 ts_tablet_manager.cc:1434] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.009s
I20260709 13:18:11.755164  7327 tablet_bootstrap.cc:654] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.755468  7328 tablet_bootstrap.cc:492] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:11.758765  7326 tablet_bootstrap.cc:492] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.759359  7326 ts_tablet_manager.cc:1403] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.014s
I20260709 13:18:11.763809  7326 raft_consensus.cc:359] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.764685  7326 raft_consensus.cc:385] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.764998  7326 raft_consensus.cc:740] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.765908  7326 consensus_queue.cc:260] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.768210  7326 ts_tablet_manager.cc:1434] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:18:11.769300  7326 tablet_bootstrap.cc:492] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.769793  7035 catalog_manager.cc:5697] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.773581  7328 tablet_bootstrap.cc:654] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.775695  7326 tablet_bootstrap.cc:654] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.780258  7327 tablet_bootstrap.cc:492] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:11.780953  7327 ts_tablet_manager.cc:1403] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.007s
I20260709 13:18:11.784718  7327 raft_consensus.cc:359] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.785719  7327 raft_consensus.cc:385] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.786077  7327 raft_consensus.cc:740] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.790251  7326 tablet_bootstrap.cc:492] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.790751  7326 ts_tablet_manager.cc:1403] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 13:18:11.793159  7326 raft_consensus.cc:359] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.792950  7327 consensus_queue.cc:260] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.793776  7326 raft_consensus.cc:385] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.794094  7326 raft_consensus.cc:740] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.794433  7328 tablet_bootstrap.cc:492] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:11.794997  7326 consensus_queue.cc:260] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.795464  7327 ts_tablet_manager.cc:1434] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:18:11.795552  7328 ts_tablet_manager.cc:1403] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.008s
I20260709 13:18:11.796808  7327 tablet_bootstrap.cc:492] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:11.797524  7326 ts_tablet_manager.cc:1434] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:11.798585  7326 tablet_bootstrap.cc:492] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.798799  7328 raft_consensus.cc:359] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.799546  7328 raft_consensus.cc:385] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.799851  7328 raft_consensus.cc:740] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.800716  7328 consensus_queue.cc:260] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.805102  7326 tablet_bootstrap.cc:654] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.809381  7328 ts_tablet_manager.cc:1434] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:18:11.813939  7328 tablet_bootstrap.cc:492] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:11.814260  7327 tablet_bootstrap.cc:654] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.816512  7326 tablet_bootstrap.cc:492] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.817034  7326 ts_tablet_manager.cc:1403] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:18:11.819528  7326 raft_consensus.cc:359] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.820297  7333 raft_consensus.cc:493] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.820292  7326 raft_consensus.cc:385] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.820995  7326 raft_consensus.cc:740] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.821014  7333 raft_consensus.cc:515] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.822067  7326 consensus_queue.cc:260] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.823123  7327 tablet_bootstrap.cc:492] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:11.823668  7327 ts_tablet_manager.cc:1403] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.008s
I20260709 13:18:11.824506  7326 ts_tablet_manager.cc:1434] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:11.825565  7326 tablet_bootstrap.cc:492] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.826817  7336 raft_consensus.cc:493] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.826720  7327 raft_consensus.cc:359] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.827615  7327 raft_consensus.cc:385] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.827386  7336 raft_consensus.cc:515] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.827993  7327 raft_consensus.cc:740] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.828775  7327 consensus_queue.cc:260] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.829499  7336 leader_election.cc:290] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.830107  7335 raft_consensus.cc:493] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.830579  7335 raft_consensus.cc:515] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.833108  7335 leader_election.cc:290] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.834290  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:11.835073  7212 raft_consensus.cc:2468] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:11.836444  7333 leader_election.cc:290] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291)
I20260709 13:18:11.836611  7103 leader_election.cc:304] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:11.837455  7327 ts_tablet_manager.cc:1434] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:11.838218  7336 raft_consensus.cc:2804] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.838757  7336 raft_consensus.cc:493] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.838956  7327 tablet_bootstrap.cc:492] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:11.839200  7336 raft_consensus.cc:3060] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.843350  7326 tablet_bootstrap.cc:654] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.846658  7327 tablet_bootstrap.cc:654] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.854905  7328 tablet_bootstrap.cc:654] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:11.856227  7083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:11.859525  7336 raft_consensus.cc:515] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.866580  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:11.867237  7212 raft_consensus.cc:3060] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.874935  7212 raft_consensus.cc:2468] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:11.876151  7103 leader_election.cc:304] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:11.877197  7342 raft_consensus.cc:2804] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.877856  7342 raft_consensus.cc:697] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:11.878732  7333 raft_consensus.cc:493] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.879313  7333 raft_consensus.cc:515] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.878973  7342 consensus_queue.cc:237] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.880640  7336 leader_election.cc:290] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.881526  7333 leader_election.cc:290] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:11.882912  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:11.883271  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:11.883854  7286 raft_consensus.cc:2468] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:11.890194  7328 tablet_bootstrap.cc:492] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:11.890797  7328 ts_tablet_manager.cc:1403] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.003s
I20260709 13:18:11.892243  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
W20260709 13:18:11.893781  7178 leader_election.cc:343] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.902424  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:11.903367  7212 raft_consensus.cc:2393] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69f68cad86bb493291b46335b3989eea in current term 1: Already voted for candidate 16f325bf8ca844cd9dc056daecf0e251 in this term.
I20260709 13:18:11.902976  7035 catalog_manager.cc:5697] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.907158  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:11.910220  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
W20260709 13:18:11.910406  7252 leader_election.cc:343] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.910931  7137 raft_consensus.cc:2468] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:11.913059  7175 leader_election.cc:304] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 69f68cad86bb493291b46335b3989eea
I20260709 13:18:11.914018  7352 raft_consensus.cc:2804] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.914494  7352 raft_consensus.cc:493] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.914847  7352 raft_consensus.cc:3060] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.918399  7328 raft_consensus.cc:359] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.919190  7328 raft_consensus.cc:385] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.919480  7328 raft_consensus.cc:740] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.920387  7328 consensus_queue.cc:260] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.923758  7352 raft_consensus.cc:515] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.924187  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:11.924644  7328 ts_tablet_manager.cc:1434] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:18:11.925179  7136 raft_consensus.cc:2468] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:11.925818  7328 tablet_bootstrap.cc:492] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:11.914088  7326 tablet_bootstrap.cc:492] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.926920  7326 ts_tablet_manager.cc:1403] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.023s
I20260709 13:18:11.928674  7249 leader_election.cc:304] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:11.930470  7333 raft_consensus.cc:2804] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:11.930234  7326 raft_consensus.cc:359] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.930965  7333 raft_consensus.cc:493] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.931614  7333 raft_consensus.cc:3060] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.933231  7328 tablet_bootstrap.cc:654] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.933166  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
W20260709 13:18:11.934840  7178 leader_election.cc:343] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.935428  7352 leader_election.cc:290] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.926641  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:11.937244  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:11.938076  7136 raft_consensus.cc:3060] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.938267  7328 tablet_bootstrap.cc:492] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:11.938838  7328 ts_tablet_manager.cc:1403] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:18:11.940685  7249 leader_election.cc:304] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69f68cad86bb493291b46335b3989eea; no voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:11.931103  7326 raft_consensus.cc:385] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.942752  7326 raft_consensus.cc:740] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.944819  7326 consensus_queue.cc:260] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.941706  7328 raft_consensus.cc:359] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.947902  7328 raft_consensus.cc:385] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.948210  7328 raft_consensus.cc:740] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.949141  7328 consensus_queue.cc:260] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.945597  7333 raft_consensus.cc:515] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.954222  7326 ts_tablet_manager.cc:1434] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 13:18:11.955015  7333 leader_election.cc:290] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:11.955425  7326 tablet_bootstrap.cc:492] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:11.955533  7342 raft_consensus.cc:493] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.956291  7342 raft_consensus.cc:515] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.958297  7342 leader_election.cc:290] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:11.960471  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
W20260709 13:18:11.962054  7103 leader_election.cc:343] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.963460  7326 tablet_bootstrap.cc:654] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.966370  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:11.968010  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:11.969336  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:11.970033  7137 raft_consensus.cc:3060] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:11.970362  7103 leader_election.cc:343] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.970834  7103 leader_election.cc:304] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251; no voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81
W20260709 13:18:11.969431  7252 leader_election.cc:343] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:11.972092  7333 raft_consensus.cc:3060] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:11.972254  7327 tablet_bootstrap.cc:492] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:11.973012  7327 ts_tablet_manager.cc:1403] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.054s
I20260709 13:18:11.976635  7342 raft_consensus.cc:2749] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:11.976967  7327 raft_consensus.cc:359] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.977927  7327 raft_consensus.cc:385] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:11.978307  7327 raft_consensus.cc:740] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:11.979424  7327 consensus_queue.cc:260] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.984081  7136 raft_consensus.cc:2468] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:11.985471  7175 leader_election.cc:304] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 69f68cad86bb493291b46335b3989eea
I20260709 13:18:11.986667  7352 raft_consensus.cc:2804] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:11.987125  7352 raft_consensus.cc:697] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:11.988518  7352 consensus_queue.cc:237] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:11.989703  7327 ts_tablet_manager.cc:1434] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:18:11.991209  7327 tablet_bootstrap.cc:492] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:11.994935  7326 tablet_bootstrap.cc:492] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:11.997275  7326 ts_tablet_manager.cc:1403] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.009s
I20260709 13:18:11.998306  7327 tablet_bootstrap.cc:654] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:11.996318  7137 raft_consensus.cc:2468] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:11.999536  7249 leader_election.cc:304] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:12.000828  7361 raft_consensus.cc:2804] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.001456  7361 raft_consensus.cc:697] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:12.002561  7361 consensus_queue.cc:237] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.004465  7335 raft_consensus.cc:493] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.005115  7335 raft_consensus.cc:515] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.005184  7326 raft_consensus.cc:359] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.006896  7326 raft_consensus.cc:385] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.009605  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82ae27b5d543b3b5b5cf3e6ef63dd0" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:12.014242  7286 raft_consensus.cc:2468] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:12.010066  7335 leader_election.cc:290] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.010761  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82ae27b5d543b3b5b5cf3e6ef63dd0" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:12.015796  7328 ts_tablet_manager.cc:1434] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.077s	user 0.030s	sys 0.025s
I20260709 13:18:12.015799  7178 leader_election.cc:304] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.016553  7034 catalog_manager.cc:5697] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.017132  7335 raft_consensus.cc:2804] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.017198  7326 raft_consensus.cc:740] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.017684  7327 tablet_bootstrap.cc:492] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:12.017880  7335 raft_consensus.cc:493] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.018339  7335 raft_consensus.cc:3060] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.018625  7326 consensus_queue.cc:260] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.019421  7137 raft_consensus.cc:2468] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:12.020714  7326 ts_tablet_manager.cc:1434] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:18:12.021620  7326 tablet_bootstrap.cc:492] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:12.026392  7335 raft_consensus.cc:515] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.018350  7327 ts_tablet_manager.cc:1403] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.003s
I20260709 13:18:12.028824  7326 tablet_bootstrap.cc:654] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.017123  7328 tablet_bootstrap.cc:492] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:12.011607  7333 raft_consensus.cc:2749] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.031010  7327 raft_consensus.cc:359] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.036511  7327 raft_consensus.cc:385] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.036820  7327 raft_consensus.cc:740] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.037497  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82ae27b5d543b3b5b5cf3e6ef63dd0" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:12.038160  7137 raft_consensus.cc:3060] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.038251  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82ae27b5d543b3b5b5cf3e6ef63dd0" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.038960  7286 raft_consensus.cc:3060] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.038652  7327 consensus_queue.cc:260] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.041615  7326 tablet_bootstrap.cc:492] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:12.042093  7326 ts_tablet_manager.cc:1403] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:18:12.043917  7035 catalog_manager.cc:5697] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 1 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.044893  7326 raft_consensus.cc:359] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.046433  7326 raft_consensus.cc:385] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.046712  7326 raft_consensus.cc:740] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.039780  7335 leader_election.cc:290] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.046689  7286 raft_consensus.cc:2468] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:12.047756  7326 consensus_queue.cc:260] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.048314  7178 leader_election.cc:304] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.049312  7335 raft_consensus.cc:2804] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.049922  7335 raft_consensus.cc:697] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:12.050211  7326 ts_tablet_manager.cc:1434] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:12.050690  7335 consensus_queue.cc:237] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.051268  7327 ts_tablet_manager.cc:1434] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 13:18:12.054282  7137 raft_consensus.cc:2468] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:12.056988  7328 tablet_bootstrap.cc:654] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.057802  7342 raft_consensus.cc:493] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.058331  7342 raft_consensus.cc:515] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.060168  7327 tablet_bootstrap.cc:492] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:12.060434  7342 leader_election.cc:290] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.063596  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:12.064353  7212 raft_consensus.cc:2468] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:12.066329  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:12.066329  7103 leader_election.cc:304] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.067057  7286 raft_consensus.cc:2468] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:12.067461  7342 raft_consensus.cc:2804] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.068041  7342 raft_consensus.cc:493] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.067476  7327 tablet_bootstrap.cc:654] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.068624  7342 raft_consensus.cc:3060] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.070706  7328 tablet_bootstrap.cc:492] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:12.071260  7328 ts_tablet_manager.cc:1403] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.002s
I20260709 13:18:12.074494  7328 raft_consensus.cc:359] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.075203  7328 raft_consensus.cc:385] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.075506  7328 raft_consensus.cc:740] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.076491  7328 consensus_queue.cc:260] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.077811  7342 raft_consensus.cc:515] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.078871  7328 ts_tablet_manager.cc:1434] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:18:12.078470  7035 catalog_manager.cc:5697] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.080030  7328 tablet_bootstrap.cc:492] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:12.081218  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:12.081879  7212 raft_consensus.cc:3060] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.087580  7328 tablet_bootstrap.cc:654] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.091605  7212 raft_consensus.cc:2468] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:12.093391  7328 tablet_bootstrap.cc:492] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:12.094144  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.094830  7286 raft_consensus.cc:3060] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.095356  7103 leader_election.cc:304] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.095682  7327 tablet_bootstrap.cc:492] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:12.096261  7336 raft_consensus.cc:2804] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.096376  7327 ts_tablet_manager.cc:1403] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.007s
I20260709 13:18:12.096887  7336 raft_consensus.cc:697] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:12.097783  7336 consensus_queue.cc:237] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.100114  7328 ts_tablet_manager.cc:1403] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.008s
I20260709 13:18:12.099700  7327 raft_consensus.cc:359] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.100627  7327 raft_consensus.cc:385] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.100950  7327 raft_consensus.cc:740] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.101817  7286 raft_consensus.cc:2468] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:12.096261  7342 leader_election.cc:290] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.102020  7327 consensus_queue.cc:260] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.103724  7328 raft_consensus.cc:359] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.104522  7328 raft_consensus.cc:385] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.104866  7328 raft_consensus.cc:740] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.105129  7327 ts_tablet_manager.cc:1434] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:18:12.105818  7328 consensus_queue.cc:260] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.106623  7327 tablet_bootstrap.cc:492] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:12.108562  7328 ts_tablet_manager.cc:1434] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:12.109760  7328 tablet_bootstrap.cc:492] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:12.116607  7328 tablet_bootstrap.cc:654] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.119397  7327 tablet_bootstrap.cc:654] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.124490  7327 tablet_bootstrap.cc:492] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:12.124850  7327 ts_tablet_manager.cc:1403] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:18:12.125236  7032 catalog_manager.cc:5697] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.126686  7327 raft_consensus.cc:359] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.127264  7327 raft_consensus.cc:385] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.127437  7327 raft_consensus.cc:740] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.128027  7327 consensus_queue.cc:260] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.130079  7328 tablet_bootstrap.cc:492] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:12.130537  7328 ts_tablet_manager.cc:1403] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:18:12.133064  7327 ts_tablet_manager.cc:1434] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:18:12.132797  7328 raft_consensus.cc:359] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.133543  7328 raft_consensus.cc:385] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.133819  7328 raft_consensus.cc:740] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.134308  7327 tablet_bootstrap.cc:492] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:12.134641  7328 consensus_queue.cc:260] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.138010  7328 ts_tablet_manager.cc:1434] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:18:12.138851  7328 tablet_bootstrap.cc:492] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:12.141041  7327 tablet_bootstrap.cc:654] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.144759  7328 tablet_bootstrap.cc:654] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:12.154557  7327 tablet_bootstrap.cc:492] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:12.154992  7327 ts_tablet_manager.cc:1403] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:18:12.155067  7328 tablet_bootstrap.cc:492] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:12.155596  7328 ts_tablet_manager.cc:1403] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:18:12.157071  7335 raft_consensus.cc:493] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.157616  7327 raft_consensus.cc:359] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.157593  7335 raft_consensus.cc:515] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.158296  7327 raft_consensus.cc:385] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.158037  7328 raft_consensus.cc:359] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.158496  7336 raft_consensus.cc:493] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.158632  7327 raft_consensus.cc:740] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.158804  7328 raft_consensus.cc:385] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:12.159195  7328 raft_consensus.cc:740] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:12.159075  7336 raft_consensus.cc:515] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.159504  7327 consensus_queue.cc:260] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.159924  7335 leader_election.cc:290] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.159996  7328 consensus_queue.cc:260] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.161156  7336 leader_election.cc:290] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.162151  7328 ts_tablet_manager.cc:1434] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:18:12.162427  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:12.164011  7327 ts_tablet_manager.cc:1434] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:18:12.164836  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:12.165484  7212 raft_consensus.cc:2468] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:12.165748  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:12.166450  7137 raft_consensus.cc:2393] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9c8319591e9b44beae48a55a48d9ef81 in current term 1: Already voted for candidate 69f68cad86bb493291b46335b3989eea in this term.
I20260709 13:18:12.164862  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:12.167412  7103 leader_election.cc:304] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.167590  7286 raft_consensus.cc:2468] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:12.168161  7175 leader_election.cc:304] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c8319591e9b44beae48a55a48d9ef81; no voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea
I20260709 13:18:12.168835  7336 raft_consensus.cc:2804] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.169286  7336 raft_consensus.cc:493] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.169466  7335 raft_consensus.cc:3060] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.169648  7336 raft_consensus.cc:3060] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.175987  7336 raft_consensus.cc:515] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.178010  7336 leader_election.cc:290] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.179019  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.179351  7335 raft_consensus.cc:2749] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.179131  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:12.179733  7286 raft_consensus.cc:3060] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.180298  7212 raft_consensus.cc:3060] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.184985  7286 raft_consensus.cc:2468] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:12.185302  7212 raft_consensus.cc:2468] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:12.186015  7103 leader_election.cc:304] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:12.186697  7336 raft_consensus.cc:2804] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.187158  7336 raft_consensus.cc:697] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:12.187968  7336 consensus_queue.cc:237] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.193600  7335 raft_consensus.cc:493] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.194105  7335 raft_consensus.cc:515] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.194694  7035 catalog_manager.cc:5697] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.195901  7335 leader_election.cc:290] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.197068  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:12.197405  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:12.197691  7286 raft_consensus.cc:2468] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:12.198040  7137 raft_consensus.cc:2468] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:12.198753  7178 leader_election.cc:304] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.199533  7335 raft_consensus.cc:2804] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.199923  7335 raft_consensus.cc:493] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.200205  7335 raft_consensus.cc:3060] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.200891  7352 raft_consensus.cc:493] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.201328  7352 raft_consensus.cc:515] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.203100  7352 leader_election.cc:290] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.204362  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354f947ee3445889cfc111f6c273c9" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:12.204469  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354f947ee3445889cfc111f6c273c9" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:12.205304  7137 raft_consensus.cc:2468] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:12.206187  7286 raft_consensus.cc:2468] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:12.207316  7178 leader_election.cc:304] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.207679  7335 raft_consensus.cc:515] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.208643  7352 raft_consensus.cc:2804] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:12.208998  7352 raft_consensus.cc:493] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.208664  7336 consensus_queue.cc:1048] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.209375  7352 raft_consensus.cc:3060] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.210603  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:12.210968  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.211272  7137 raft_consensus.cc:3060] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.211750  7286 raft_consensus.cc:3060] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.217710  7352 raft_consensus.cc:515] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.218668  7137 raft_consensus.cc:2468] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:12.210743  7335 leader_election.cc:290] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.220149  7175 leader_election.cc:304] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.220515  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354f947ee3445889cfc111f6c273c9" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:12.221124  7137 raft_consensus.cc:3060] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.221487  7286 raft_consensus.cc:2468] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:12.221661  7352 leader_election.cc:290] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.222335  7352 raft_consensus.cc:2804] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.222795  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66354f947ee3445889cfc111f6c273c9" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.224785  7286 raft_consensus.cc:3060] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.222765  7352 raft_consensus.cc:697] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:12.226254  7352 consensus_queue.cc:237] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.228200  7137 raft_consensus.cc:2468] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:12.229228  7175 leader_election.cc:304] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.229863  7335 raft_consensus.cc:2804] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:12.231753  7286 raft_consensus.cc:2468] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:12.236915  7335 raft_consensus.cc:697] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:12.237914  7335 consensus_queue.cc:237] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.240188  7035 catalog_manager.cc:5697] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.253551  7342 consensus_queue.cc:1048] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.260028  7032 catalog_manager.cc:5697] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.307173  7212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
mode: GRACEFUL
new_leader_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:57488
I20260709 13:18:12.307660  7212 raft_consensus.cc:606] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Received request to transfer leadership to TS 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:12.317214  7342 consensus_queue.cc:1048] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.320765  7285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
mode: GRACEFUL
new_leader_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:18:12.321872  7285 raft_consensus.cc:606] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Received request to transfer leadership to TS 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:12.333956  7342 consensus_queue.cc:1048] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.350095  7137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
mode: GRACEFUL
new_leader_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:42622
I20260709 13:18:12.350739  7137 raft_consensus.cc:606] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Received request to transfer leadership to TS 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:12.356313  7137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
mode: GRACEFUL
new_leader_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:42622
I20260709 13:18:12.356942  7137 raft_consensus.cc:606] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Received request to transfer leadership to TS 69f68cad86bb493291b46335b3989eea
I20260709 13:18:12.406533  7361 raft_consensus.cc:493] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.407272  7361 raft_consensus.cc:515] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.410377  7361 leader_election.cc:290] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:12.410669  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:12.410923  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:12.411494  7137 raft_consensus.cc:2393] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69f68cad86bb493291b46335b3989eea in current term 1: Already voted for candidate 9c8319591e9b44beae48a55a48d9ef81 in this term.
I20260709 13:18:12.412619  7249 leader_election.cc:304] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69f68cad86bb493291b46335b3989eea; no voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:12.413280  7361 raft_consensus.cc:3060] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:12.418282  7361 raft_consensus.cc:2749] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:12.489938  7361 consensus_queue.cc:1048] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.496825  7333 raft_consensus.cc:993] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: : Instructing follower 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:12.497407  7333 raft_consensus.cc:1081] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Signalling peer 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:12.497889  7335 consensus_queue.cc:1048] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.500747  7137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:42604
I20260709 13:18:12.501376  7137 raft_consensus.cc:493] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:12.501721  7137 raft_consensus.cc:3060] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.502822  7362 consensus_queue.cc:1048] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.511801  7342 consensus_queue.cc:1048] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.512750  7137 raft_consensus.cc:515] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.514261  7136 raft_consensus.cc:1240] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Rejecting Update request from peer 69f68cad86bb493291b46335b3989eea for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:12.515628  7137 leader_election.cc:290] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.516590  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:12.519953  7361 consensus_queue.cc:1059] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.520860  7362 raft_consensus.cc:3055] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.521482  7362 raft_consensus.cc:740] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:12.522187  7352 consensus_queue.cc:1048] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.522342  7362 consensus_queue.cc:260] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
W20260709 13:18:12.524056  7390 consensus_queue.cc:1175] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9c8319591e9b44beae48a55a48d9ef81" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:18:12.524170  7335 consensus_queue.cc:1048] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.528095  7362 raft_consensus.cc:3060] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.530390  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ed194745d34f309da2d1cc8d3cca29" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.532497  7336 raft_consensus.cc:993] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: : Instructing follower 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:12.532981  7336 raft_consensus.cc:1081] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Signalling peer 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:12.541631  7284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:33526
I20260709 13:18:12.542238  7284 raft_consensus.cc:493] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:12.542593  7284 raft_consensus.cc:3060] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.547899  7335 consensus_queue.cc:1048] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.550805  7284 raft_consensus.cc:515] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.553722  7342 consensus_queue.cc:1048] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:12.551357  7286 raft_consensus.cc:2468] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:12.569406  7103 leader_election.cc:304] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:12.569623  7284 leader_election.cc:290] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:12.570888  7331 raft_consensus.cc:2804] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:12.571518  7331 raft_consensus.cc:697] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:12.572723  7331 consensus_queue.cc:237] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.580343  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:12.581121  7136 raft_consensus.cc:3055] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.582512  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afcd7ee807b64106b29a1f2d9c43cc91" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:12.582584  7136 raft_consensus.cc:740] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:12.584524  7136 consensus_queue.cc:260] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.585894  7136 raft_consensus.cc:3060] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.592732  7136 raft_consensus.cc:2468] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:12.593688  7249 leader_election.cc:304] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:12.594534  7362 raft_consensus.cc:2804] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:12.595033  7362 raft_consensus.cc:697] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:12.595922  7362 consensus_queue.cc:237] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.600379  7032 catalog_manager.cc:5697] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 1 to 2, leader changed from 69f68cad86bb493291b46335b3989eea (127.29.5.131) to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.608444  7034 catalog_manager.cc:5697] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 1 to 2, leader changed from 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129) to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 2 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:12.667387  7335 consensus_queue.cc:1048] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.681507  7335 consensus_queue.cc:1048] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.780284  7331 consensus_queue.cc:1048] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.790983  7331 consensus_queue.cc:1048] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:12.791872  7335 consensus_queue.cc:1048] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.801649  7336 raft_consensus.cc:993] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: : Instructing follower 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:12.802167  7331 raft_consensus.cc:1081] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Signalling peer 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:12.803900  7211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:57462
I20260709 13:18:12.804486  7211 raft_consensus.cc:493] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:12.804850  7211 raft_consensus.cc:3060] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.808274  7352 consensus_queue.cc:1048] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:12.814604  7211 raft_consensus.cc:515] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.817301  7211 leader_election.cc:290] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.817859  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.818511  7284 raft_consensus.cc:3060] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.819119  7352 raft_consensus.cc:993] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: : Instructing follower 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:12.819586  7352 raft_consensus.cc:1081] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Signalling peer 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:12.825802  7137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:18:12.826395  7137 raft_consensus.cc:493] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:12.826489  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc3e56a4ecd4acb86ae504e26a67d5b" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:12.826831  7137 raft_consensus.cc:3060] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.827148  7136 raft_consensus.cc:3055] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.827462  7136 raft_consensus.cc:740] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:12.828112  7284 raft_consensus.cc:2468] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:12.828294  7136 consensus_queue.cc:260] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.829332  7178 leader_election.cc:304] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.829566  7136 raft_consensus.cc:3060] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.830160  7395 raft_consensus.cc:2804] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:12.830668  7395 raft_consensus.cc:697] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:12.831491  7395 consensus_queue.cc:237] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.833981  7137 raft_consensus.cc:515] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.835314  7136 raft_consensus.cc:2468] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:12.836815  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:12.837332  7211 raft_consensus.cc:3055] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:12.837587  7211 raft_consensus.cc:740] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:12.838357  7211 consensus_queue.cc:260] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.838713  7137 leader_election.cc:290] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:12.839445  7211 raft_consensus.cc:3060] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.838850  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a8795c7faa4934af115277e1f67b5f" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:12.840179  7284 raft_consensus.cc:3060] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:12.841050  7032 catalog_manager.cc:5697] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 1 to 2, leader changed from 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129) to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.845074  7211 raft_consensus.cc:2468] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:12.846359  7103 leader_election.cc:304] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:12.846382  7284 raft_consensus.cc:2468] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:12.847232  7331 raft_consensus.cc:2804] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:12.847718  7331 raft_consensus.cc:697] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:12.848543  7331 consensus_queue.cc:237] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:12.856701  7032 catalog_manager.cc:5697] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 1 to 2, leader changed from 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130) to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.117040  7136 raft_consensus.cc:1275] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.117174  7284 raft_consensus.cc:1275] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.117780  7211 raft_consensus.cc:3060] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.118538  7362 consensus_queue.cc:1048] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.125723  7212 raft_consensus.cc:3060] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:13.129143  7211 raft_consensus.cc:1275] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.141525  7331 consensus_queue.cc:1048] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.143622  7331 consensus_queue.cc:1048] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.147630  7212 raft_consensus.cc:1275] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.149361  7333 consensus_queue.cc:1048] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.265527  7136 raft_consensus.cc:1275] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.266842  7397 consensus_queue.cc:1048] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.269479  7284 raft_consensus.cc:1275] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.270859  7379 consensus_queue.cc:1048] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.295076  7284 raft_consensus.cc:1275] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.296316  7331 consensus_queue.cc:1048] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:13.303411  7212 raft_consensus.cc:1275] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:13.305584  7342 consensus_queue.cc:1048] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:14.023350  7066 debug-util.cc:398] Leaking SignalData structure 0x7b080004eae0 after lost signal to thread 29721
W20260709 13:18:14.024551  7066 debug-util.cc:398] Leaking SignalData structure 0x7b08000919a0 after lost signal to thread 7069
W20260709 13:18:14.025772  7066 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbfc0 after lost signal to thread 7161
W20260709 13:18:14.026829  7066 debug-util.cc:398] Leaking SignalData structure 0x7b080020a9c0 after lost signal to thread 7236
W20260709 13:18:14.027849  7066 debug-util.cc:398] Leaking SignalData structure 0x7b0800214ee0 after lost signal to thread 7310
I20260709 13:18:15.415284  7032 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46028:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:15.420099  7032 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:15.493245  7123 tablet_service.cc:1511] Processing CreateTablet for tablet ecb1c877d3434a9897db2736a9f0af83 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:15.494328  7198 tablet_service.cc:1511] Processing CreateTablet for tablet ecb1c877d3434a9897db2736a9f0af83 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:15.496276  7198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb1c877d3434a9897db2736a9f0af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.497728  7121 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd21f4e54184e77be77728a9ed31a0f (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:15.499401  7123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb1c877d3434a9897db2736a9f0af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.506714  7119 tablet_service.cc:1511] Processing CreateTablet for tablet 79bddb40906e4f498204786bffc5b8f5 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:15.506735  7272 tablet_service.cc:1511] Processing CreateTablet for tablet ecb1c877d3434a9897db2736a9f0af83 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:15.508985  7200 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd21f4e54184e77be77728a9ed31a0f (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:15.510540  7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb1c877d3434a9897db2736a9f0af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.510596  7200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd21f4e54184e77be77728a9ed31a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.502084  7120 tablet_service.cc:1511] Processing CreateTablet for tablet 8551cfdd46f546f197051de4d69497db (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:15.513074  7119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bddb40906e4f498204786bffc5b8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.516534  7120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8551cfdd46f546f197051de4d69497db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.518105  7269 tablet_service.cc:1511] Processing CreateTablet for tablet 4dd21f4e54184e77be77728a9ed31a0f (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:15.522672  7122 tablet_service.cc:1511] Processing CreateTablet for tablet cebe7b62f1924489966eaccede09e2d2 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:15.523238  7195 tablet_service.cc:1511] Processing CreateTablet for tablet 8551cfdd46f546f197051de4d69497db (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:15.524875  7195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8551cfdd46f546f197051de4d69497db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.525178  7126 tablet_service.cc:1511] Processing CreateTablet for tablet a27a9fe4e5054465b3d8e6a4eb7aeb00 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:15.526667  7126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27a9fe4e5054465b3d8e6a4eb7aeb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.529620  7124 tablet_service.cc:1511] Processing CreateTablet for tablet 1c14626d867343a1b01213db19f6c8eb (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:15.531095  7124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c14626d867343a1b01213db19f6c8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.532339  7122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebe7b62f1924489966eaccede09e2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.532927  7271 tablet_service.cc:1511] Processing CreateTablet for tablet 8551cfdd46f546f197051de4d69497db (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:15.537139  7270 tablet_service.cc:1511] Processing CreateTablet for tablet 79bddb40906e4f498204786bffc5b8f5 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:15.540155  7121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd21f4e54184e77be77728a9ed31a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.541268  7194 tablet_service.cc:1511] Processing CreateTablet for tablet 79bddb40906e4f498204786bffc5b8f5 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:15.542768  7194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bddb40906e4f498204786bffc5b8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.545174  7199 tablet_service.cc:1511] Processing CreateTablet for tablet cebe7b62f1924489966eaccede09e2d2 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:15.546736  7199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebe7b62f1924489966eaccede09e2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.549741  7125 tablet_service.cc:1511] Processing CreateTablet for tablet 291d49453b634a1682caf20c4c660850 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:15.551357  7125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291d49453b634a1682caf20c4c660850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.551684  7268 tablet_service.cc:1511] Processing CreateTablet for tablet a27a9fe4e5054465b3d8e6a4eb7aeb00 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:15.553872  7273 tablet_service.cc:1511] Processing CreateTablet for tablet 1c14626d867343a1b01213db19f6c8eb (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:15.549820  7274 tablet_service.cc:1511] Processing CreateTablet for tablet cebe7b62f1924489966eaccede09e2d2 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:15.553634  7127 tablet_service.cc:1511] Processing CreateTablet for tablet 3c1e9d0612a04dd9874db0a914538d76 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:15.560238  7127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c1e9d0612a04dd9874db0a914538d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.560348  7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd21f4e54184e77be77728a9ed31a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.570798  7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c14626d867343a1b01213db19f6c8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.572369  7197 tablet_service.cc:1511] Processing CreateTablet for tablet a27a9fe4e5054465b3d8e6a4eb7aeb00 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:15.574034  7197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27a9fe4e5054465b3d8e6a4eb7aeb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.572444  7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cebe7b62f1924489966eaccede09e2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.576938  7268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27a9fe4e5054465b3d8e6a4eb7aeb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.577860  7271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8551cfdd46f546f197051de4d69497db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.582089  7196 tablet_service.cc:1511] Processing CreateTablet for tablet 1c14626d867343a1b01213db19f6c8eb (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:15.582402  7201 tablet_service.cc:1511] Processing CreateTablet for tablet 291d49453b634a1682caf20c4c660850 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:15.584138  7270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bddb40906e4f498204786bffc5b8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.585055  7196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c14626d867343a1b01213db19f6c8eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.587535  7201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291d49453b634a1682caf20c4c660850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.598505  7202 tablet_service.cc:1511] Processing CreateTablet for tablet 3c1e9d0612a04dd9874db0a914538d76 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:15.600462  7202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c1e9d0612a04dd9874db0a914538d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.602089  7275 tablet_service.cc:1511] Processing CreateTablet for tablet 291d49453b634a1682caf20c4c660850 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:15.603735  7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291d49453b634a1682caf20c4c660850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.605209  7276 tablet_service.cc:1511] Processing CreateTablet for tablet 3c1e9d0612a04dd9874db0a914538d76 (DEFAULT_TABLE table=soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:15.609891  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c1e9d0612a04dd9874db0a914538d76. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:15.618392  7103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.130:33239, user_credentials={real_user=slave}} blocked reactor thread for 50698.3us
I20260709 13:18:15.682303  7427 tablet_bootstrap.cc:492] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
W20260709 13:18:15.696759  7103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:39211, user_credentials={real_user=slave}} blocked reactor thread for 71094.2us
I20260709 13:18:15.745767  7425 tablet_bootstrap.cc:492] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:15.750893  7427 tablet_bootstrap.cc:654] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.768438  7428 tablet_bootstrap.cc:492] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:15.780335  7425 tablet_bootstrap.cc:654] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.780566  7428 tablet_bootstrap.cc:654] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.783057  7427 tablet_bootstrap.cc:492] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:15.783686  7427 ts_tablet_manager.cc:1403] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.008s
I20260709 13:18:15.788196  7427 raft_consensus.cc:359] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.789422  7427 raft_consensus.cc:385] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.789882  7427 raft_consensus.cc:740] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.790938  7427 consensus_queue.cc:260] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.794092  7427 ts_tablet_manager.cc:1434] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:15.794406  7428 tablet_bootstrap.cc:492] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:15.795023  7428 ts_tablet_manager.cc:1403] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.009s
I20260709 13:18:15.795384  7427 tablet_bootstrap.cc:492] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:15.803375  7427 tablet_bootstrap.cc:654] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.803294  7428 raft_consensus.cc:359] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.804304  7428 raft_consensus.cc:385] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.804716  7428 raft_consensus.cc:740] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.805671  7428 consensus_queue.cc:260] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.810746  7428 ts_tablet_manager.cc:1434] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 13:18:15.812090  7428 tablet_bootstrap.cc:492] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:15.812229  7397 raft_consensus.cc:493] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.812789  7397 raft_consensus.cc:515] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.816486  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
W20260709 13:18:15.818562  7178 leader_election.cc:343] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.816440  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:15.820114  7428 tablet_bootstrap.cc:654] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:15.821552  7175 leader_election.cc:343] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.822048  7175 leader_election.cc:304] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c8319591e9b44beae48a55a48d9ef81; no voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea
I20260709 13:18:15.822166  7425 tablet_bootstrap.cc:492] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:15.823403  7425 ts_tablet_manager.cc:1403] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.017s
I20260709 13:18:15.824709  7397 leader_election.cc:290] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:15.826434  7397 raft_consensus.cc:2749] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:15.832171  7425 raft_consensus.cc:359] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.833335  7425 raft_consensus.cc:385] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.833701  7425 raft_consensus.cc:740] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.834666  7425 consensus_queue.cc:260] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.858916  7427 tablet_bootstrap.cc:492] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:15.859630  7427 ts_tablet_manager.cc:1403] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.030s
I20260709 13:18:15.860369  7425 ts_tablet_manager.cc:1434] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.037s	user 0.012s	sys 0.006s
I20260709 13:18:15.863124  7427 raft_consensus.cc:359] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.864004  7427 raft_consensus.cc:385] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.864316  7427 raft_consensus.cc:740] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.865293  7427 consensus_queue.cc:260] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.865788  7425 tablet_bootstrap.cc:492] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:15.868147  7427 ts_tablet_manager.cc:1434] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:15.869395  7427 tablet_bootstrap.cc:492] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:15.874913  7428 tablet_bootstrap.cc:492] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:15.875717  7428 ts_tablet_manager.cc:1403] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.000s
I20260709 13:18:15.876627  7427 tablet_bootstrap.cc:654] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.882746  7428 raft_consensus.cc:359] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.883684  7428 raft_consensus.cc:385] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.884001  7428 raft_consensus.cc:740] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.884725  7428 consensus_queue.cc:260] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.885159  7426 raft_consensus.cc:493] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.885897  7426 raft_consensus.cc:515] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
W20260709 13:18:15.898229  7083 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:15.952461  7428 ts_tablet_manager.cc:1434] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.001s
I20260709 13:18:15.954090  7428 tablet_bootstrap.cc:492] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:15.959740  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:15.964233  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:15.970515  7427 tablet_bootstrap.cc:492] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:15.971082  7427 ts_tablet_manager.cc:1403] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.019s
W20260709 13:18:15.972676  7103 leader_election.cc:343] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.965456  7425 tablet_bootstrap.cc:654] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.973994  7427 raft_consensus.cc:359] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.974927  7427 raft_consensus.cc:385] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:15.973480  7103 leader_election.cc:343] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:15.975239  7427 raft_consensus.cc:740] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.958165  7426 leader_election.cc:290] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:15.975593  7103 leader_election.cc:304] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251; no voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:15.976186  7427 consensus_queue.cc:260] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.977075  7426 raft_consensus.cc:2749] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:15.979328  7428 tablet_bootstrap.cc:654] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.991460  7428 tablet_bootstrap.cc:492] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:15.991874  7427 ts_tablet_manager.cc:1434] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:18:15.992027  7428 ts_tablet_manager.cc:1403] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
I20260709 13:18:15.995730  7428 raft_consensus.cc:359] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:15.996716  7428 raft_consensus.cc:385] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.997038  7428 raft_consensus.cc:740] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.997768  7428 consensus_queue.cc:260] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.004948  7427 tablet_bootstrap.cc:492] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:16.007829  7428 ts_tablet_manager.cc:1434] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:18:16.015122  7427 tablet_bootstrap.cc:654] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.016642  7428 tablet_bootstrap.cc:492] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:16.018759  7425 tablet_bootstrap.cc:492] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.019381  7425 ts_tablet_manager.cc:1403] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.024s
I20260709 13:18:16.024467  7428 tablet_bootstrap.cc:654] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.023667  7425 raft_consensus.cc:359] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.027617  7425 raft_consensus.cc:385] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.027971  7425 raft_consensus.cc:740] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.028769  7425 consensus_queue.cc:260] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.031304  7425 ts_tablet_manager.cc:1434] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:18:16.032866  7425 tablet_bootstrap.cc:492] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.034472  7427 tablet_bootstrap.cc:492] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:16.035063  7427 ts_tablet_manager.cc:1403] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.010s
I20260709 13:18:16.038395  7427 raft_consensus.cc:359] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.039162  7427 raft_consensus.cc:385] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.039482  7427 raft_consensus.cc:740] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.040731  7425 tablet_bootstrap.cc:654] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.040437  7427 consensus_queue.cc:260] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.043308  7427 ts_tablet_manager.cc:1434] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:18:16.044409  7427 tablet_bootstrap.cc:492] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:16.053326  7427 tablet_bootstrap.cc:654] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.056754  7433 raft_consensus.cc:493] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.057337  7433 raft_consensus.cc:515] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.058391  7425 tablet_bootstrap.cc:492] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.058981  7425 ts_tablet_manager.cc:1403] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.010s
I20260709 13:18:16.058995  7428 tablet_bootstrap.cc:492] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:16.059664  7428 ts_tablet_manager.cc:1403] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.001s
I20260709 13:18:16.061522  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:16.062419  7425 raft_consensus.cc:359] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.062793  7428 raft_consensus.cc:359] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
W20260709 13:18:16.063113  7178 leader_election.cc:343] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.063635  7428 raft_consensus.cc:385] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.063988  7428 raft_consensus.cc:740] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.064661  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.064738  7428 consensus_queue.cc:260] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.065448  7136 raft_consensus.cc:2468] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:16.066872  7175 leader_election.cc:304] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 69f68cad86bb493291b46335b3989eea
I20260709 13:18:16.067276  7428 ts_tablet_manager.cc:1434] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:16.059561  7433 leader_election.cc:290] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.067839  7434 raft_consensus.cc:2804] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.068310  7428 tablet_bootstrap.cc:492] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:16.068426  7434 raft_consensus.cc:493] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.068907  7434 raft_consensus.cc:3060] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.063210  7425 raft_consensus.cc:385] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.073943  7425 raft_consensus.cc:740] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.075090  7425 consensus_queue.cc:260] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.077845  7425 ts_tablet_manager.cc:1434] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:18:16.079712  7425 tablet_bootstrap.cc:492] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.087071  7425 tablet_bootstrap.cc:654] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.088933  7428 tablet_bootstrap.cc:654] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.092557  7434 raft_consensus.cc:515] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.095813  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.096655  7136 raft_consensus.cc:3060] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.100342  7425 tablet_bootstrap.cc:492] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.101243  7425 ts_tablet_manager.cc:1403] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:18:16.105557  7425 raft_consensus.cc:359] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.106746  7425 raft_consensus.cc:385] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.107283  7425 raft_consensus.cc:740] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.108335  7425 consensus_queue.cc:260] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.111404  7425 ts_tablet_manager.cc:1434] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:16.112217  7136 raft_consensus.cc:2468] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:16.112783  7425 tablet_bootstrap.cc:492] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.113822  7175 leader_election.cc:304] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.114846  7433 raft_consensus.cc:2804] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.115355  7433 raft_consensus.cc:697] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:16.116307  7433 consensus_queue.cc:237] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.121802  7425 tablet_bootstrap.cc:654] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.123358  7427 tablet_bootstrap.cc:492] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:16.126631  7427 ts_tablet_manager.cc:1403] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.001s
I20260709 13:18:16.129899  7427 raft_consensus.cc:359] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.130659  7427 raft_consensus.cc:385] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.130959  7427 raft_consensus.cc:740] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.137701  7425 tablet_bootstrap.cc:492] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.138546  7425 ts_tablet_manager.cc:1403] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.001s
I20260709 13:18:16.141584  7035 catalog_manager.cc:5697] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.148092  7426 raft_consensus.cc:493] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.149011  7426 raft_consensus.cc:515] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.149948  7434 leader_election.cc:290] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.152985  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.153775  7427 consensus_queue.cc:260] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
W20260709 13:18:16.154455  7178 leader_election.cc:343] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.154873  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
W20260709 13:18:16.156520  7103 leader_election.cc:343] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.157037  7428 tablet_bootstrap.cc:492] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:16.157125  7427 ts_tablet_manager.cc:1434] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:18:16.158147  7426 leader_election.cc:290] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.158643  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:16.157701  7428 ts_tablet_manager.cc:1403] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.031s
W20260709 13:18:16.160015  7103 leader_election.cc:343] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.160506  7103 leader_election.cc:304] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251; no voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.161635  7426 raft_consensus.cc:2749] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.158766  7427 tablet_bootstrap.cc:492] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:16.163535  7428 raft_consensus.cc:359] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.164362  7428 raft_consensus.cc:385] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.164702  7428 raft_consensus.cc:740] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.159614  7425 raft_consensus.cc:359] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.166375  7425 raft_consensus.cc:385] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.166674  7425 raft_consensus.cc:740] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.167421  7425 consensus_queue.cc:260] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.169873  7425 ts_tablet_manager.cc:1434] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:18:16.165527  7428 consensus_queue.cc:260] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.172817  7428 ts_tablet_manager.cc:1434] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:18:16.173990  7425 tablet_bootstrap.cc:492] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.174022  7428 tablet_bootstrap.cc:492] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:16.180992  7425 tablet_bootstrap.cc:654] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.181674  7428 tablet_bootstrap.cc:654] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.185777  7427 tablet_bootstrap.cc:654] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.186828  7437 raft_consensus.cc:493] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.187340  7437 raft_consensus.cc:515] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.189610  7437 leader_election.cc:290] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.190490  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.191470  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
W20260709 13:18:16.192185  7249 leader_election.cc:343] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.192203  7211 raft_consensus.cc:2468] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.194007  7252 leader_election.cc:304] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:16.202435  7425 tablet_bootstrap.cc:492] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.203148  7425 ts_tablet_manager.cc:1403] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 13:18:16.207310  7425 raft_consensus.cc:359] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.208370  7425 raft_consensus.cc:385] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.208724  7425 raft_consensus.cc:740] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.211196  7425 consensus_queue.cc:260] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.212785  7436 raft_consensus.cc:2804] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.213146  7436 raft_consensus.cc:493] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.213439  7436 raft_consensus.cc:3060] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.229769  7436 raft_consensus.cc:515] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.234648  7428 tablet_bootstrap.cc:492] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:16.235258  7428 ts_tablet_manager.cc:1403] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.019s
I20260709 13:18:16.236271  7427 tablet_bootstrap.cc:492] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:16.236836  7427 ts_tablet_manager.cc:1403] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.005s
I20260709 13:18:16.238338  7428 raft_consensus.cc:359] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.239101  7428 raft_consensus.cc:385] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.239398  7428 raft_consensus.cc:740] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.240288  7437 raft_consensus.cc:493] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.240293  7428 consensus_queue.cc:260] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.242298  7425 ts_tablet_manager.cc:1434] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:18:16.243216  7428 ts_tablet_manager.cc:1434] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:18:16.243399  7425 tablet_bootstrap.cc:492] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.244299  7428 tablet_bootstrap.cc:492] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:16.247483  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
W20260709 13:18:16.249086  7249 leader_election.cc:343] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.241150  7437 raft_consensus.cc:515] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.251300  7428 tablet_bootstrap.cc:654] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.253021  7437 leader_election.cc:290] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.253268  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.253971  7211 raft_consensus.cc:2468] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.255565  7252 leader_election.cc:304] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.252808  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.257412  7136 raft_consensus.cc:2468] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.261248  7437 raft_consensus.cc:2804] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.261650  7437 raft_consensus.cc:493] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.261987  7437 raft_consensus.cc:3060] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.263863  7456 raft_consensus.cc:493] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.264381  7456 raft_consensus.cc:515] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.267050  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.267643  7136 raft_consensus.cc:2468] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.268698  7249 leader_election.cc:304] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:16.240144  7427 raft_consensus.cc:359] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.270735  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.271051  7427 raft_consensus.cc:385] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.271559  7427 raft_consensus.cc:740] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.271587  7211 raft_consensus.cc:3060] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.272677  7427 consensus_queue.cc:260] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.275585  7428 tablet_bootstrap.cc:492] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:16.275645  7427 ts_tablet_manager.cc:1434] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:18:16.276170  7428 ts_tablet_manager.cc:1403] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.009s
I20260709 13:18:16.282117  7436 leader_election.cc:290] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.282775  7436 raft_consensus.cc:2804] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.283155  7436 raft_consensus.cc:493] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.283300  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.279367  7428 raft_consensus.cc:359] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.283557  7436 raft_consensus.cc:3060] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.285076  7456 leader_election.cc:290] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.285655  7428 raft_consensus.cc:385] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.284096  7212 raft_consensus.cc:2468] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.288823  7428 raft_consensus.cc:740] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.289692  7428 consensus_queue.cc:260] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.293704  7428 ts_tablet_manager.cc:1434] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:18:16.295907  7211 raft_consensus.cc:2468] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.295961  7428 tablet_bootstrap.cc:492] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:16.300451  7252 leader_election.cc:304] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:16.301229  7425 tablet_bootstrap.cc:654] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.308158  7437 raft_consensus.cc:515] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.308444  7436 raft_consensus.cc:515] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.310384  7437 leader_election.cc:290] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.310961  7437 raft_consensus.cc:2804] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.288503  7427 tablet_bootstrap.cc:492] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:16.311703  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.312456  7428 tablet_bootstrap.cc:654] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.312341  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.312893  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.313064  7211 raft_consensus.cc:3060] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.313524  7137 raft_consensus.cc:3060] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.312368  7136 raft_consensus.cc:3060] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.311524  7437 raft_consensus.cc:697] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.317020  7437 consensus_queue.cc:237] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.321838  7436 leader_election.cc:290] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.323699  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.324595  7212 raft_consensus.cc:3060] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.325273  7136 raft_consensus.cc:2468] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.328296  7249 leader_election.cc:304] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:16.332890  7211 raft_consensus.cc:2468] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.334442  7252 leader_election.cc:304] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.335481  7427 tablet_bootstrap.cc:654] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.337658  7428 tablet_bootstrap.cc:492] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:16.338227  7428 ts_tablet_manager.cc:1403] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 13:18:16.340377  7212 raft_consensus.cc:2468] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.340459  7436 raft_consensus.cc:2804] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.341135  7425 tablet_bootstrap.cc:492] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.341331  7436 raft_consensus.cc:697] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.341607  7428 raft_consensus.cc:359] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.342490  7428 raft_consensus.cc:385] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.342268  7436 consensus_queue.cc:237] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.342893  7428 raft_consensus.cc:740] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.342196  7457 raft_consensus.cc:2804] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.344026  7457 raft_consensus.cc:697] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.344071  7428 consensus_queue.cc:260] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.345052  7457 consensus_queue.cc:237] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.342893  7137 raft_consensus.cc:2468] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.352077  7428 ts_tablet_manager.cc:1434] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:16.353122  7428 tablet_bootstrap.cc:492] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: Bootstrap starting.
I20260709 13:18:16.341688  7425 ts_tablet_manager.cc:1403] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.007s
I20260709 13:18:16.358455  7425 raft_consensus.cc:359] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.360093  7425 raft_consensus.cc:385] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.360628  7425 raft_consensus.cc:740] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.361460  7425 consensus_queue.cc:260] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.363938  7425 ts_tablet_manager.cc:1434] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:18:16.364854  7425 tablet_bootstrap.cc:492] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.371085  7428 tablet_bootstrap.cc:654] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.372056  7436 raft_consensus.cc:493] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.372568  7436 raft_consensus.cc:515] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.374665  7427 tablet_bootstrap.cc:492] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:16.374784  7436 leader_election.cc:290] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.375312  7427 ts_tablet_manager.cc:1403] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.016s
I20260709 13:18:16.375336  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.375849  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.376197  7136 raft_consensus.cc:2468] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
W20260709 13:18:16.377182  7252 leader_election.cc:343] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.377611  7426 raft_consensus.cc:493] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.377858  7249 leader_election.cc:304] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.378149  7426 raft_consensus.cc:515] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.379065  7436 raft_consensus.cc:2804] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.379472  7436 raft_consensus.cc:493] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.379851  7436 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.380534  7426 leader_election.cc:290] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.382483  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
W20260709 13:18:16.384089  7103 leader_election.cc:343] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.385413  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
W20260709 13:18:16.386925  7103 leader_election.cc:343] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.387377  7103 leader_election.cc:304] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251; no voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.388613  7426 raft_consensus.cc:2749] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.388741  7436 raft_consensus.cc:515] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.387737  7427 raft_consensus.cc:359] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.393301  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.398156  7436 leader_election.cc:290] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.399236  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.400228  7136 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.400650  7425 tablet_bootstrap.cc:654] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:16.401573  7252 leader_election.cc:343] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.406586  7428 tablet_bootstrap.cc:492] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: No bootstrap required, opened a new log
I20260709 13:18:16.407104  7428 ts_tablet_manager.cc:1403] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.015s
I20260709 13:18:16.408021  7427 raft_consensus.cc:385] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.407545  7034 catalog_manager.cc:5697] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 1 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.408370  7427 raft_consensus.cc:740] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.409197  7427 consensus_queue.cc:260] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.410025  7428 raft_consensus.cc:359] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.410737  7428 raft_consensus.cc:385] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.410161  7034 catalog_manager.cc:5697] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 1 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.411005  7428 raft_consensus.cc:740] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.411689  7427 ts_tablet_manager.cc:1434] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:18:16.411865  7034 catalog_manager.cc:5697] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 1 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.412806  7427 tablet_bootstrap.cc:492] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:16.422196  7427 tablet_bootstrap.cc:654] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.409138  7136 raft_consensus.cc:2468] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.413631  7425 tablet_bootstrap.cc:492] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.425469  7425 ts_tablet_manager.cc:1403] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 13:18:16.425314  7249 leader_election.cc:304] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.426692  7436 raft_consensus.cc:2804] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.427170  7436 raft_consensus.cc:697] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.427682  7427 tablet_bootstrap.cc:492] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:16.428154  7427 ts_tablet_manager.cc:1403] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 13:18:16.428042  7436 consensus_queue.cc:237] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.431066  7434 raft_consensus.cc:493] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.431380  7433 raft_consensus.cc:493] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.431506  7434 raft_consensus.cc:515] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.431707  7425 raft_consensus.cc:359] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.432370  7425 raft_consensus.cc:385] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.432006  7433 raft_consensus.cc:515] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.432634  7425 raft_consensus.cc:740] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.433779  7434 leader_election.cc:290] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.433727  7425 consensus_queue.cc:260] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.434103  7433 leader_election.cc:290] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.436120  7425 ts_tablet_manager.cc:1434] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:16.437076  7425 tablet_bootstrap.cc:492] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: Bootstrap starting.
I20260709 13:18:16.436880  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.437660  7137 raft_consensus.cc:2468] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:16.437724  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:16.411736  7428 consensus_queue.cc:260] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.438408  7286 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:16.439651  7175 leader_election.cc:304] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.436905  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.443473  7136 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 0.
I20260709 13:18:16.443939  7433 raft_consensus.cc:2804] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.444383  7433 raft_consensus.cc:493] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.439951  7428 ts_tablet_manager.cc:1434] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.005s
I20260709 13:18:16.440943  7178 leader_election.cc:304] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.444749  7433 raft_consensus.cc:3060] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.441689  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:16.446024  7434 raft_consensus.cc:2804] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.446437  7434 raft_consensus.cc:493] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.446908  7434 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:16.448179  7178 leader_election.cc:343] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.446436  7427 raft_consensus.cc:359] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.455794  7427 raft_consensus.cc:385] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.456645  7427 raft_consensus.cc:740] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.458387  7427 consensus_queue.cc:260] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.461278  7425 tablet_bootstrap.cc:654] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.463148  7427 ts_tablet_manager.cc:1434] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:18:16.464468  7427 tablet_bootstrap.cc:492] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: Bootstrap starting.
I20260709 13:18:16.454495  7434 raft_consensus.cc:515] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.472411  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.473012  7136 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.482116  7433 raft_consensus.cc:515] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.493065  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.493795  7137 raft_consensus.cc:3060] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.495386  7434 leader_election.cc:290] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.496075  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.503654  7433 leader_election.cc:290] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.504073  7286 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.504060  7136 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:16.505586  7175 leader_election.cc:304] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.506070  7426 raft_consensus.cc:493] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.501147  7137 raft_consensus.cc:2468] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:16.506542  7433 raft_consensus.cc:2804] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.503140  7427 tablet_bootstrap.cc:654] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.506640  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.508347  7175 leader_election.cc:304] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.506600  7426 raft_consensus.cc:515] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
W20260709 13:18:16.508978  7178 leader_election.cc:343] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.509752  7397 raft_consensus.cc:2804] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.510279  7397 raft_consensus.cc:697] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:16.511011  7426 leader_election.cc:290] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.511142  7397 consensus_queue.cc:237] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.509251  7433 raft_consensus.cc:697] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:16.513015  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:16.513720  7284 raft_consensus.cc:2468] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:16.513644  7433 consensus_queue.cc:237] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.514849  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.515137  7103 leader_election.cc:304] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:16.515517  7212 raft_consensus.cc:2468] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 0.
I20260709 13:18:16.516177  7426 raft_consensus.cc:2804] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.516592  7426 raft_consensus.cc:493] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.516952  7426 raft_consensus.cc:3060] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.505527  7032 catalog_manager.cc:5697] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 1 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.522336  7425 tablet_bootstrap.cc:492] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: No bootstrap required, opened a new log
I20260709 13:18:16.515185  7286 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 1.
I20260709 13:18:16.522900  7425 ts_tablet_manager.cc:1403] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.019s
I20260709 13:18:16.526953  7425 raft_consensus.cc:359] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.527834  7425 raft_consensus.cc:385] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.528190  7425 raft_consensus.cc:740] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.528991  7425 consensus_queue.cc:260] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.530974  7425 ts_tablet_manager.cc:1434] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:16.535907  7426 raft_consensus.cc:515] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.539098  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.539755  7212 raft_consensus.cc:3060] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.547508  7212 raft_consensus.cc:2468] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:16.547186  7032 catalog_manager.cc:5697] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.548806  7103 leader_election.cc:304] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.549765  7427 tablet_bootstrap.cc:492] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: No bootstrap required, opened a new log
I20260709 13:18:16.550299  7427 ts_tablet_manager.cc:1403] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.001s
I20260709 13:18:16.553418  7427 raft_consensus.cc:359] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.554065  7427 raft_consensus.cc:385] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.554347  7427 raft_consensus.cc:740] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.555006  7427 consensus_queue.cc:260] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.557075  7427 ts_tablet_manager.cc:1434] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:18:16.558198  7426 leader_election.cc:290] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 1 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.558797  7426 raft_consensus.cc:2804] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.559207  7426 raft_consensus.cc:697] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:16.559960  7426 consensus_queue.cc:237] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.566018  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.566848  7286 raft_consensus.cc:3060] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.567485  7032 catalog_manager.cc:5697] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.575541  7286 raft_consensus.cc:2468] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 1.
I20260709 13:18:16.576661  7436 raft_consensus.cc:493] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.577409  7436 raft_consensus.cc:515] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.580840  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.581538  7212 raft_consensus.cc:2468] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.582734  7252 leader_election.cc:304] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.583114  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.583917  7437 raft_consensus.cc:2804] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.584384  7437 raft_consensus.cc:493] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.584697  7437 raft_consensus.cc:3060] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.583999  7137 raft_consensus.cc:2468] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 0.
I20260709 13:18:16.583945  7457 raft_consensus.cc:493] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.589166  7457 raft_consensus.cc:515] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.591282  7457 leader_election.cc:290] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.592501  7437 raft_consensus.cc:515] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.592824  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.593505  7034 catalog_manager.cc:5697] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 1 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.595082  7437 leader_election.cc:290] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.595280  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.595916  7136 raft_consensus.cc:3060] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.596251  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c14626d867343a1b01213db19f6c8eb" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.597035  7137 raft_consensus.cc:2393] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69f68cad86bb493291b46335b3989eea in current term 1: Already voted for candidate 9c8319591e9b44beae48a55a48d9ef81 in this term.
I20260709 13:18:16.597703  7436 leader_election.cc:290] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.600194  7249 leader_election.cc:304] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69f68cad86bb493291b46335b3989eea; no voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.601367  7436 raft_consensus.cc:3060] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.602989  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.604826  7212 raft_consensus.cc:3060] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.608475  7436 raft_consensus.cc:2749] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.609647  7136 raft_consensus.cc:2468] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.611052  7249 leader_election.cc:304] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:16.611670  7212 raft_consensus.cc:2468] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 1.
I20260709 13:18:16.612007  7436 raft_consensus.cc:2804] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.612830  7436 raft_consensus.cc:697] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.613646  7436 consensus_queue.cc:237] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.621757  7034 catalog_manager.cc:5697] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 1 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.672574  7433 consensus_queue.cc:1048] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:16.674729  7433 consensus_queue.cc:1048] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.707360  7212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
mode: GRACEFUL
new_leader_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:57488
I20260709 13:18:16.708204  7212 raft_consensus.cc:606] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Received request to transfer leadership to TS 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:16.714649  7436 consensus_queue.cc:1048] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.715076  7284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
mode: GRACEFUL
new_leader_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:18:16.715945  7284 raft_consensus.cc:606] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Received request to transfer leadership to TS 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:16.723697  7210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8551cfdd46f546f197051de4d69497db"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
mode: GRACEFUL
new_leader_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:57488
I20260709 13:18:16.724436  7210 raft_consensus.cc:606] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Received request to transfer leadership to TS 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:16.733896  7284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
mode: GRACEFUL
new_leader_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:18:16.734560  7284 raft_consensus.cc:606] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Received request to transfer leadership to TS 16f325bf8ca844cd9dc056daecf0e251
I20260709 13:18:16.741079  7136 raft_consensus.cc:3060] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.743069  7284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
mode: GRACEFUL
new_leader_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:18:16.743793  7284 raft_consensus.cc:606] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Received request to transfer leadership to TS 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.750196  7284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
mode: GRACEFUL
new_leader_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:18:16.750800  7284 raft_consensus.cc:606] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Received request to transfer leadership to TS 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.751818  7437 consensus_queue.cc:1048] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.761322  7284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "291d49453b634a1682caf20c4c660850"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
mode: GRACEFUL
new_leader_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:33538
I20260709 13:18:16.761984  7284 raft_consensus.cc:606] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Received request to transfer leadership to TS 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.763516  7437 consensus_queue.cc:1048] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.766112  7437 raft_consensus.cc:993] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: : Instructing follower 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:16.766712  7457 raft_consensus.cc:1081] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Signalling peer 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:16.772243  7212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:57474
I20260709 13:18:16.776815  7137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
mode: GRACEFUL
new_leader_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:42622
I20260709 13:18:16.777742  7137 raft_consensus.cc:606] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Received request to transfer leadership to TS 69f68cad86bb493291b46335b3989eea
I20260709 13:18:16.782783  7457 consensus_queue.cc:1048] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:16.773191  7212 raft_consensus.cc:493] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.788604  7212 raft_consensus.cc:3060] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.799507  7212 raft_consensus.cc:515] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.805517  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:16.806095  7136 raft_consensus.cc:3060] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.806365  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27a9fe4e5054465b3d8e6a4eb7aeb00" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.807034  7284 raft_consensus.cc:3055] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:16.807339  7284 raft_consensus.cc:740] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.808195  7284 consensus_queue.cc:260] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.809032  7284 raft_consensus.cc:3060] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.813618  7457 raft_consensus.cc:993] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: : Instructing follower 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:16.813822  7212 leader_election.cc:290] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.815243  7457 raft_consensus.cc:1081] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Signalling peer 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:16.815743  7284 raft_consensus.cc:2468] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:16.816987  7178 leader_election.cc:304] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:16.817827  7434 raft_consensus.cc:2804] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.818292  7434 raft_consensus.cc:697] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:16.819133  7434 consensus_queue.cc:237] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.824324  7136 raft_consensus.cc:2468] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:16.830457  7437 consensus_queue.cc:1048] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.835289  7436 consensus_queue.cc:1048] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.836999  7136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:42604
I20260709 13:18:16.837618  7136 raft_consensus.cc:493] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.838939  7136 raft_consensus.cc:3060] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.841048  7034 catalog_manager.cc:5697] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 1 to 2, leader changed from 69f68cad86bb493291b46335b3989eea (127.29.5.131) to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.846630  7136 raft_consensus.cc:515] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.849932  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.853325  7436 raft_consensus.cc:493] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.853925  7436 raft_consensus.cc:515] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.856194  7436 leader_election.cc:290] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:16.858157  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c8319591e9b44beae48a55a48d9ef81" is_pre_election: true
I20260709 13:18:16.859355  7137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.859601  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dd21f4e54184e77be77728a9ed31a0f" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.860301  7284 raft_consensus.cc:3055] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:16.860443  7137 raft_consensus.cc:2393] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69f68cad86bb493291b46335b3989eea in current term 1: Already voted for candidate 9c8319591e9b44beae48a55a48d9ef81 in this term.
I20260709 13:18:16.860693  7284 raft_consensus.cc:740] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.861688  7284 consensus_queue.cc:260] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.862625  7284 raft_consensus.cc:3060] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.864193  7252 leader_election.cc:304] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69f68cad86bb493291b46335b3989eea; no voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.865505  7436 raft_consensus.cc:3060] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.885914  7437 raft_consensus.cc:993] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: : Instructing follower 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:16.886487  7437 raft_consensus.cc:1081] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Signalling peer 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:16.888738  7135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:42604
I20260709 13:18:16.889520  7135 raft_consensus.cc:493] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.889977  7135 raft_consensus.cc:3060] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.890957  7136 leader_election.cc:290] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.893749  7436 raft_consensus.cc:2749] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.901980  7284 raft_consensus.cc:2468] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:16.899617  7135 raft_consensus.cc:515] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.904482  7103 leader_election.cc:304] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 9c8319591e9b44beae48a55a48d9ef81
I20260709 13:18:16.905805  7135 leader_election.cc:290] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.906461  7426 raft_consensus.cc:2804] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.907032  7426 raft_consensus.cc:697] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:16.907888  7426 consensus_queue.cc:237] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.910701  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:16.911378  7211 raft_consensus.cc:3060] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.916898  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bddb40906e4f498204786bffc5b8f5" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:16.917733  7284 raft_consensus.cc:3055] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:16.918102  7284 raft_consensus.cc:740] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:16.918939  7284 consensus_queue.cc:260] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.920359  7284 raft_consensus.cc:3060] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:16.921131  7434 raft_consensus.cc:493] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.921653  7434 raft_consensus.cc:515] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.923753  7434 leader_election.cc:290] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:16.925239  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f68cad86bb493291b46335b3989eea" is_pre_election: true
I20260709 13:18:16.927716  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16f325bf8ca844cd9dc056daecf0e251" is_pre_election: true
I20260709 13:18:16.928429  7284 raft_consensus.cc:2468] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:16.928722  7135 raft_consensus.cc:2393] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9c8319591e9b44beae48a55a48d9ef81 in current term 1: Already voted for candidate 69f68cad86bb493291b46335b3989eea in this term.
I20260709 13:18:16.931063  7034 catalog_manager.cc:5697] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 1 to 2, leader changed from 69f68cad86bb493291b46335b3989eea (127.29.5.131) to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.933238  7211 raft_consensus.cc:2468] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:16.930830  7103 leader_election.cc:304] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:16.940164  7175 leader_election.cc:304] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c8319591e9b44beae48a55a48d9ef81; no voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea
I20260709 13:18:16.941004  7434 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.941586  7426 raft_consensus.cc:2804] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:16.942131  7426 raft_consensus.cc:697] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:16.942957  7426 consensus_queue.cc:237] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:16.948994  7434 raft_consensus.cc:2749] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.950994  7034 catalog_manager.cc:5697] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 1 to 2, leader changed from 69f68cad86bb493291b46335b3989eea (127.29.5.131) to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.961228  7436 consensus_queue.cc:1048] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:16.981181  7434 consensus_queue.cc:1048] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.982009  7456 consensus_queue.cc:1048] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.993467  7472 consensus_queue.cc:1048] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:16.998673  7456 raft_consensus.cc:993] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: : Instructing follower 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:16.999157  7456 raft_consensus.cc:1081] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Signalling peer 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:17.000995  7212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "291d49453b634a1682caf20c4c660850"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:57474
I20260709 13:18:17.001562  7212 raft_consensus.cc:493] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:17.001919  7212 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.009807  7212 raft_consensus.cc:515] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.012704  7472 raft_consensus.cc:993] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: : Instructing follower 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:17.013262  7472 raft_consensus.cc:1081] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Signalling peer 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:17.018167  7397 consensus_queue.cc:1048] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.021025  7136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:17.021570  7136 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.021782  7212 leader_election.cc:290] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:17.023914  7285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:33526
I20260709 13:18:17.024608  7285 raft_consensus.cc:493] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:17.025012  7285 raft_consensus.cc:3060] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.030849  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:17.036325  7472 consensus_queue.cc:1048] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.035439  7284 raft_consensus.cc:3055] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.038687  7284 raft_consensus.cc:740] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:17.040520  7284 consensus_queue.cc:260] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.041841  7284 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.041662  7136 raft_consensus.cc:2468] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:17.043102  7175 leader_election.cc:304] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:17.044128  7434 raft_consensus.cc:2804] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:17.044730  7434 raft_consensus.cc:697] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:17.046149  7434 consensus_queue.cc:237] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.051851  7285 raft_consensus.cc:515] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.055353  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:17.055908  7135 raft_consensus.cc:3055] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.056087  7285 leader_election.cc:290] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:17.056352  7135 raft_consensus.cc:740] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:17.057243  7135 consensus_queue.cc:260] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.058485  7284 raft_consensus.cc:2468] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:17.058841  7135 raft_consensus.cc:3060] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.064220  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1e9d0612a04dd9874db0a914538d76" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:17.064898  7211 raft_consensus.cc:3060] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.065399  7397 raft_consensus.cc:993] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: : Instructing follower 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:17.065861  7397 raft_consensus.cc:1081] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Signalling peer 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:17.068557  7137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8551cfdd46f546f197051de4d69497db"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:18:17.069088  7137 raft_consensus.cc:493] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:17.069465  7137 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.073488  7211 raft_consensus.cc:2468] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:17.076917  7252 leader_election.cc:304] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:17.077823  7437 raft_consensus.cc:2804] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:17.078342  7437 raft_consensus.cc:697] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:17.079165  7437 consensus_queue.cc:237] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.081410  7034 catalog_manager.cc:5697] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 1 to 2, leader changed from 69f68cad86bb493291b46335b3989eea (127.29.5.131) to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.085930  7137 raft_consensus.cc:515] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.088157  7137 leader_election.cc:290] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:17.090389  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:17.091081  7211 raft_consensus.cc:3055] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.091426  7211 raft_consensus.cc:740] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:17.092227  7211 consensus_queue.cc:260] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.093482  7211 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.093492  7033 catalog_manager.cc:5697] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 1 to 2, leader changed from 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129) to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 2 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.091106  7284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:17.096314  7284 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.097731  7434 consensus_queue.cc:1048] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.103067  7284 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:17.104156  7103 leader_election.cc:304] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:17.104948  7426 raft_consensus.cc:2804] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:17.105450  7426 raft_consensus.cc:697] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:17.106025  7135 raft_consensus.cc:2468] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:17.106282  7426 consensus_queue.cc:237] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.111467  7211 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:17.116389  7434 consensus_queue.cc:1048] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.117403  7034 catalog_manager.cc:5697] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 1 to 2, leader changed from 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130) to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.129232  7397 raft_consensus.cc:993] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: : Instructing follower 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:17.129771  7397 raft_consensus.cc:1081] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Signalling peer 16f325bf8ca844cd9dc056daecf0e251 to start an election
I20260709 13:18:17.134287  7135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
 from {username='slave'} at 127.0.0.1:42612
I20260709 13:18:17.135824  7135 raft_consensus.cc:493] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:17.136263  7135 raft_consensus.cc:3060] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.151455  7135 raft_consensus.cc:515] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.156421  7135 leader_election.cc:290] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:17.159018  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:17.159176  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb1c877d3434a9897db2736a9f0af83" candidate_uuid: "16f325bf8ca844cd9dc056daecf0e251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:17.159673  7211 raft_consensus.cc:3055] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.159749  7286 raft_consensus.cc:3060] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.160208  7211 raft_consensus.cc:740] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:17.161062  7211 consensus_queue.cc:260] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.162182  7211 raft_consensus.cc:3060] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.167909  7286 raft_consensus.cc:2468] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:17.168989  7103 leader_election.cc:304] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:17.169517  7211 raft_consensus.cc:2468] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16f325bf8ca844cd9dc056daecf0e251 in term 2.
I20260709 13:18:17.169831  7426 raft_consensus.cc:2804] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:17.170346  7426 raft_consensus.cc:697] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Leader. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:17.171044  7426 consensus_queue.cc:237] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.176599  7457 consensus_queue.cc:1048] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.179080  7033 catalog_manager.cc:5697] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 reported cstate change: term changed from 1 to 2, leader changed from 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130) to 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129). New cstate: current_term: 2 leader_uuid: "16f325bf8ca844cd9dc056daecf0e251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.191398  7436 consensus_queue.cc:1048] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.210148  7437 raft_consensus.cc:993] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: : Instructing follower 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:17.210640  7437 raft_consensus.cc:1081] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Signalling peer 9c8319591e9b44beae48a55a48d9ef81 to start an election
I20260709 13:18:17.212782  7211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
 from {username='slave'} at 127.0.0.1:57474
I20260709 13:18:17.213389  7211 raft_consensus.cc:493] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:17.213775  7211 raft_consensus.cc:3060] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.222913  7211 raft_consensus.cc:515] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.225178  7211 leader_election.cc:290] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211)
I20260709 13:18:17.226225  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f68cad86bb493291b46335b3989eea"
I20260709 13:18:17.226644  7135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cebe7b62f1924489966eaccede09e2d2" candidate_uuid: "9c8319591e9b44beae48a55a48d9ef81" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:17.226902  7286 raft_consensus.cc:3055] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:17.227321  7286 raft_consensus.cc:740] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:17.227324  7135 raft_consensus.cc:3060] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.228335  7286 consensus_queue.cc:260] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.229631  7286 raft_consensus.cc:3060] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.235193  7286 raft_consensus.cc:2468] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:17.235265  7135 raft_consensus.cc:2468] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c8319591e9b44beae48a55a48d9ef81 in term 2.
I20260709 13:18:17.236115  7178 leader_election.cc:304] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:17.236934  7397 raft_consensus.cc:2804] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:17.237484  7397 raft_consensus.cc:697] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Becoming Leader. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:17.238209  7397 consensus_queue.cc:237] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:17.255100  7033 catalog_manager.cc:5697] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 reported cstate change: term changed from 1 to 2, leader changed from 69f68cad86bb493291b46335b3989eea (127.29.5.131) to 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "9c8319591e9b44beae48a55a48d9ef81" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.318327  7211 raft_consensus.cc:3060] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:17.327193  7211 raft_consensus.cc:1275] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.328856  7426 consensus_queue.cc:1048] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.338364  7286 raft_consensus.cc:1275] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.339833  7496 consensus_queue.cc:1048] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.343225  7135 raft_consensus.cc:1275] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.344492  7285 raft_consensus.cc:1275] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.344786  7433 consensus_queue.cc:1048] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.348274  7397 consensus_queue.cc:1048] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.405701  7286 raft_consensus.cc:1275] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.407215  7496 consensus_queue.cc:1048] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.420288  7211 raft_consensus.cc:1275] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.424268  7496 consensus_queue.cc:1048] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.565513  7211 raft_consensus.cc:1275] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.566988  7426 consensus_queue.cc:1048] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.577337  7286 raft_consensus.cc:1275] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.578698  7496 consensus_queue.cc:1048] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.580793  7135 raft_consensus.cc:1275] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.583966  7437 consensus_queue.cc:1048] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.591732  7211 raft_consensus.cc:1275] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.594877  7456 consensus_queue.cc:1048] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.610311  7286 raft_consensus.cc:1275] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.611851  7496 consensus_queue.cc:1048] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.624799  7211 raft_consensus.cc:1275] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 16f325bf8ca844cd9dc056daecf0e251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.631579  7496 consensus_queue.cc:1048] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.647873  7135 raft_consensus.cc:1275] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.649128  7397 consensus_queue.cc:1048] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.657580  7286 raft_consensus.cc:1275] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.659230  7498 consensus_queue.cc:1048] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:17.784492  7135 raft_consensus.cc:1275] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.785801  7498 consensus_queue.cc:1048] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:17.793929  7285 raft_consensus.cc:1275] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Refusing update from remote peer 9c8319591e9b44beae48a55a48d9ef81: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:17.796444  7498 consensus_queue.cc:1048] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:19.783270  7033 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46028:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:18:19.802208  7033 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46028:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:18:19.849519 29718 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:18:19.960831  7536 tablet.cc:1724] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:19.967804  7528 log.cc:927] Time spent T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: Append to log took a long time: real 0.056s	user 0.002s	sys 0.010s
I20260709 13:18:20.023680  7535 tablet.cc:1724] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:20.026774  7163 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:4dd21f4e54184e77be77728a9ed31a0f)
W20260709 13:18:20.018651  7540 log.cc:927] Time spent T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:18:20.038503  7163 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:4dd21f4e54184e77be77728a9ed31a0f)
W20260709 13:18:20.045961  7163 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:4dd21f4e54184e77be77728a9ed31a0f)
I20260709 13:18:20.091426  7550 tablet.cc:1724] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.096300  7541 tablet.cc:1724] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.131644  7207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "291d49453b634a1682caf20c4c660850"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
mode: GRACEFUL
new_leader_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:59904
I20260709 13:18:20.132692  7207 raft_consensus.cc:606] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Received request to transfer leadership to TS 69f68cad86bb493291b46335b3989eea
I20260709 13:18:20.203190  7567 tablet.cc:1724] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.215993  7560 tablet.cc:1724] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:20.206081  7553 log.cc:927] Time spent T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: Append to log took a long time: real 0.064s	user 0.000s	sys 0.004s
W20260709 13:18:20.240048  7556 log.cc:927] Time spent T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:20.241292  7561 tablet.cc:1724] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.242254  7535 tablet.cc:1724] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.247951  7559 tablet.cc:1724] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.262450  7557 tablet.cc:1724] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.272608  7563 tablet.cc:1724] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.279745  7536 tablet.cc:1724] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.282163  7541 tablet.cc:1724] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:20.261870  7178 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:39211, user_credentials={real_user=slave}} blocked reactor thread for 99881.2us
I20260709 13:18:20.320580  7134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8551cfdd46f546f197051de4d69497db"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
mode: GRACEFUL
new_leader_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:41016
I20260709 13:18:20.321285  7134 raft_consensus.cc:606] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Received request to transfer leadership to TS 69f68cad86bb493291b46335b3989eea
I20260709 13:18:20.323848 29718 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:18:20.331928 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:20.360066  7134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce"
dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
mode: GRACEFUL
new_leader_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:41016
I20260709 13:18:20.369683  7134 raft_consensus.cc:606] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Received request to transfer leadership to TS 69f68cad86bb493291b46335b3989eea
I20260709 13:18:20.375941  7212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d"
dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
mode: GRACEFUL
new_leader_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:59904
I20260709 13:18:20.375584  7568 tablet.cc:1724] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.376590  7212 raft_consensus.cc:606] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Received request to transfer leadership to TS 69f68cad86bb493291b46335b3989eea
I20260709 13:18:20.324159  7561 tablet.cc:1724] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.378196 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:20.378134  7565 tablet.cc:1724] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.379031 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:20.391091  7565 tablet.cc:1724] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.391949  7550 tablet.cc:1724] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.406838  7560 tablet.cc:1724] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.409679  7557 tablet.cc:1724] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.413719  7569 raft_consensus.cc:993] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: : Instructing follower 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.414232  7569 raft_consensus.cc:1081] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Signalling peer 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.417681  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "291d49453b634a1682caf20c4c660850"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:18:20.417171  7567 tablet.cc:1724] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.418332  7286 raft_consensus.cc:493] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:20.418715  7286 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.419430  7536 tablet.cc:1724] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.387391  7559 tablet.cc:1724] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.398743  7541 tablet.cc:1724] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.425868  7535 tablet.cc:1724] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.426721  7286 raft_consensus.cc:515] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.447757  7286 leader_election.cc:290] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 3 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:20.448777  7279 raft_consensus.cc:1240] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Rejecting Update request from peer 9c8319591e9b44beae48a55a48d9ef81 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:20.452759  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:20.453395  7498 consensus_queue.cc:1059] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.453794  7133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291d49453b634a1682caf20c4c660850" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:20.453416  7210 raft_consensus.cc:3055] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.454488  7133 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.454680  7210 raft_consensus.cc:740] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:20.459568  7210 consensus_queue.cc:260] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.460820  7210 raft_consensus.cc:3060] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.462033  7133 raft_consensus.cc:2468] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 3.
I20260709 13:18:20.463689  7249 leader_election.cc:304] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16f325bf8ca844cd9dc056daecf0e251, 69f68cad86bb493291b46335b3989eea; no voters: 
I20260709 13:18:20.464686  7547 raft_consensus.cc:2804] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:20.465186  7547 raft_consensus.cc:697] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 3 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:20.466009  7547 consensus_queue.cc:237] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.468003  7210 raft_consensus.cc:2468] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 3.
I20260709 13:18:20.439096  7568 tablet.cc:1724] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:20.468626  7498 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:18:20.483003  7032 catalog_manager.cc:5697] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 2 to 3, leader changed from 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130) to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 3 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.484701  7032 catalog_manager.cc:5789] TS 69f68cad86bb493291b46335b3989eea (127.29.5.131:39211) does not have the latest schema for tablet 291d49453b634a1682caf20c4c660850 (table soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5]). Expected version 1 got 0
I20260709 13:18:20.493958  7035 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac: soft_deleted_table [id=97812dc55fdc45d1a58628dabbc938f5] alter complete (version 1)
I20260709 13:18:20.534664  7531 raft_consensus.cc:993] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: : Instructing follower 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.535120  7531 raft_consensus.cc:1081] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Signalling peer 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.536594  7279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:33526
I20260709 13:18:20.537060  7279 raft_consensus.cc:493] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:20.537380  7279 raft_consensus.cc:3060] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.543071  7279 raft_consensus.cc:515] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.545748  7279 leader_election.cc:290] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Requested vote from peers 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239), 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291)
I20260709 13:18:20.546581  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:20.547236  7212 raft_consensus.cc:3060] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.547791  7133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d8c9b2d30614aeea62a7713107722ce" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:20.548676  7133 raft_consensus.cc:3055] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:20.549008  7133 raft_consensus.cc:740] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:20.549825  7133 consensus_queue.cc:260] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.550981  7133 raft_consensus.cc:3060] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.552623  7212 raft_consensus.cc:2468] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:20.553766  7252 leader_election.cc:304] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:20.554677  7547 raft_consensus.cc:2804] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:20.555173  7547 raft_consensus.cc:697] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:20.556013  7547 consensus_queue.cc:237] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.557971  7133 raft_consensus.cc:2468] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:20.564915  7035 catalog_manager.cc:5697] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 1 to 2, leader changed from 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129) to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 2 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.633455  7542 raft_consensus.cc:993] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: : Instructing follower 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.633903  7542 raft_consensus.cc:1081] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Signalling peer 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.635236  7279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8551cfdd46f546f197051de4d69497db"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:33526
I20260709 13:18:20.635639  7279 raft_consensus.cc:493] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:20.635957  7279 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.641530  7279 raft_consensus.cc:515] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.643496  7279 leader_election.cc:290] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 3 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:20.644085  7133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:20.644608  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8551cfdd46f546f197051de4d69497db" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:20.644757  7133 raft_consensus.cc:3055] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:20.645154  7212 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.645196  7133 raft_consensus.cc:740] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16f325bf8ca844cd9dc056daecf0e251, State: Running, Role: LEADER
I20260709 13:18:20.646205  7133 consensus_queue.cc:260] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.647459  7133 raft_consensus.cc:3060] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:20.649667  7212 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 3.
I20260709 13:18:20.650561  7252 leader_election.cc:304] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:20.651233  7547 raft_consensus.cc:2804] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:20.651641  7547 raft_consensus.cc:697] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 3 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:20.652451  7547 consensus_queue.cc:237] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.654289  7133 raft_consensus.cc:2468] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 3.
I20260709 13:18:20.658895  7035 catalog_manager.cc:5697] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 2 to 3, leader changed from 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129) to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 3 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.666750  7572 raft_consensus.cc:993] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: : Instructing follower 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.667229  7498 raft_consensus.cc:1081] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Signalling peer 69f68cad86bb493291b46335b3989eea to start an election
I20260709 13:18:20.668872  7279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d"
dest_uuid: "69f68cad86bb493291b46335b3989eea"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:18:20.669436  7279 raft_consensus.cc:493] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:20.669813  7279 raft_consensus.cc:3060] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.677147  7279 raft_consensus.cc:515] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.679195  7279 leader_election.cc:290] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Requested vote from peers 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291), 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239)
I20260709 13:18:20.679834  7133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16f325bf8ca844cd9dc056daecf0e251"
I20260709 13:18:20.680152  7212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa4a23d43704835aa188b111403ee9d" candidate_uuid: "69f68cad86bb493291b46335b3989eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c8319591e9b44beae48a55a48d9ef81"
I20260709 13:18:20.680507  7133 raft_consensus.cc:3060] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.680783  7212 raft_consensus.cc:3055] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:20.681075  7212 raft_consensus.cc:740] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c8319591e9b44beae48a55a48d9ef81, State: Running, Role: LEADER
I20260709 13:18:20.681699  7212 consensus_queue.cc:260] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.682575  7212 raft_consensus.cc:3060] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:20.687279  7212 raft_consensus.cc:2468] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:20.687855  7133 raft_consensus.cc:2468] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f68cad86bb493291b46335b3989eea in term 2.
I20260709 13:18:20.688251  7252 leader_election.cc:304] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f68cad86bb493291b46335b3989eea, 9c8319591e9b44beae48a55a48d9ef81; no voters: 
I20260709 13:18:20.689131  7547 raft_consensus.cc:2804] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:20.689626  7547 raft_consensus.cc:697] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Becoming Leader. State: Replica: 69f68cad86bb493291b46335b3989eea, State: Running, Role: LEADER
I20260709 13:18:20.690541  7547 consensus_queue.cc:237] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } }
I20260709 13:18:20.698669  7035 catalog_manager.cc:5697] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea reported cstate change: term changed from 1 to 2, leader changed from 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130) to 69f68cad86bb493291b46335b3989eea (127.29.5.131). New cstate: current_term: 2 leader_uuid: "69f68cad86bb493291b46335b3989eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f68cad86bb493291b46335b3989eea" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 39211 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:20.892828  7133 raft_consensus.cc:1275] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:20.894151  7547 consensus_queue.cc:1048] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:20.900163  7541 tablet.cc:1724] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:20.903784  7212 raft_consensus.cc:1275] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:20.905404  7582 consensus_queue.cc:1048] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:20.925580  7541 tablet.cc:1719] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:18:20.928139  7535 tablet.cc:1719] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:18:20.939947  7568 tablet.cc:1719] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:18:21.155649  7133 raft_consensus.cc:1275] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.157084  7582 consensus_queue.cc:1048] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.166199  7209 raft_consensus.cc:1275] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.167732  7582 consensus_queue.cc:1048] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.174228  7133 raft_consensus.cc:1275] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.177312  7582 consensus_queue.cc:1048] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.179340  7209 raft_consensus.cc:1275] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:21.180876  7212 raft_consensus.cc:1275] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:21.181262  7547 consensus_queue.cc:1048] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:21.182438  7582 consensus_queue.cc:1048] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c8319591e9b44beae48a55a48d9ef81" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:21.198441  7133 raft_consensus.cc:1275] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Refusing update from remote peer 69f68cad86bb493291b46335b3989eea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:21.203751  7547 consensus_queue.cc:1048] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "16f325bf8ca844cd9dc056daecf0e251" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 37291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:21.437783 29718 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:18:21.443569 29718 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:18:21.444013 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:21.449608 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:18:21.450107 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:22.477918 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
I20260709 13:18:22.503710 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:22.504643 29718 tablet_replica.cc:333] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.505649 29718 raft_consensus.cc:2243] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.506251 29718 raft_consensus.cc:2272] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.508292 29718 tablet_replica.cc:333] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.508872 29718 raft_consensus.cc:2243] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.509599 29718 raft_consensus.cc:2272] T 3c1e9d0612a04dd9874db0a914538d76 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.511602 29718 tablet_replica.cc:333] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.512202 29718 raft_consensus.cc:2243] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.512950 29718 raft_consensus.cc:2272] T ecb1c877d3434a9897db2736a9f0af83 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.514899 29718 tablet_replica.cc:333] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
W20260709 13:18:22.515353  7249 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:18:22.515462 29718 raft_consensus.cc:2243] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.516292 29718 raft_consensus.cc:2272] T 291d49453b634a1682caf20c4c660850 P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.518965 29718 tablet_replica.cc:333] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
W20260709 13:18:22.518949  7249 consensus_peers.cc:597] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.519928 29718 raft_consensus.cc:2243] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.520844 29718 raft_consensus.cc:2272] T 79bddb40906e4f498204786bffc5b8f5 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.522822 29718 tablet_replica.cc:333] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.523416 29718 raft_consensus.cc:2243] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.524209 29718 raft_consensus.cc:2272] T 6313b5af1a1a46199cbd0d253e0f5e33 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.526397 29718 tablet_replica.cc:333] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.526898 29718 raft_consensus.cc:2243] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.527284 29718 raft_consensus.cc:2272] T 1c14626d867343a1b01213db19f6c8eb P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.529141 29718 tablet_replica.cc:333] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.529662 29718 raft_consensus.cc:2243] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.530082 29718 raft_consensus.cc:2272] T 66354f947ee3445889cfc111f6c273c9 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.532078 29718 tablet_replica.cc:333] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.532558 29718 raft_consensus.cc:2243] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.532913 29718 raft_consensus.cc:2272] T cebe7b62f1924489966eaccede09e2d2 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.534596 29718 tablet_replica.cc:333] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.535058 29718 raft_consensus.cc:2243] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.535867 29718 raft_consensus.cc:2272] T 43ed194745d34f309da2d1cc8d3cca29 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.537853 29718 tablet_replica.cc:333] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.538343 29718 raft_consensus.cc:2243] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.538857 29718 raft_consensus.cc:2272] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 16f325bf8ca844cd9dc056daecf0e251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.540915 29718 tablet_replica.cc:333] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.541486 29718 raft_consensus.cc:2243] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.541978 29718 raft_consensus.cc:2272] T eaa4a23d43704835aa188b111403ee9d P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.544466 29718 tablet_replica.cc:333] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.545027 29718 raft_consensus.cc:2243] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.545457 29718 raft_consensus.cc:2272] T 8551cfdd46f546f197051de4d69497db P 16f325bf8ca844cd9dc056daecf0e251 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.545642  7249 consensus_peers.cc:597] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.547274 29718 tablet_replica.cc:333] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.548074 29718 raft_consensus.cc:2243] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.548542 29718 raft_consensus.cc:2272] T afc3e56a4ecd4acb86ae504e26a67d5b P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.551226 29718 tablet_replica.cc:333] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.551944 29718 raft_consensus.cc:2243] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.553009 29718 raft_consensus.cc:2272] T 28a8795c7faa4934af115277e1f67b5f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.555308 29718 tablet_replica.cc:333] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.555920 29718 raft_consensus.cc:2243] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.556344 29718 raft_consensus.cc:2272] T afcd7ee807b64106b29a1f2d9c43cc91 P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.558585 29718 tablet_replica.cc:333] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.559055 29718 raft_consensus.cc:2243] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.559856 29718 raft_consensus.cc:2272] T 4dd21f4e54184e77be77728a9ed31a0f P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.561650 29718 tablet_replica.cc:333] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251: stopping tablet replica
I20260709 13:18:22.562089 29718 raft_consensus.cc:2243] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.562448 29718 raft_consensus.cc:2272] T 5d8c9b2d30614aeea62a7713107722ce P 16f325bf8ca844cd9dc056daecf0e251 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.567910  7249 consensus_peers.cc:597] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.604751 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
I20260709 13:18:22.638427 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
W20260709 13:18:22.652678  7252 consensus_peers.cc:597] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea -> Peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Couldn't send request to peer 9c8319591e9b44beae48a55a48d9ef81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.662631  7252 consensus_peers.cc:597] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea -> Peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Couldn't send request to peer 9c8319591e9b44beae48a55a48d9ef81. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.671876 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:22.672639 29718 tablet_replica.cc:333] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.673285 29718 raft_consensus.cc:2243] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.673862 29718 raft_consensus.cc:2272] T 291d49453b634a1682caf20c4c660850 P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.675710 29718 tablet_replica.cc:333] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.676333 29718 raft_consensus.cc:2243] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.676761 29718 raft_consensus.cc:2272] T 3c1e9d0612a04dd9874db0a914538d76 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.678606 29718 tablet_replica.cc:333] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.679177 29718 raft_consensus.cc:2243] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.680037 29718 raft_consensus.cc:2272] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.681969 29718 tablet_replica.cc:333] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.682539 29718 raft_consensus.cc:2243] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.682966 29718 raft_consensus.cc:2272] T ecb1c877d3434a9897db2736a9f0af83 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.684922 29718 tablet_replica.cc:333] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.685503 29718 raft_consensus.cc:2243] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.685935 29718 raft_consensus.cc:2272] T 79bddb40906e4f498204786bffc5b8f5 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.687816 29718 tablet_replica.cc:333] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.688511 29718 raft_consensus.cc:2243] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.688959 29718 raft_consensus.cc:2272] T 5d8c9b2d30614aeea62a7713107722ce P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.691013 29718 tablet_replica.cc:333] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.691525 29718 raft_consensus.cc:2243] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.691970 29718 raft_consensus.cc:2272] T 4dd21f4e54184e77be77728a9ed31a0f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.693972  7175 consensus_peers.cc:597] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:37291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.693985 29718 tablet_replica.cc:333] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.694801 29718 raft_consensus.cc:2243] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.695559 29718 raft_consensus.cc:2272] T 66354f947ee3445889cfc111f6c273c9 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.697516 29718 tablet_replica.cc:333] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.698081 29718 raft_consensus.cc:2243] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.698499 29718 raft_consensus.cc:2272] T 28a8795c7faa4934af115277e1f67b5f P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.700475 29718 tablet_replica.cc:333] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.701009 29718 raft_consensus.cc:2243] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.701421 29718 raft_consensus.cc:2272] T afcd7ee807b64106b29a1f2d9c43cc91 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.703382 29718 tablet_replica.cc:333] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.704058 29718 raft_consensus.cc:2243] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.705024 29718 raft_consensus.cc:2272] T afc3e56a4ecd4acb86ae504e26a67d5b P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.707242 29718 tablet_replica.cc:333] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.707751 29718 raft_consensus.cc:2243] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.708197 29718 raft_consensus.cc:2272] T 8551cfdd46f546f197051de4d69497db P 9c8319591e9b44beae48a55a48d9ef81 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.708331  7175 consensus_peers.cc:597] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:37291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.710067 29718 tablet_replica.cc:333] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.710733 29718 raft_consensus.cc:2243] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.711139 29718 raft_consensus.cc:2272] T eaa4a23d43704835aa188b111403ee9d P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.713124 29718 tablet_replica.cc:333] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.713629 29718 raft_consensus.cc:2243] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.714349 29718 raft_consensus.cc:2272] T cebe7b62f1924489966eaccede09e2d2 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.716248 29718 tablet_replica.cc:333] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.716864 29718 raft_consensus.cc:2243] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.717306 29718 raft_consensus.cc:2272] T 43ed194745d34f309da2d1cc8d3cca29 P 9c8319591e9b44beae48a55a48d9ef81 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.719309 29718 tablet_replica.cc:333] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.719930 29718 raft_consensus.cc:2243] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.720906 29718 raft_consensus.cc:2272] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.723058 29718 tablet_replica.cc:333] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.723573 29718 raft_consensus.cc:2243] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.724323 29718 raft_consensus.cc:2272] T 1c14626d867343a1b01213db19f6c8eb P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.726171 29718 tablet_replica.cc:333] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81: stopping tablet replica
I20260709 13:18:22.726694 29718 raft_consensus.cc:2243] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.727205 29718 raft_consensus.cc:2272] T 6313b5af1a1a46199cbd0d253e0f5e33 P 9c8319591e9b44beae48a55a48d9ef81 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.736236  7249 consensus_peers.cc:597] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:37291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.762177  7249 consensus_peers.cc:597] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea -> Peer 16f325bf8ca844cd9dc056daecf0e251 (127.29.5.129:37291): Couldn't send request to peer 16f325bf8ca844cd9dc056daecf0e251. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:37291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.773653 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
I20260709 13:18:22.806833 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
W20260709 13:18:22.814863  7252 consensus_peers.cc:597] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea -> Peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Couldn't send request to peer 9c8319591e9b44beae48a55a48d9ef81. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:33239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.837891 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:22.838820 29718 tablet_replica.cc:333] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.839848 29718 raft_consensus.cc:2243] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.840502 29718 raft_consensus.cc:2272] T ecb1c877d3434a9897db2736a9f0af83 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.842460 29718 tablet_replica.cc:333] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.842989 29718 raft_consensus.cc:2243] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.843745 29718 raft_consensus.cc:2272] T 3c1e9d0612a04dd9874db0a914538d76 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.845633 29718 tablet_replica.cc:333] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.846145 29718 raft_consensus.cc:2243] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.846861 29718 raft_consensus.cc:2272] T 291d49453b634a1682caf20c4c660850 P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.848737 29718 tablet_replica.cc:333] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.849251 29718 raft_consensus.cc:2243] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.849615 29718 raft_consensus.cc:2272] T a27a9fe4e5054465b3d8e6a4eb7aeb00 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.851382 29718 tablet_replica.cc:333] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.851974 29718 raft_consensus.cc:2243] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.852425 29718 raft_consensus.cc:2272] T 79bddb40906e4f498204786bffc5b8f5 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.854115 29718 tablet_replica.cc:333] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.854686 29718 raft_consensus.cc:2243] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.855635 29718 raft_consensus.cc:2272] T 5d8c9b2d30614aeea62a7713107722ce P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.857568 29718 tablet_replica.cc:333] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.858096 29718 raft_consensus.cc:2243] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.858516 29718 raft_consensus.cc:2272] T 4dd21f4e54184e77be77728a9ed31a0f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.860249 29718 tablet_replica.cc:333] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.860841 29718 raft_consensus.cc:2243] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.861297 29718 raft_consensus.cc:2272] T 66354f947ee3445889cfc111f6c273c9 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.863541 29718 tablet_replica.cc:333] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.864148 29718 raft_consensus.cc:2243] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.864585 29718 raft_consensus.cc:2272] T afc3e56a4ecd4acb86ae504e26a67d5b P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:22.865130  7252 consensus_peers.cc:597] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea -> Peer 9c8319591e9b44beae48a55a48d9ef81 (127.29.5.130:33239): Couldn't send request to peer 9c8319591e9b44beae48a55a48d9ef81. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:33239: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.866547 29718 tablet_replica.cc:333] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.867192 29718 raft_consensus.cc:2243] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.868031 29718 raft_consensus.cc:2272] T 8551cfdd46f546f197051de4d69497db P 69f68cad86bb493291b46335b3989eea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.869865 29718 tablet_replica.cc:333] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.870415 29718 raft_consensus.cc:2243] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.871162 29718 raft_consensus.cc:2272] T eaa4a23d43704835aa188b111403ee9d P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.873134 29718 tablet_replica.cc:333] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.873654 29718 raft_consensus.cc:2243] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.874152 29718 raft_consensus.cc:2272] T cebe7b62f1924489966eaccede09e2d2 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.875976 29718 tablet_replica.cc:333] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.876510 29718 raft_consensus.cc:2243] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.876951 29718 raft_consensus.cc:2272] T 43ed194745d34f309da2d1cc8d3cca29 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.879098 29718 tablet_replica.cc:333] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.879631 29718 raft_consensus.cc:2243] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.880117 29718 raft_consensus.cc:2272] T 6a82ae27b5d543b3b5b5cf3e6ef63dd0 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.882131 29718 tablet_replica.cc:333] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.882647 29718 raft_consensus.cc:2243] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.883098 29718 raft_consensus.cc:2272] T 28a8795c7faa4934af115277e1f67b5f P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.885059 29718 tablet_replica.cc:333] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.885597 29718 raft_consensus.cc:2243] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.886379 29718 raft_consensus.cc:2272] T afcd7ee807b64106b29a1f2d9c43cc91 P 69f68cad86bb493291b46335b3989eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.888408 29718 tablet_replica.cc:333] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.888895 29718 raft_consensus.cc:2243] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.889309 29718 raft_consensus.cc:2272] T 1c14626d867343a1b01213db19f6c8eb P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.891017 29718 tablet_replica.cc:333] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea: stopping tablet replica
I20260709 13:18:22.891531 29718 raft_consensus.cc:2243] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.891984 29718 raft_consensus.cc:2272] T 6313b5af1a1a46199cbd0d253e0f5e33 P 69f68cad86bb493291b46335b3989eea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.931895 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
I20260709 13:18:22.963971 29718 master.cc:562] Master@127.29.5.190:41103 shutting down...
I20260709 13:18:22.988473 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:22.989066 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.989423 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P 60e0f0ddbf10408d9f62278f64ef81ac: stopping tablet replica
I20260709 13:18:23.028211 29718 master.cc:584] Master@127.29.5.190:41103 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12355 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:18:23.082384 29718 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.29.5.190:42119
I20260709 13:18:23.083535 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:23.089460  7596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.090173  7599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.090440  7597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:23.091084 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:23.093017 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:23.093256 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:23.093428 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603103093413 us; error 0 us; skew 500 ppm
I20260709 13:18:23.093968 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:23.096442 29718 webserver.cc:533] Webserver started at http://127.29.5.190:34211/ using document root <none> and password file <none>
I20260709 13:18:23.096922 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:23.097136 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:23.097419 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:23.098555 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/master-0-root/instance:
uuid: "e181a6c75b7641a697bd4cab596bbcec"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.103111 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:18:23.106456  7604 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.107249 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:23.107543 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/master-0-root
uuid: "e181a6c75b7641a697bd4cab596bbcec"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.107856 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:23.118273 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:23.119585 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:23.158488 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.190:42119
I20260709 13:18:23.158592  7655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.190:42119 every 8 connection(s)
I20260709 13:18:23.162587  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.173676  7656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec: Bootstrap starting.
I20260709 13:18:23.178592  7656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.182897  7656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec: No bootstrap required, opened a new log
I20260709 13:18:23.185046  7656 raft_consensus.cc:359] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e181a6c75b7641a697bd4cab596bbcec" member_type: VOTER }
I20260709 13:18:23.185503  7656 raft_consensus.cc:385] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.185710  7656 raft_consensus.cc:740] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e181a6c75b7641a697bd4cab596bbcec, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.186322  7656 consensus_queue.cc:260] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e181a6c75b7641a697bd4cab596bbcec" member_type: VOTER }
I20260709 13:18:23.186731  7656 raft_consensus.cc:399] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:23.186915  7656 raft_consensus.cc:493] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:23.187119  7656 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.191857  7656 raft_consensus.cc:515] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e181a6c75b7641a697bd4cab596bbcec" member_type: VOTER }
I20260709 13:18:23.192327  7656 leader_election.cc:304] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e181a6c75b7641a697bd4cab596bbcec; no voters: 
I20260709 13:18:23.193466  7656 leader_election.cc:290] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:23.193831  7659 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.195250  7659 raft_consensus.cc:697] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 1 LEADER]: Becoming Leader. State: Replica: e181a6c75b7641a697bd4cab596bbcec, State: Running, Role: LEADER
I20260709 13:18:23.195984  7659 consensus_queue.cc:237] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e181a6c75b7641a697bd4cab596bbcec" member_type: VOTER }
I20260709 13:18:23.196460  7656 sys_catalog.cc:565] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:23.200274  7660 sys_catalog.cc:455] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e181a6c75b7641a697bd4cab596bbcec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e181a6c75b7641a697bd4cab596bbcec" member_type: VOTER } }
I20260709 13:18:23.201035  7660 sys_catalog.cc:458] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:23.201073  7661 sys_catalog.cc:455] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [sys.catalog]: SysCatalogTable state changed. Reason: New leader e181a6c75b7641a697bd4cab596bbcec. Latest consensus state: current_term: 1 leader_uuid: "e181a6c75b7641a697bd4cab596bbcec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e181a6c75b7641a697bd4cab596bbcec" member_type: VOTER } }
I20260709 13:18:23.201671  7661 sys_catalog.cc:458] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:23.204762  7666 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:23.210230  7666 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:23.212149 29718 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:23.219061  7666 catalog_manager.cc:1383] Generated new cluster ID: b8fb8c1c732e44ea8ebad72163bfef97
I20260709 13:18:23.219379  7666 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:23.249259  7666 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:23.250561  7666 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:23.268229  7666 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec: Generated new TSK 0
I20260709 13:18:23.268860  7666 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:23.278214 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:23.284024  7677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.285113  7678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.287046  7680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:23.287168 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:23.288395 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:23.288688 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:23.288882 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603103288856 us; error 0 us; skew 500 ppm
I20260709 13:18:23.289440 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:23.291718 29718 webserver.cc:533] Webserver started at http://127.29.5.129:46791/ using document root <none> and password file <none>
I20260709 13:18:23.292323 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:23.292557 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:23.292856 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:23.294013 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-0-root/instance:
uuid: "e06813d9b94c44bc8010170059affc2f"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.299268 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:18:23.302801  7685 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.303610 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:23.303974 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-0-root
uuid: "e06813d9b94c44bc8010170059affc2f"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.304276 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:23.332751 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:23.334019 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:23.335489 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:23.337744 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:23.337966 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.338207 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:23.338397 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.378597 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.129:45607
I20260709 13:18:23.378727  7747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.129:45607 every 8 connection(s)
I20260709 13:18:23.383885 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:23.391511  7752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.393324  7753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.394694  7755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:23.395393 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:23.396706 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:23.396891  7748 heartbeater.cc:344] Connected to a master server at 127.29.5.190:42119
W20260709 13:18:23.396991 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:23.397323 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603103397306 us; error 0 us; skew 500 ppm
I20260709 13:18:23.397404  7748 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:23.397984 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:23.398276  7748 heartbeater.cc:507] Master 127.29.5.190:42119 requested a full tablet report, sending...
I20260709 13:18:23.400766  7621 ts_manager.cc:194] Registered new tserver with Master: e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607)
I20260709 13:18:23.400785 29718 webserver.cc:533] Webserver started at http://127.29.5.130:45309/ using document root <none> and password file <none>
I20260709 13:18:23.401459 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:23.401683 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:23.401948 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:23.402710  7621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54176
I20260709 13:18:23.403054 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-1-root/instance:
uuid: "57039b71674b4719abbef40a29a8ec03"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.408301 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:18:23.411689  7760 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.412458 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:23.412753 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-1-root
uuid: "57039b71674b4719abbef40a29a8ec03"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.413046 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:23.427111 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:23.428417 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:23.429868 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:23.432111 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:23.432331 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.432566 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:23.432746 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.472738 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.130:45965
I20260709 13:18:23.472855  7822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.130:45965 every 8 connection(s)
I20260709 13:18:23.477568 29718 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:23.484831  7826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.485970  7827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:23.488656  7829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:23.489853 29718 server_base.cc:1061] running on GCE node
I20260709 13:18:23.490857  7823 heartbeater.cc:344] Connected to a master server at 127.29.5.190:42119
I20260709 13:18:23.490939 29718 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:23.491333 29718 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:23.491361  7823 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:23.491519 29718 hybrid_clock.cc:648] HybridClock initialized: now 1783603103491502 us; error 0 us; skew 500 ppm
I20260709 13:18:23.492264 29718 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:23.492272  7823 heartbeater.cc:507] Master 127.29.5.190:42119 requested a full tablet report, sending...
I20260709 13:18:23.494472  7621 ts_manager.cc:194] Registered new tserver with Master: 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:23.494894 29718 webserver.cc:533] Webserver started at http://127.29.5.131:35667/ using document root <none> and password file <none>
I20260709 13:18:23.495428 29718 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:23.495632 29718 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:23.495930 29718 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:23.496091  7621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54180
I20260709 13:18:23.497335 29718 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-2-root/instance:
uuid: "ad5bcb3e418842f998b2f9aa622c7527"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.502071 29718 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:23.505156  7834 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.505949 29718 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:18:23.506193 29718 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-2-root
uuid: "ad5bcb3e418842f998b2f9aa622c7527"
format_stamp: "Formatted at 2026-07-09 13:18:23 on dist-test-slave-kgkf"
I20260709 13:18:23.506615 29718 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjMuZkU/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602803890413-29718-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:23.519164 29718 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:23.520373 29718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:23.521870 29718 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:23.524057 29718 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:23.524293 29718 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.524528 29718 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:23.524698 29718 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:23.563318 29718 rpc_server.cc:307] RPC server started. Bound to: 127.29.5.131:38115
I20260709 13:18:23.563459  7896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.29.5.131:38115 every 8 connection(s)
I20260709 13:18:23.578145  7897 heartbeater.cc:344] Connected to a master server at 127.29.5.190:42119
I20260709 13:18:23.578660  7897 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:23.579453  7897 heartbeater.cc:507] Master 127.29.5.190:42119 requested a full tablet report, sending...
I20260709 13:18:23.581664  7621 ts_manager.cc:194] Registered new tserver with Master: ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:23.582345 29718 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015937798s
I20260709 13:18:23.583501  7621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54194
I20260709 13:18:23.612150  7621 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54196:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:23.614722  7621 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:23.689257  7862 tablet_service.cc:1511] Processing CreateTablet for tablet 2df012888d964e41b1c7175829371b55 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:23.690691  7862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df012888d964e41b1c7175829371b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.692822  7861 tablet_service.cc:1511] Processing CreateTablet for tablet afa747ca87014f5c848ea05f8e51b6bb (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:23.694267  7861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa747ca87014f5c848ea05f8e51b6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.697857  7713 tablet_service.cc:1511] Processing CreateTablet for tablet 2df012888d964e41b1c7175829371b55 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:23.698768  7860 tablet_service.cc:1511] Processing CreateTablet for tablet e0b0fa9345344e58b6da4eeb8ced9b49 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:23.699328  7713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df012888d964e41b1c7175829371b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.697921  7712 tablet_service.cc:1511] Processing CreateTablet for tablet afa747ca87014f5c848ea05f8e51b6bb (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:23.701191  7712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa747ca87014f5c848ea05f8e51b6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.700871  7788 tablet_service.cc:1511] Processing CreateTablet for tablet 2df012888d964e41b1c7175829371b55 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:23.702251  7788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df012888d964e41b1c7175829371b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.705868  7785 tablet_service.cc:1511] Processing CreateTablet for tablet 48be1d6a553c490eb7df545e052bf194 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:23.706001  7859 tablet_service.cc:1511] Processing CreateTablet for tablet 48be1d6a553c490eb7df545e052bf194 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:23.706336  7711 tablet_service.cc:1511] Processing CreateTablet for tablet e0b0fa9345344e58b6da4eeb8ced9b49 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:23.708213  7784 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a7e5a2cbc44dc917cf605377dc94b (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:23.708907  7710 tablet_service.cc:1511] Processing CreateTablet for tablet 48be1d6a553c490eb7df545e052bf194 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:23.707667  7711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b0fa9345344e58b6da4eeb8ced9b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.710531  7787 tablet_service.cc:1511] Processing CreateTablet for tablet afa747ca87014f5c848ea05f8e51b6bb (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:23.711966  7710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be1d6a553c490eb7df545e052bf194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.712690  7858 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a7e5a2cbc44dc917cf605377dc94b (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:23.714007  7786 tablet_service.cc:1511] Processing CreateTablet for tablet e0b0fa9345344e58b6da4eeb8ced9b49 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:23.716285  7783 tablet_service.cc:1511] Processing CreateTablet for tablet c20f3e5b7f804f9ca36132fb645b91f7 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:23.720690  7787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa747ca87014f5c848ea05f8e51b6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.721658  7783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20f3e5b7f804f9ca36132fb645b91f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.722050  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b0fa9345344e58b6da4eeb8ced9b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.722347  7857 tablet_service.cc:1511] Processing CreateTablet for tablet c20f3e5b7f804f9ca36132fb645b91f7 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:23.723587  7784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a7e5a2cbc44dc917cf605377dc94b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.725001  7859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be1d6a553c490eb7df545e052bf194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.725580  7785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48be1d6a553c490eb7df545e052bf194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.726472  7786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b0fa9345344e58b6da4eeb8ced9b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.727138  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20f3e5b7f804f9ca36132fb645b91f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.730939  7709 tablet_service.cc:1511] Processing CreateTablet for tablet 7a0a7e5a2cbc44dc917cf605377dc94b (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:23.732479  7709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a7e5a2cbc44dc917cf605377dc94b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.740440  7858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a0a7e5a2cbc44dc917cf605377dc94b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.752486  7782 tablet_service.cc:1511] Processing CreateTablet for tablet bd133bbcaad6446caef836fed56d89e3 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:23.754024  7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd133bbcaad6446caef836fed56d89e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.758795  7708 tablet_service.cc:1511] Processing CreateTablet for tablet c20f3e5b7f804f9ca36132fb645b91f7 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:23.760234  7708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20f3e5b7f804f9ca36132fb645b91f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.764840  7707 tablet_service.cc:1511] Processing CreateTablet for tablet bd133bbcaad6446caef836fed56d89e3 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:23.766258  7707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd133bbcaad6446caef836fed56d89e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.769424  7856 tablet_service.cc:1511] Processing CreateTablet for tablet bd133bbcaad6446caef836fed56d89e3 (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:23.770864  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd133bbcaad6446caef836fed56d89e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.771787  7706 tablet_service.cc:1511] Processing CreateTablet for tablet 352aacdb915e4962b234ffec9089146d (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:23.774310  7706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aacdb915e4962b234ffec9089146d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.816435  7781 tablet_service.cc:1511] Processing CreateTablet for tablet 352aacdb915e4962b234ffec9089146d (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:23.817936  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aacdb915e4962b234ffec9089146d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.845422  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 352aacdb915e4962b234ffec9089146d (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:23.846974  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352aacdb915e4962b234ffec9089146d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.852849  7912 tablet_bootstrap.cc:492] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:23.854632  7710 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd35fb9ad734c4bbd68c8a8ab2d8b9b (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:23.856000  7710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd35fb9ad734c4bbd68c8a8ab2d8b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.864884  7913 tablet_bootstrap.cc:492] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:23.887086  7913 tablet_bootstrap.cc:654] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.890877  7912 tablet_bootstrap.cc:654] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.892269  7914 tablet_bootstrap.cc:492] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:23.896498  7781 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd35fb9ad734c4bbd68c8a8ab2d8b9b (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:23.893035  7860 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd35fb9ad734c4bbd68c8a8ab2d8b9b (DEFAULT_TABLE table=test-workload [id=3c890815d64f464a99d5b94dcec2b3fc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:23.898310  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd35fb9ad734c4bbd68c8a8ab2d8b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.898510  7913 tablet_bootstrap.cc:492] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:23.899021  7913 ts_tablet_manager.cc:1403] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:18:23.899264  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd35fb9ad734c4bbd68c8a8ab2d8b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:23.902067  7913 raft_consensus.cc:359] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.902876  7913 raft_consensus.cc:385] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.903195  7913 raft_consensus.cc:740] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.903846  7914 tablet_bootstrap.cc:654] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.904314  7913 consensus_queue.cc:260] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.913468  7897 heartbeater.cc:499] Master 127.29.5.190:42119 was elected leader, sending a full tablet report...
I20260709 13:18:23.914603  7913 ts_tablet_manager.cc:1434] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.015s	user 0.015s	sys 0.000s
I20260709 13:18:23.915900  7913 tablet_bootstrap.cc:492] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:23.939483  7912 tablet_bootstrap.cc:492] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:23.940208  7914 tablet_bootstrap.cc:492] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:23.940794  7914 ts_tablet_manager.cc:1403] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.010s
I20260709 13:18:23.943259  7913 tablet_bootstrap.cc:654] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.943933  7914 raft_consensus.cc:359] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.944792  7914 raft_consensus.cc:385] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.945104  7914 raft_consensus.cc:740] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.946094  7914 consensus_queue.cc:260] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.940181  7912 ts_tablet_manager.cc:1403] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.011s
I20260709 13:18:23.952194  7912 raft_consensus.cc:359] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:23.952982  7912 raft_consensus.cc:385] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.953333  7912 raft_consensus.cc:740] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.953408  7913 tablet_bootstrap.cc:492] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:23.954591  7913 ts_tablet_manager.cc:1403] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.013s
I20260709 13:18:23.955333  7823 heartbeater.cc:499] Master 127.29.5.190:42119 was elected leader, sending a full tablet report...
I20260709 13:18:23.954895  7912 consensus_queue.cc:260] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:23.958299  7913 raft_consensus.cc:359] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.959589  7913 raft_consensus.cc:385] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.960086  7913 raft_consensus.cc:740] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.960770  7748 heartbeater.cc:499] Master 127.29.5.190:42119 was elected leader, sending a full tablet report...
I20260709 13:18:23.961329  7912 ts_tablet_manager.cc:1434] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:18:23.960934  7913 consensus_queue.cc:260] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.962437  7912 tablet_bootstrap.cc:492] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:23.963626  7913 ts_tablet_manager.cc:1434] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:18:23.964839  7913 tablet_bootstrap.cc:492] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:23.969089  7912 tablet_bootstrap.cc:654] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.955307  7914 ts_tablet_manager.cc:1434] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:18:23.971340  7913 tablet_bootstrap.cc:654] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.971550  7914 tablet_bootstrap.cc:492] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:23.981491  7912 tablet_bootstrap.cc:492] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:23.981575  7914 tablet_bootstrap.cc:654] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.983850  7912 ts_tablet_manager.cc:1403] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 13:18:23.984773  7913 tablet_bootstrap.cc:492] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:23.985523  7913 ts_tablet_manager.cc:1403] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:18:23.986922  7912 raft_consensus.cc:359] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.987797  7912 raft_consensus.cc:385] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.988117  7912 raft_consensus.cc:740] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.988494  7916 raft_consensus.cc:493] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.988914  7912 consensus_queue.cc:260] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.989005  7916 raft_consensus.cc:515] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:23.989223  7913 raft_consensus.cc:359] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:23.990783  7913 raft_consensus.cc:385] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.991080  7913 raft_consensus.cc:740] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.991374  7912 ts_tablet_manager.cc:1434] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:23.992411  7912 tablet_bootstrap.cc:492] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:23.994376  7916 leader_election.cc:290] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:23.998812  7912 tablet_bootstrap.cc:654] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.013470  7723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.014575  7723 raft_consensus.cc:2468] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:24.016412  7835 leader_election.cc:304] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.017498  7916 raft_consensus.cc:2804] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.017879  7916 raft_consensus.cc:493] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.018222  7916 raft_consensus.cc:3060] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.018154  7913 consensus_queue.cc:260] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:24.020710  7921 raft_consensus.cc:493] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.021406  7921 raft_consensus.cc:515] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:24.024005  7913 ts_tablet_manager.cc:1434] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:18:24.029850  7916 raft_consensus.cc:515] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.032370  7916 leader_election.cc:290] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:24.032902  7723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:24.033542  7723 raft_consensus.cc:3060] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.035029  7914 tablet_bootstrap.cc:492] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.035573  7914 ts_tablet_manager.cc:1403] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.011s
I20260709 13:18:24.038460  7914 raft_consensus.cc:359] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.039139  7914 raft_consensus.cc:385] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.039443  7914 raft_consensus.cc:740] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.040275  7914 consensus_queue.cc:260] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.040681  7921 leader_election.cc:290] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:24.044206  7914 ts_tablet_manager.cc:1434] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:24.045202  7914 tablet_bootstrap.cc:492] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:24.045413  7723 raft_consensus.cc:2468] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:24.046681  7835 leader_election.cc:304] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.047487  7916 raft_consensus.cc:2804] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.048020  7916 raft_consensus.cc:697] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:24.048871  7916 consensus_queue.cc:237] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.047487  7913 tablet_bootstrap.cc:492] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:24.054891  7912 tablet_bootstrap.cc:492] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.058966  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:24.060809  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.062187  7912 ts_tablet_manager.cc:1403] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.070s	user 0.037s	sys 0.025s
W20260709 13:18:24.064105  7836 leader_election.cc:343] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:24.065292  7836 leader_election.cc:343] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.065194  7912 raft_consensus.cc:359] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.066105  7912 raft_consensus.cc:385] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.066480  7912 raft_consensus.cc:740] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.067695  7914 tablet_bootstrap.cc:654] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.067442  7912 consensus_queue.cc:260] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.069526  7921 raft_consensus.cc:493] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.069998  7921 raft_consensus.cc:515] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.071449  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df012888d964e41b1c7175829371b55" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
W20260709 13:18:24.073289  7687 leader_election.cc:343] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.073706  7913 tablet_bootstrap.cc:654] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.073814  7921 leader_election.cc:290] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.074960  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be1d6a553c490eb7df545e052bf194" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
W20260709 13:18:24.076119  7687 leader_election.cc:343] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.081194  7914 tablet_bootstrap.cc:492] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.081763  7914 ts_tablet_manager.cc:1403] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.004s
I20260709 13:18:24.081791  7912 ts_tablet_manager.cc:1434] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:18:24.082959  7912 tablet_bootstrap.cc:492] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:24.086576  7913 tablet_bootstrap.cc:492] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:24.087168  7913 ts_tablet_manager.cc:1403] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.003s
I20260709 13:18:24.088073  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df012888d964e41b1c7175829371b55" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.088825  7872 raft_consensus.cc:2468] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:24.088963  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be1d6a553c490eb7df545e052bf194" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.089995  7871 raft_consensus.cc:2468] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:24.091322  7689 leader_election.cc:304] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:24.092060  7913 raft_consensus.cc:359] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.092609  7921 raft_consensus.cc:2804] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.092890  7913 raft_consensus.cc:385] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.092402  7618 catalog_manager.cc:5697] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.093267  7921 raft_consensus.cc:493] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.093315  7913 raft_consensus.cc:740] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.089116  7914 raft_consensus.cc:359] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.094007  7921 raft_consensus.cc:3060] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.094074  7914 raft_consensus.cc:385] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.095118  7914 raft_consensus.cc:740] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.095782  7912 tablet_bootstrap.cc:654] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.096128  7914 consensus_queue.cc:260] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.101693  7914 ts_tablet_manager.cc:1434] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.006s
I20260709 13:18:24.103098  7921 raft_consensus.cc:515] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.104082  7913 consensus_queue.cc:260] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.106099  7921 leader_election.cc:290] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.106383  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be1d6a553c490eb7df545e052bf194" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.107244  7798 raft_consensus.cc:3060] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.113461  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48be1d6a553c490eb7df545e052bf194" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.114136  7872 raft_consensus.cc:3060] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.114926  7689 leader_election.cc:304] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:24.116367  7921 raft_consensus.cc:2804] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.116791  7921 raft_consensus.cc:493] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.117182  7921 raft_consensus.cc:3060] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.118263  7798 raft_consensus.cc:2468] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.121454  7872 raft_consensus.cc:2468] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.122715  7689 leader_election.cc:304] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.123700  7932 raft_consensus.cc:2804] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.124725  7921 raft_consensus.cc:515] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:24.128981  7914 tablet_bootstrap.cc:492] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:24.129617  7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df012888d964e41b1c7175829371b55" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.131229  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df012888d964e41b1c7175829371b55" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.132045  7871 raft_consensus.cc:3060] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:24.136859  7687 leader_election.cc:343] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.142968  7932 raft_consensus.cc:697] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:24.143487  7921 leader_election.cc:290] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Requested vote from peers ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:24.143249  7871 raft_consensus.cc:2468] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.144001  7932 consensus_queue.cc:237] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.145493  7689 leader_election.cc:304] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:24.146481  7913 ts_tablet_manager.cc:1434] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.004s
I20260709 13:18:24.146775  7921 raft_consensus.cc:2804] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.153924  7913 tablet_bootstrap.cc:492] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:24.154573  7912 tablet_bootstrap.cc:492] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.155139  7912 ts_tablet_manager.cc:1403] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.072s	user 0.031s	sys 0.029s
I20260709 13:18:24.158182  7912 raft_consensus.cc:359] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.159088  7912 raft_consensus.cc:385] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.158011  7618 catalog_manager.cc:5697] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 1 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.159384  7912 raft_consensus.cc:740] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.160097  7921 raft_consensus.cc:697] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:24.161291  7913 tablet_bootstrap.cc:654] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.161011  7912 consensus_queue.cc:260] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.161211  7921 consensus_queue.cc:237] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:24.163898  7912 ts_tablet_manager.cc:1434] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.006s
I20260709 13:18:24.165081  7912 tablet_bootstrap.cc:492] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:24.168460  7914 tablet_bootstrap.cc:654] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.172930  7912 tablet_bootstrap.cc:654] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.182238  7913 tablet_bootstrap.cc:492] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:24.182991  7913 ts_tablet_manager.cc:1403] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.012s
I20260709 13:18:24.184476  7618 catalog_manager.cc:5697] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 1 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.187753  7920 raft_consensus.cc:493] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.186942  7913 raft_consensus.cc:359] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.188522  7920 raft_consensus.cc:515] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.190912  7914 tablet_bootstrap.cc:492] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.191036  7912 tablet_bootstrap.cc:492] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.191484  7914 ts_tablet_manager.cc:1403] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.089s	user 0.022s	sys 0.006s
I20260709 13:18:24.191659  7912 ts_tablet_manager.cc:1403] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:18:24.188539  7913 raft_consensus.cc:385] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.193341  7913 raft_consensus.cc:740] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.194196  7913 consensus_queue.cc:260] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.194584  7914 raft_consensus.cc:359] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.195369  7914 raft_consensus.cc:385] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.195676  7914 raft_consensus.cc:740] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.196717  7913 ts_tablet_manager.cc:1434] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:18:24.196398  7914 consensus_queue.cc:260] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.199819  7912 raft_consensus.cc:359] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.200626  7912 raft_consensus.cc:385] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.200917  7912 raft_consensus.cc:740] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.201680  7912 consensus_queue.cc:260] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.203867  7912 ts_tablet_manager.cc:1434] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:18:24.204311  7920 leader_election.cc:290] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.204882  7912 tablet_bootstrap.cc:492] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:24.212054  7912 tablet_bootstrap.cc:654] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:24.214123  7669 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:24.216116  7913 tablet_bootstrap.cc:492] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:24.218179  7912 tablet_bootstrap.cc:492] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.218906  7912 ts_tablet_manager.cc:1403] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:18:24.223299  7913 tablet_bootstrap.cc:654] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.222878  7912 raft_consensus.cc:359] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.223889  7912 raft_consensus.cc:385] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.224316  7912 raft_consensus.cc:740] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.225478  7912 consensus_queue.cc:260] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.228509  7912 ts_tablet_manager.cc:1434] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 13:18:24.229970  7912 tablet_bootstrap.cc:492] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:24.238742  7912 tablet_bootstrap.cc:654] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.244112  7920 raft_consensus.cc:493] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.244665  7920 raft_consensus.cc:515] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.246930  7920 leader_election.cc:290] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.249143  7723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd133bbcaad6446caef836fed56d89e3" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.249575  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.249866  7723 raft_consensus.cc:2468] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:24.250473  7722 raft_consensus.cc:2393] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57039b71674b4719abbef40a29a8ec03 in current term 1: Already voted for candidate ad5bcb3e418842f998b2f9aa622c7527 in this term.
I20260709 13:18:24.251928  7761 leader_election.cc:304] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.253029  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd133bbcaad6446caef836fed56d89e3" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.253696  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.253705  7871 raft_consensus.cc:2468] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:24.254084  7914 ts_tablet_manager.cc:1434] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.062s	user 0.025s	sys 0.030s
I20260709 13:18:24.254913  7912 tablet_bootstrap.cc:492] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.254851  7945 raft_consensus.cc:2804] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.255503  7945 raft_consensus.cc:493] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.255646  7912 ts_tablet_manager.cc:1403] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:18:24.255875  7945 raft_consensus.cc:3060] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.256098  7764 leader_election.cc:304] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03; no voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:24.257299  7920 raft_consensus.cc:3060] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.258668  7912 raft_consensus.cc:359] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.259415  7912 raft_consensus.cc:385] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.259701  7912 raft_consensus.cc:740] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.260535  7912 consensus_queue.cc:260] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.261739  7914 tablet_bootstrap.cc:492] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:24.264479  7920 raft_consensus.cc:2749] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.265334  7912 ts_tablet_manager.cc:1434] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:24.263453  7945 raft_consensus.cc:515] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.265908  7913 tablet_bootstrap.cc:492] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:24.266390  7912 tablet_bootstrap.cc:492] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:24.266446  7913 ts_tablet_manager.cc:1403] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:18:24.268374  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd133bbcaad6446caef836fed56d89e3" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:24.268989  7722 raft_consensus.cc:3060] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.271102  7913 raft_consensus.cc:359] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.271888  7913 raft_consensus.cc:385] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.272193  7913 raft_consensus.cc:740] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.272922  7914 tablet_bootstrap.cc:654] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.273015  7913 consensus_queue.cc:260] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.274792  7912 tablet_bootstrap.cc:654] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.278527  7913 ts_tablet_manager.cc:1434] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:24.279610  7913 tablet_bootstrap.cc:492] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:24.280527  7722 raft_consensus.cc:2468] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:24.283141  7761 leader_election.cc:304] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.284025  7920 raft_consensus.cc:2804] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.286041  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd133bbcaad6446caef836fed56d89e3" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.286932  7872 raft_consensus.cc:3060] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.290249  7945 leader_election.cc:290] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.294845  7914 tablet_bootstrap.cc:492] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.295529  7921 raft_consensus.cc:493] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.296285  7921 raft_consensus.cc:515] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.299799  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:24.300457  7798 raft_consensus.cc:2468] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:24.300802  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.301457  7871 raft_consensus.cc:2468] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:24.301698  7687 leader_election.cc:304] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.302631  7938 raft_consensus.cc:2804] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.303124  7938 raft_consensus.cc:493] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.303870  7938 raft_consensus.cc:3060] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.307631  7920 raft_consensus.cc:697] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:24.308086  7921 leader_election.cc:290] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.310704  7920 consensus_queue.cc:237] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.314579  7913 tablet_bootstrap.cc:654] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.317418  7938 raft_consensus.cc:515] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.295529  7914 ts_tablet_manager.cc:1403] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.011s
I20260709 13:18:24.303027  7872 raft_consensus.cc:2468] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:24.362779  7912 tablet_bootstrap.cc:492] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.364697  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.377070  7912 ts_tablet_manager.cc:1403] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.111s	user 0.034s	sys 0.035s
I20260709 13:18:24.377234  7798 raft_consensus.cc:3060] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.376184  7619 catalog_manager.cc:5697] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.367636  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.379674  7871 raft_consensus.cc:3060] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.384198  7912 raft_consensus.cc:359] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.385418  7912 raft_consensus.cc:385] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.385824  7912 raft_consensus.cc:740] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.386883  7912 consensus_queue.cc:260] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.389519  7912 ts_tablet_manager.cc:1434] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:18:24.395668  7912 tablet_bootstrap.cc:492] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:24.324730  7914 raft_consensus.cc:359] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.398916  7914 raft_consensus.cc:385] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.399330  7914 raft_consensus.cc:740] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.325389  7938 leader_election.cc:290] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.402714  7913 tablet_bootstrap.cc:492] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:24.403934  7913 ts_tablet_manager.cc:1403] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.009s
I20260709 13:18:24.405149  7912 tablet_bootstrap.cc:654] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.410461  7798 raft_consensus.cc:2468] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.415207  7687 leader_election.cc:304] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.417135  7938 raft_consensus.cc:2804] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.417016  7913 raft_consensus.cc:359] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.418459  7938 raft_consensus.cc:697] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:24.418951  7913 raft_consensus.cc:385] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.419503  7913 raft_consensus.cc:740] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.420176  7914 consensus_queue.cc:260] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.420810  7913 consensus_queue.cc:260] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.425210  7914 ts_tablet_manager.cc:1434] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.105s	user 0.012s	sys 0.001s
I20260709 13:18:24.425851  7913 ts_tablet_manager.cc:1434] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 13:18:24.420532  7938 consensus_queue.cc:237] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.428975  7913 tablet_bootstrap.cc:492] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:24.434362  7921 raft_consensus.cc:493] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.435217  7921 raft_consensus.cc:515] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.420231  7871 raft_consensus.cc:2468] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.440702  7921 leader_election.cc:290] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.442200  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
W20260709 13:18:24.443982  7689 leader_election.cc:343] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.445225  7913 tablet_bootstrap.cc:654] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.445964  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:24.448156  7914 tablet_bootstrap.cc:492] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
W20260709 13:18:24.449190  7687 leader_election.cc:343] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.449723  7687 leader_election.cc:304] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:24.450201  7912 tablet_bootstrap.cc:492] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:24.450708  7912 ts_tablet_manager.cc:1403] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.020s
I20260709 13:18:24.450904  7921 raft_consensus.cc:2749] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.453893  7912 raft_consensus.cc:359] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.454617  7912 raft_consensus.cc:385] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.454911  7912 raft_consensus.cc:740] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.455232  7916 consensus_queue.cc:1048] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.455669  7912 consensus_queue.cc:260] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.459067  7914 tablet_bootstrap.cc:654] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.461706  7912 ts_tablet_manager.cc:1434] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:18:24.461967  7921 raft_consensus.cc:493] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.464232  7921 raft_consensus.cc:515] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.468868  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.469596  7921 leader_election.cc:290] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
W20260709 13:18:24.470527  7689 leader_election.cc:343] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.470434  7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
W20260709 13:18:24.473067  7687 leader_election.cc:343] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.473568  7687 leader_election.cc:304] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:24.474727  7938 raft_consensus.cc:2749] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.479393  7913 tablet_bootstrap.cc:492] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:24.480120  7913 ts_tablet_manager.cc:1403] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.000s
I20260709 13:18:24.482851  7618 catalog_manager.cc:5697] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 1 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.488919  7913 raft_consensus.cc:359] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.489670  7913 raft_consensus.cc:385] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.489931  7913 raft_consensus.cc:740] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.490654  7913 consensus_queue.cc:260] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.493356  7913 ts_tablet_manager.cc:1434] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:18:24.497860  7913 tablet_bootstrap.cc:492] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:24.499176  7914 tablet_bootstrap.cc:492] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.499881  7914 ts_tablet_manager.cc:1403] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.014s
I20260709 13:18:24.504778  7914 raft_consensus.cc:359] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:24.505537  7914 raft_consensus.cc:385] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.505832  7914 raft_consensus.cc:740] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.506155  7913 tablet_bootstrap.cc:654] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.506649  7914 consensus_queue.cc:260] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:24.507349  7916 consensus_queue.cc:1048] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.514225  7914 ts_tablet_manager.cc:1434] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:18:24.516325  7914 tablet_bootstrap.cc:492] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:24.533463  7914 tablet_bootstrap.cc:654] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.535344  7913 tablet_bootstrap.cc:492] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:24.536021  7913 ts_tablet_manager.cc:1403] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.024s
I20260709 13:18:24.539039  7913 raft_consensus.cc:359] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.539561  7914 tablet_bootstrap.cc:492] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.539817  7913 raft_consensus.cc:385] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.540221  7913 raft_consensus.cc:740] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.540275  7914 ts_tablet_manager.cc:1403] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:18:24.540894  7913 consensus_queue.cc:260] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.542518  7913 ts_tablet_manager.cc:1434] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:24.543692  7914 raft_consensus.cc:359] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.544512  7914 raft_consensus.cc:385] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.544826  7914 raft_consensus.cc:740] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.545696  7914 consensus_queue.cc:260] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.547569  7914 ts_tablet_manager.cc:1434] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:24.548951  7914 tablet_bootstrap.cc:492] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:24.556069  7938 consensus_queue.cc:1048] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.556620  7914 tablet_bootstrap.cc:654] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.569242  7920 raft_consensus.cc:493] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.569797  7920 raft_consensus.cc:515] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.572644  7920 leader_election.cc:290] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.574378  7921 consensus_queue.cc:1048] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.580701  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a7e5a2cbc44dc917cf605377dc94b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.581193  7936 consensus_queue.cc:1048] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.581492  7722 raft_consensus.cc:2468] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:24.587512  7761 leader_election.cc:304] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.587637  7914 tablet_bootstrap.cc:492] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.588461  7914 ts_tablet_manager.cc:1403] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.011s
I20260709 13:18:24.588603  7952 raft_consensus.cc:2804] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.589093  7952 raft_consensus.cc:493] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.589493  7952 raft_consensus.cc:3060] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.592214  7914 raft_consensus.cc:359] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.593190  7914 raft_consensus.cc:385] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.593505  7914 raft_consensus.cc:740] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.594609  7914 consensus_queue.cc:260] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.588950  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a7e5a2cbc44dc917cf605377dc94b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.596248  7871 raft_consensus.cc:2468] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:24.597605  7914 ts_tablet_manager.cc:1434] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:18:24.599422  7914 tablet_bootstrap.cc:492] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:24.603674  7952 raft_consensus.cc:515] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.605686  7914 tablet_bootstrap.cc:654] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.606611  7921 raft_consensus.cc:493] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.607209  7921 raft_consensus.cc:515] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.611713  7914 tablet_bootstrap.cc:492] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:24.611820  7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:24.612293  7914 ts_tablet_manager.cc:1403] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.009s
I20260709 13:18:24.612553  7797 raft_consensus.cc:2468] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:24.613706  7687 leader_election.cc:304] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.614097  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a7e5a2cbc44dc917cf605377dc94b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.613705  7921 leader_election.cc:290] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.615993  7871 raft_consensus.cc:3060] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.617031  7914 raft_consensus.cc:359] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.617738  7914 raft_consensus.cc:385] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.617993  7914 raft_consensus.cc:740] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.618709  7914 consensus_queue.cc:260] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.619966  7927 raft_consensus.cc:493] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.620488  7927 raft_consensus.cc:515] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.621104  7914 ts_tablet_manager.cc:1434] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:24.622052  7921 raft_consensus.cc:2804] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.622462  7921 raft_consensus.cc:493] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.622793  7921 raft_consensus.cc:3060] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.622928  7927 leader_election.cc:290] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:24.623299  7797 raft_consensus.cc:3060] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.619982  7916 raft_consensus.cc:493] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.624303  7916 raft_consensus.cc:515] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.605720  7952 leader_election.cc:290] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.624517  7871 raft_consensus.cc:2468] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:24.626049  7764 leader_election.cc:304] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:24.626453  7916 leader_election.cc:290] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:24.626924  7952 raft_consensus.cc:2804] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.629746  7723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.630462  7723 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:24.631685  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.606612  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a0a7e5a2cbc44dc917cf605377dc94b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:24.631456  7921 raft_consensus.cc:515] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.632740  7722 raft_consensus.cc:3060] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.633281  7721 raft_consensus.cc:2393] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad5bcb3e418842f998b2f9aa622c7527 in current term 1: Already voted for candidate e06813d9b94c44bc8010170059affc2f in this term.
I20260709 13:18:24.634742  7952 raft_consensus.cc:697] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:24.635794  7952 consensus_queue.cc:237] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.636746  7870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.636976  7835 leader_election.cc:304] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.637362  7870 raft_consensus.cc:3060] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.639317  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.641924  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:24.642496  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:24.643267  7796 raft_consensus.cc:2468] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:24.641913  7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.643185  7938 consensus_queue.cc:1048] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.644340  7797 raft_consensus.cc:3060] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.642608  7798 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:24.646071  7870 raft_consensus.cc:2468] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.645993  7836 leader_election.cc:304] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: e06813d9b94c44bc8010170059affc2f
I20260709 13:18:24.647464  7916 raft_consensus.cc:2804] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.647835  7916 raft_consensus.cc:493] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.648193  7916 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.652225  7797 raft_consensus.cc:2468] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:24.654139  7921 leader_election.cc:290] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.654361  7687 leader_election.cc:304] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.656179  7921 raft_consensus.cc:2804] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.656663  7921 raft_consensus.cc:697] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:24.656993  7916 raft_consensus.cc:515] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.657542  7921 consensus_queue.cc:237] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.656770  7971 raft_consensus.cc:2764] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:18:24.659909  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:24.660523  7721 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.665393  7722 raft_consensus.cc:2468] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:24.668604  7916 leader_election.cc:290] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:24.669761  7797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.670456  7797 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.672606  7721 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:24.674266  7835 leader_election.cc:304] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.675509  7916 raft_consensus.cc:2804] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.677110  7916 raft_consensus.cc:697] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:24.679282  7797 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:24.680162  7916 consensus_queue.cc:237] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.680663  7618 catalog_manager.cc:5697] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.691992  7619 catalog_manager.cc:5697] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 1 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.692449  7621 catalog_manager.cc:5697] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.700594  7952 raft_consensus.cc:493] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.701195  7952 raft_consensus.cc:515] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.703261  7952 leader_election.cc:290] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.704038  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:24.704778  7721 raft_consensus.cc:2468] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:24.705044  7870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:24.705660  7870 raft_consensus.cc:2468] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:24.705998  7761 leader_election.cc:304] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.706880  7952 raft_consensus.cc:2804] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.707192  7952 raft_consensus.cc:493] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.707473  7952 raft_consensus.cc:3060] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.712658  7952 raft_consensus.cc:515] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.714293  7952 leader_election.cc:290] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.715093  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:24.715219  7870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.715628  7721 raft_consensus.cc:3060] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.715847  7870 raft_consensus.cc:3060] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.720680  7721 raft_consensus.cc:2468] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:24.721041  7870 raft_consensus.cc:2468] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:24.721688  7761 leader_election.cc:304] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.722544  7952 raft_consensus.cc:2804] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.723034  7952 raft_consensus.cc:697] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:24.723851  7952 consensus_queue.cc:237] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.730464  7621 catalog_manager.cc:5697] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.737171  7952 consensus_queue.cc:1048] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.749505  7945 consensus_queue.cc:1048] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.927699  7870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
mode: GRACEFUL
new_leader_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:41062
I20260709 13:18:24.928370  7870 raft_consensus.cc:606] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Received request to transfer leadership to TS e06813d9b94c44bc8010170059affc2f
I20260709 13:18:24.941727  7971 raft_consensus.cc:993] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: : Instructing follower e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:24.942234  7971 raft_consensus.cc:1081] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Signalling peer e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:24.942097  7870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
mode: GRACEFUL
new_leader_uuid: "57039b71674b4719abbef40a29a8ec03"
 from {username='slave'} at 127.0.0.1:41062
I20260709 13:18:24.942935  7870 raft_consensus.cc:606] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Received request to transfer leadership to TS 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:24.944271  7721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:18:24.944908  7721 raft_consensus.cc:493] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:24.945269  7721 raft_consensus.cc:3060] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.952203  7721 raft_consensus.cc:515] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.954736  7721 leader_election.cc:290] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:24.955044  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:24.955379  7870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afa747ca87014f5c848ea05f8e51b6bb" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:24.955708  7798 raft_consensus.cc:3060] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.956063  7870 raft_consensus.cc:3055] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:24.956446  7870 raft_consensus.cc:740] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:24.957365  7870 consensus_queue.cc:260] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.958668  7870 raft_consensus.cc:3060] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:24.961750  7721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "352aacdb915e4962b234ffec9089146d"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
mode: GRACEFUL
new_leader_uuid: "57039b71674b4719abbef40a29a8ec03"
 from {username='slave'} at 127.0.0.1:42230
I20260709 13:18:24.962388  7721 raft_consensus.cc:606] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Received request to transfer leadership to TS 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:24.962673  7798 raft_consensus.cc:2468] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:24.963814  7687 leader_election.cc:304] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:24.964609  7921 raft_consensus.cc:2804] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:24.965035  7921 raft_consensus.cc:697] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:24.965857  7921 consensus_queue.cc:237] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:24.967908  7870 raft_consensus.cc:2468] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:24.973605  7619 catalog_manager.cc:5697] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 1 to 2, leader changed from ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131) to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 2 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.976500  7921 consensus_queue.cc:1048] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.982358  7797 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b"
dest_uuid: "57039b71674b4719abbef40a29a8ec03"
mode: GRACEFUL
new_leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:18:24.983026  7797 raft_consensus.cc:606] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Received request to transfer leadership to TS ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:24.990250  7921 consensus_queue.cc:1048] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.043850  7945 consensus_queue.cc:1048] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.054518  7920 consensus_queue.cc:1048] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.070791  7971 consensus_queue.cc:1048] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.077428  7916 raft_consensus.cc:993] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: : Instructing follower 57039b71674b4719abbef40a29a8ec03 to start an election
I20260709 13:18:25.077945  7927 raft_consensus.cc:1081] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Signalling peer 57039b71674b4719abbef40a29a8ec03 to start an election
I20260709 13:18:25.079596  7797 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7"
dest_uuid: "57039b71674b4719abbef40a29a8ec03"
 from {username='slave'} at 127.0.0.1:50256
I20260709 13:18:25.080206  7797 raft_consensus.cc:493] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:25.080578  7797 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.083277  7927 consensus_queue.cc:1048] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.090749  7797 raft_consensus.cc:515] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.091188  7932 consensus_queue.cc:1048] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.091981  7798 raft_consensus.cc:1240] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Rejecting Update request from peer ad5bcb3e418842f998b2f9aa622c7527 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:25.093326  7797 leader_election.cc:290] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 2 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:25.094481  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:25.095103  7872 raft_consensus.cc:3055] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:25.095448  7872 raft_consensus.cc:740] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:25.096237  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:25.096949  7721 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.096418  7872 consensus_queue.cc:260] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.098760  7872 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.102783  7932 raft_consensus.cc:993] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: : Instructing follower 57039b71674b4719abbef40a29a8ec03 to start an election
I20260709 13:18:25.103932  7936 raft_consensus.cc:1081] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Signalling peer 57039b71674b4719abbef40a29a8ec03 to start an election
I20260709 13:18:25.106619  7721 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 2.
I20260709 13:18:25.108441  7872 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 2.
I20260709 13:18:25.109655  7764 leader_election.cc:304] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:25.109799  7932 consensus_queue.cc:1048] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.110569  7920 raft_consensus.cc:2804] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:25.111075  7920 raft_consensus.cc:697] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:25.111938  7920 consensus_queue.cc:237] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.117034  7796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "352aacdb915e4962b234ffec9089146d"
dest_uuid: "57039b71674b4719abbef40a29a8ec03"
 from {username='slave'} at 127.0.0.1:50266
I20260709 13:18:25.117750  7796 raft_consensus.cc:493] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:25.118146  7796 raft_consensus.cc:3060] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.125590  7796 raft_consensus.cc:515] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.127533  7796 leader_election.cc:290] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 2 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:25.128172  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:25.128894  7721 raft_consensus.cc:3055] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:25.129222  7721 raft_consensus.cc:740] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:25.129643  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352aacdb915e4962b234ffec9089146d" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:25.130276  7872 raft_consensus.cc:3060] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.130021  7721 consensus_queue.cc:260] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.131250  7721 raft_consensus.cc:3060] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.137750  7872 raft_consensus.cc:2468] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 2.
I20260709 13:18:25.137249  7620 catalog_manager.cc:5697] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 1 to 2, leader changed from ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131) to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.138545  7721 raft_consensus.cc:2468] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 2.
I20260709 13:18:25.139241  7764 leader_election.cc:304] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:25.140241  7920 raft_consensus.cc:2804] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:25.140743  7920 raft_consensus.cc:697] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:25.141589  7920 consensus_queue.cc:237] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.154541  7621 catalog_manager.cc:5697] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 1 to 2, leader changed from e06813d9b94c44bc8010170059affc2f (127.29.5.129) to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.157589  7920 consensus_queue.cc:1048] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.165642  7952 raft_consensus.cc:993] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: : Instructing follower ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:25.166131  7952 raft_consensus.cc:1081] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Signalling peer ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:25.168746  7872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:41050
I20260709 13:18:25.170701  7872 raft_consensus.cc:493] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:25.171120  7872 raft_consensus.cc:3060] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.172928  7920 consensus_queue.cc:1048] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.177892  7872 raft_consensus.cc:515] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.182305  7872 leader_election.cc:290] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:25.183903  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:25.184616  7721 raft_consensus.cc:3060] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.185640  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd35fb9ad734c4bbd68c8a8ab2d8b9b" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:25.186342  7796 raft_consensus.cc:3055] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:25.186668  7796 raft_consensus.cc:740] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:25.187650  7796 consensus_queue.cc:260] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.189371  7796 raft_consensus.cc:3060] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:25.192632  7721 raft_consensus.cc:2468] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 2.
I20260709 13:18:25.193735  7835 leader_election.cc:304] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:25.194640  7927 raft_consensus.cc:2804] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:25.195116  7927 raft_consensus.cc:697] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 2 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:25.195215  7796 raft_consensus.cc:2468] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 2.
I20260709 13:18:25.195948  7927 consensus_queue.cc:237] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:25.202867  7621 catalog_manager.cc:5697] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 1 to 2, leader changed from 57039b71674b4719abbef40a29a8ec03 (127.29.5.130) to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.424304  7796 raft_consensus.cc:1275] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.425542  7932 consensus_queue.cc:1048] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.433637  7872 raft_consensus.cc:1275] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.436345  7921 consensus_queue.cc:1048] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.550702  7721 raft_consensus.cc:1275] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Refusing update from remote peer 57039b71674b4719abbef40a29a8ec03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.552184  7920 consensus_queue.cc:1048] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.560003  7870 raft_consensus.cc:1275] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer 57039b71674b4719abbef40a29a8ec03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.561739  7952 consensus_queue.cc:1048] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.572400  7870 raft_consensus.cc:1275] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer 57039b71674b4719abbef40a29a8ec03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.573603  7952 consensus_queue.cc:1048] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.582042  7721 raft_consensus.cc:1275] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Refusing update from remote peer 57039b71674b4719abbef40a29a8ec03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.583868  7952 consensus_queue.cc:1048] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.607461  7721 raft_consensus.cc:1275] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.608783  7927 consensus_queue.cc:1048] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:25.616755  7796 raft_consensus.cc:1275] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:25.618394  7916 consensus_queue.cc:1048] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:28.017490  7621 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54208:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:28.019896  7621 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:28.072803  7708 tablet_service.cc:1511] Processing CreateTablet for tablet be33cc1f36f34068b484ab7216318820 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:28.073642  7781 tablet_service.cc:1511] Processing CreateTablet for tablet be33cc1f36f34068b484ab7216318820 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:28.074419  7708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be33cc1f36f34068b484ab7216318820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.075210  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be33cc1f36f34068b484ab7216318820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.075336  7860 tablet_service.cc:1511] Processing CreateTablet for tablet be33cc1f36f34068b484ab7216318820 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:18:28.076767  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be33cc1f36f34068b484ab7216318820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.077611  7783 tablet_service.cc:1511] Processing CreateTablet for tablet 085dea7e7e414db1b8b056d310f950b5 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:28.079067  7783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085dea7e7e414db1b8b056d310f950b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.085853  7709 tablet_service.cc:1511] Processing CreateTablet for tablet 085dea7e7e414db1b8b056d310f950b5 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:28.087158  7709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085dea7e7e414db1b8b056d310f950b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.101768  7862 tablet_service.cc:1511] Processing CreateTablet for tablet 085dea7e7e414db1b8b056d310f950b5 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:18:28.103246  7862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085dea7e7e414db1b8b056d310f950b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.104454  7706 tablet_service.cc:1511] Processing CreateTablet for tablet a4029bb503654a3abfcebe96c447c872 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:28.105955  7706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4029bb503654a3abfcebe96c447c872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.108958  7788 tablet_service.cc:1511] Processing CreateTablet for tablet a4029bb503654a3abfcebe96c447c872 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:28.110360  7788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4029bb503654a3abfcebe96c447c872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.113142  7857 tablet_service.cc:1511] Processing CreateTablet for tablet a4029bb503654a3abfcebe96c447c872 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:18:28.114522  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4029bb503654a3abfcebe96c447c872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.116478  8008 tablet_bootstrap.cc:492] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.118930  7710 tablet_service.cc:1511] Processing CreateTablet for tablet f0679999514447789c20706e56d7a4f6 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:28.125914  7784 tablet_service.cc:1511] Processing CreateTablet for tablet f0679999514447789c20706e56d7a4f6 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:28.126579  7710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0679999514447789c20706e56d7a4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.127313  7784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0679999514447789c20706e56d7a4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.130699  7707 tablet_service.cc:1511] Processing CreateTablet for tablet a42323c88a944b76bfca0602a8d24650 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:28.131037  7860 tablet_service.cc:1511] Processing CreateTablet for tablet f0679999514447789c20706e56d7a4f6 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:18:28.134001  7785 tablet_service.cc:1511] Processing CreateTablet for tablet a42323c88a944b76bfca0602a8d24650 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:28.135241  7707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42323c88a944b76bfca0602a8d24650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.135833  7785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42323c88a944b76bfca0602a8d24650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.140796  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0679999514447789c20706e56d7a4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.159983  7858 tablet_service.cc:1511] Processing CreateTablet for tablet a42323c88a944b76bfca0602a8d24650 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:18:28.161504  7858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42323c88a944b76bfca0602a8d24650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.166353  8008 tablet_bootstrap.cc:654] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.168744  7711 tablet_service.cc:1511] Processing CreateTablet for tablet dfa8c6fe7865458fa2972dc8acd8b18d (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:28.170229  7711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa8c6fe7865458fa2972dc8acd8b18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.176246  7787 tablet_service.cc:1511] Processing CreateTablet for tablet dfa8c6fe7865458fa2972dc8acd8b18d (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:28.177704  7787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa8c6fe7865458fa2972dc8acd8b18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.198021  8008 tablet_bootstrap.cc:492] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.198735  8008 ts_tablet_manager.cc:1403] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.005s
I20260709 13:18:28.199754  7860 tablet_service.cc:1511] Processing CreateTablet for tablet dfa8c6fe7865458fa2972dc8acd8b18d (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:18:28.201467  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa8c6fe7865458fa2972dc8acd8b18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.205147  8008 raft_consensus.cc:359] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.208343  8008 raft_consensus.cc:385] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.208726  8008 raft_consensus.cc:740] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.209636  8008 consensus_queue.cc:260] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.216053  8008 ts_tablet_manager.cc:1434] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:18:28.217268  8008 tablet_bootstrap.cc:492] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.224709  8009 tablet_bootstrap.cc:492] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.232074  8008 tablet_bootstrap.cc:654] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.231899  7783 tablet_service.cc:1511] Processing CreateTablet for tablet d0562f88033c404baf7f3ba0bd0b6d63 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:28.233911  7783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0562f88033c404baf7f3ba0bd0b6d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.237259  8007 tablet_bootstrap.cc:492] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.239284  7858 tablet_service.cc:1511] Processing CreateTablet for tablet d0562f88033c404baf7f3ba0bd0b6d63 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:28.240690  7858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0562f88033c404baf7f3ba0bd0b6d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.240756  7709 tablet_service.cc:1511] Processing CreateTablet for tablet d0562f88033c404baf7f3ba0bd0b6d63 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:18:28.241331  7708 tablet_service.cc:1511] Processing CreateTablet for tablet 22aba1482fb54caa81fce2c947b22259 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:28.242030  7709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0562f88033c404baf7f3ba0bd0b6d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.246549  7708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aba1482fb54caa81fce2c947b22259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.252964  8009 tablet_bootstrap.cc:654] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:28.256805  7669 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:28.256726  7785 tablet_service.cc:1511] Processing CreateTablet for tablet 22aba1482fb54caa81fce2c947b22259 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:28.264462  7785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aba1482fb54caa81fce2c947b22259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.265710  8008 tablet_bootstrap.cc:492] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.266081  8007 tablet_bootstrap.cc:654] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.266323  8008 ts_tablet_manager.cc:1403] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.005s
I20260709 13:18:28.269258  7706 tablet_service.cc:1511] Processing CreateTablet for tablet 14fec0eae8004693a813852224aed514 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:28.269621  8008 raft_consensus.cc:359] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.270568  7706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fec0eae8004693a813852224aed514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.270606  8008 raft_consensus.cc:385] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.271252  8008 raft_consensus.cc:740] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.272205  8008 consensus_queue.cc:260] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.270282  7858 tablet_service.cc:1511] Processing CreateTablet for tablet 22aba1482fb54caa81fce2c947b22259 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:18:28.283221  7784 tablet_service.cc:1511] Processing CreateTablet for tablet 14fec0eae8004693a813852224aed514 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:28.284363  7858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22aba1482fb54caa81fce2c947b22259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.284428  7784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fec0eae8004693a813852224aed514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.285779  8008 ts_tablet_manager.cc:1434] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 13:18:28.293579  8007 tablet_bootstrap.cc:492] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.294170  8007 ts_tablet_manager.cc:1403] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 13:18:28.294625  8008 tablet_bootstrap.cc:492] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.297353  7857 tablet_service.cc:1511] Processing CreateTablet for tablet 14fec0eae8004693a813852224aed514 (DEFAULT_TABLE table=soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:18:28.298928  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fec0eae8004693a813852224aed514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:28.297327  8007 raft_consensus.cc:359] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.304144  8007 raft_consensus.cc:385] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.305207  8008 tablet_bootstrap.cc:654] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.307523  8009 tablet_bootstrap.cc:492] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.309863  8009 ts_tablet_manager.cc:1403] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.009s
I20260709 13:18:28.311852  8007 raft_consensus.cc:740] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.314967  8007 consensus_queue.cc:260] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.319556  8009 raft_consensus.cc:359] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.325220  8009 raft_consensus.cc:385] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.325598  8009 raft_consensus.cc:740] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.326503  8009 consensus_queue.cc:260] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.321122  8007 ts_tablet_manager.cc:1434] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.005s
I20260709 13:18:28.328756  8008 tablet_bootstrap.cc:492] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.329559  8008 ts_tablet_manager.cc:1403] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:18:28.330080  8009 ts_tablet_manager.cc:1434] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:18:28.328773  8007 tablet_bootstrap.cc:492] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.331231  8009 tablet_bootstrap.cc:492] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.332722  7995 raft_consensus.cc:493] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.333252  7995 raft_consensus.cc:515] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.335912  7995 leader_election.cc:290] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.336404  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
W20260709 13:18:28.337809  7836 leader_election.cc:343] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.338429  8009 tablet_bootstrap.cc:654] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.338376  8008 raft_consensus.cc:359] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.340611  8007 tablet_bootstrap.cc:654] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.340794  8008 raft_consensus.cc:385] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.341240  8008 raft_consensus.cc:740] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.342207  8008 consensus_queue.cc:260] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.352246  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.352994  7721 raft_consensus.cc:2468] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:28.358263  7835 leader_election.cc:304] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:28.366809  8019 raft_consensus.cc:2804] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.367810  8019 raft_consensus.cc:493] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.368597  8019 raft_consensus.cc:3060] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:28.371553  7898 tablet.cc:2406] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:28.379889  8008 ts_tablet_manager.cc:1434] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.030s
I20260709 13:18:28.381175  8008 tablet_bootstrap.cc:492] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.381376  8007 tablet_bootstrap.cc:492] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.381982  8007 ts_tablet_manager.cc:1403] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.019s
I20260709 13:18:28.385233  8007 raft_consensus.cc:359] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.386039  8007 raft_consensus.cc:385] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.386397  8007 raft_consensus.cc:740] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.387172  8007 consensus_queue.cc:260] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.390156  8007 ts_tablet_manager.cc:1434] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:18:28.391258  8007 tablet_bootstrap.cc:492] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.392649  8009 tablet_bootstrap.cc:492] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.393266  8009 ts_tablet_manager.cc:1403] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.016s
I20260709 13:18:28.394115  8019 raft_consensus.cc:515] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.398201  8007 tablet_bootstrap.cc:654] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.399531  8019 leader_election.cc:290] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.394778  8008 tablet_bootstrap.cc:654] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.400655  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.401022  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:28.401312  7721 raft_consensus.cc:3060] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:28.404134  7836 leader_election.cc:343] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.406438  8009 raft_consensus.cc:359] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.407521  8009 raft_consensus.cc:385] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.407948  8009 raft_consensus.cc:740] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.409026  8009 consensus_queue.cc:260] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.410503  7721 raft_consensus.cc:2468] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:28.411829  7835 leader_election.cc:304] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:28.413041  8019 raft_consensus.cc:2804] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.413595  8019 raft_consensus.cc:697] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:28.413744  8009 ts_tablet_manager.cc:1434] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:18:28.414543  8019 consensus_queue.cc:237] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.418323  8009 tablet_bootstrap.cc:492] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.425776  8007 tablet_bootstrap.cc:492] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.426461  8007 ts_tablet_manager.cc:1403] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.017s
I20260709 13:18:28.427983  8009 tablet_bootstrap.cc:654] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.429719  8007 raft_consensus.cc:359] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.431927  8007 raft_consensus.cc:385] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.432642  8007 raft_consensus.cc:740] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.433832  8007 consensus_queue.cc:260] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.437525  8007 ts_tablet_manager.cc:1434] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:18:28.440461  8007 tablet_bootstrap.cc:492] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.441416  8009 tablet_bootstrap.cc:492] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.442217  8009 ts_tablet_manager.cc:1403] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:18:28.446189  8009 raft_consensus.cc:359] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.447149  8009 raft_consensus.cc:385] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.447515  8009 raft_consensus.cc:740] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.448760  8009 consensus_queue.cc:260] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.455817  8009 ts_tablet_manager.cc:1434] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 13:18:28.455895  8007 tablet_bootstrap.cc:654] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.456921  8009 tablet_bootstrap.cc:492] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.459905  8008 tablet_bootstrap.cc:492] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.460500  8008 ts_tablet_manager.cc:1403] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.019s
I20260709 13:18:28.463851  8008 raft_consensus.cc:359] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.464457  8009 tablet_bootstrap.cc:654] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.464628  8008 raft_consensus.cc:385] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.464991  8008 raft_consensus.cc:740] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.465811  8008 consensus_queue.cc:260] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.472898  8008 ts_tablet_manager.cc:1434] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:28.474254  8008 tablet_bootstrap.cc:492] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.478197  7621 catalog_manager.cc:5697] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.484125  8008 tablet_bootstrap.cc:654] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.485445  8009 tablet_bootstrap.cc:492] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.486006  8009 ts_tablet_manager.cc:1403] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.017s
I20260709 13:18:28.486271  8007 tablet_bootstrap.cc:492] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.486872  8007 ts_tablet_manager.cc:1403] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.017s
I20260709 13:18:28.489487  8009 raft_consensus.cc:359] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.490289  8009 raft_consensus.cc:385] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.489852  8007 raft_consensus.cc:359] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.490612  8009 raft_consensus.cc:740] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.490752  8007 raft_consensus.cc:385] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.491196  8007 raft_consensus.cc:740] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.491564  8009 consensus_queue.cc:260] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.492017  8007 consensus_queue.cc:260] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.494190  8009 ts_tablet_manager.cc:1434] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:18:28.495574  8009 tablet_bootstrap.cc:492] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.499897  8007 ts_tablet_manager.cc:1434] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:28.501056  8007 tablet_bootstrap.cc:492] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.502106  8009 tablet_bootstrap.cc:654] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.504746  7952 raft_consensus.cc:493] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.505256  7952 raft_consensus.cc:515] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.507450  7952 leader_election.cc:290] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.511137  7952 raft_consensus.cc:493] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.511912  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.513181  7721 raft_consensus.cc:2393] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57039b71674b4719abbef40a29a8ec03 in current term 1: Already voted for candidate ad5bcb3e418842f998b2f9aa622c7527 in this term.
I20260709 13:18:28.515304  8007 tablet_bootstrap.cc:654] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.511709  7952 raft_consensus.cc:515] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.509692  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.521428  7952 leader_election.cc:290] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.522064  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.522764  7721 raft_consensus.cc:2468] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.523970  7761 leader_election.cc:304] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.526221  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.526891  7872 raft_consensus.cc:2468] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.528604  7764 leader_election.cc:304] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03; no voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:28.529390  7952 raft_consensus.cc:3060] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.524935  8028 raft_consensus.cc:2804] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.537750  8028 raft_consensus.cc:493] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.537753  7952 raft_consensus.cc:2749] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:28.538244  8028 raft_consensus.cc:3060] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.540997  7952 raft_consensus.cc:493] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.541519  7952 raft_consensus.cc:515] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.542155  8007 tablet_bootstrap.cc:492] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.542920  8007 ts_tablet_manager.cc:1403] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.005s
I20260709 13:18:28.544231  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
W20260709 13:18:28.545941  7761 leader_election.cc:343] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.547465  8007 raft_consensus.cc:359] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.553273  8007 raft_consensus.cc:385] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.553633  8008 tablet_bootstrap.cc:492] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.547947  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.554325  8008 ts_tablet_manager.cc:1403] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.018s
W20260709 13:18:28.555472  7764 leader_election.cc:343] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.555743  8009 tablet_bootstrap.cc:492] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.555950  7764 leader_election.cc:304] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03; no voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:28.556346  8009 ts_tablet_manager.cc:1403] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.034s
I20260709 13:18:28.557518  8008 raft_consensus.cc:359] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.558274  8008 raft_consensus.cc:385] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.558570  8008 raft_consensus.cc:740] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.547838  7952 leader_election.cc:290] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.559826  7952 raft_consensus.cc:2749] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:28.559556  8009 raft_consensus.cc:359] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.560390  8009 raft_consensus.cc:385] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.560701  8009 raft_consensus.cc:740] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.556926  8028 raft_consensus.cc:515] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.560894  8008 consensus_queue.cc:260] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.553650  8007 raft_consensus.cc:740] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.561596  8009 consensus_queue.cc:260] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.564064  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.564412  8008 ts_tablet_manager.cc:1434] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:18:28.564740  7721 raft_consensus.cc:3060] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.565884  8008 tablet_bootstrap.cc:492] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.565423  8007 consensus_queue.cc:260] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.568049  8007 ts_tablet_manager.cc:1434] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:18:28.569199  8007 tablet_bootstrap.cc:492] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.572595  8009 ts_tablet_manager.cc:1434] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:28.573721  8009 tablet_bootstrap.cc:492] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.576126  8007 tablet_bootstrap.cc:654] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.576893  8008 tablet_bootstrap.cc:654] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.580425  8009 tablet_bootstrap.cc:654] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.592351  8030 raft_consensus.cc:493] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.592981  8030 raft_consensus.cc:515] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.594640  8019 raft_consensus.cc:493] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.595240  8019 raft_consensus.cc:515] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.597021  8030 leader_election.cc:290] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.597218  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa8c6fe7865458fa2972dc8acd8b18d" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.597550  8019 leader_election.cc:290] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.594017  8009 tablet_bootstrap.cc:492] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.599491  8009 ts_tablet_manager.cc:1403] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.009s
I20260709 13:18:28.599617  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0679999514447789c20706e56d7a4f6" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.600489  7722 raft_consensus.cc:2468] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:28.601814  7835 leader_election.cc:304] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.602694  8019 raft_consensus.cc:2804] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.603077  8019 raft_consensus.cc:493] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:28.598857  7764 leader_election.cc:343] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.603518  8019 raft_consensus.cc:3060] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.603430  8009 raft_consensus.cc:359] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.604292  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa8c6fe7865458fa2972dc8acd8b18d" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.605075  7722 raft_consensus.cc:2468] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.605719  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0679999514447789c20706e56d7a4f6" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:28.606850  7761 leader_election.cc:304] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:28.608412  8030 raft_consensus.cc:2804] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.608966  8030 raft_consensus.cc:493] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.609393  8030 raft_consensus.cc:3060] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.613849  7721 raft_consensus.cc:2468] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.617105  8028 leader_election.cc:290] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.617319  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:28.617892  7872 raft_consensus.cc:3060] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.618395  7761 leader_election.cc:304] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.619391  8028 raft_consensus.cc:2804] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.619886  8009 raft_consensus.cc:385] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.619889  8028 raft_consensus.cc:697] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:28.620428  8009 raft_consensus.cc:740] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.621024  8028 consensus_queue.cc:237] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.621594  8009 consensus_queue.cc:260] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.622987  7798 raft_consensus.cc:2468] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:28.624775  8009 ts_tablet_manager.cc:1434] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:18:28.619675  8030 raft_consensus.cc:515] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.626618  8009 tablet_bootstrap.cc:492] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.627202  8030 leader_election.cc:290] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.628332  7870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa8c6fe7865458fa2972dc8acd8b18d" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:28.629386  8008 tablet_bootstrap.cc:492] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
W20260709 13:18:28.629839  7764 leader_election.cc:343] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:28.630039  7872 raft_consensus.cc:2468] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.630940  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa8c6fe7865458fa2972dc8acd8b18d" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.614950  8019 raft_consensus.cc:515] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.631553  7721 raft_consensus.cc:3060] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.629906  8008 ts_tablet_manager.cc:1403] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.064s	user 0.035s	sys 0.012s
I20260709 13:18:28.636492  8009 tablet_bootstrap.cc:654] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.636960  8008 raft_consensus.cc:359] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.637768  8008 raft_consensus.cc:385] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.638067  8008 raft_consensus.cc:740] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.638968  8008 consensus_queue.cc:260] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.640977  8019 leader_election.cc:290] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.640853  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0679999514447789c20706e56d7a4f6" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.641798  7722 raft_consensus.cc:3060] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.645412  7721 raft_consensus.cc:2468] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.647192  7761 leader_election.cc:304] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:28.648721  8030 raft_consensus.cc:2804] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.649179  8030 raft_consensus.cc:697] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:28.649960  8030 consensus_queue.cc:237] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.652137  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0679999514447789c20706e56d7a4f6" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:28.652253  7722 raft_consensus.cc:2468] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:28.652776  7798 raft_consensus.cc:3060] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.655251  8008 ts_tablet_manager.cc:1434] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:18:28.656399  7835 leader_election.cc:304] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.656715  8008 tablet_bootstrap.cc:492] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.673130  8007 tablet_bootstrap.cc:492] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.675999  8007 ts_tablet_manager.cc:1403] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.022s
I20260709 13:18:28.676229  8008 tablet_bootstrap.cc:654] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.675913  7620 catalog_manager.cc:5697] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:28.679418  8007 raft_consensus.cc:359] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.680166  8007 raft_consensus.cc:385] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.680454  8007 raft_consensus.cc:740] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.675223  8019 raft_consensus.cc:2804] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.681831  8019 raft_consensus.cc:697] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:28.682657  8019 consensus_queue.cc:237] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.662206  7798 raft_consensus.cc:2468] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:28.685272  8007 consensus_queue.cc:260] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.687985  8007 ts_tablet_manager.cc:1434] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:18:28.688995  8007 tablet_bootstrap.cc:492] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.698670  8008 tablet_bootstrap.cc:492] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.699506  8008 ts_tablet_manager.cc:1403] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.043s	user 0.029s	sys 0.000s
I20260709 13:18:28.703985  8008 raft_consensus.cc:359] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.704975  8008 raft_consensus.cc:385] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.709204  8008 raft_consensus.cc:740] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.710274  8008 consensus_queue.cc:260] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.711030  8007 tablet_bootstrap.cc:654] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.705753  7620 catalog_manager.cc:5697] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:28.713476  8008 ts_tablet_manager.cc:1434] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:28.714929  8008 tablet_bootstrap.cc:492] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.722991  8007 tablet_bootstrap.cc:492] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.723546  8008 tablet_bootstrap.cc:654] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.723630  8007 ts_tablet_manager.cc:1403] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.002s
I20260709 13:18:28.729923  8007 raft_consensus.cc:359] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.730677  8007 raft_consensus.cc:385] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.730973  8007 raft_consensus.cc:740] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.731966  8007 consensus_queue.cc:260] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.732028  7619 catalog_manager.cc:5697] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.734881  8019 raft_consensus.cc:493] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.735412  8019 raft_consensus.cc:515] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.736286  8008 tablet_bootstrap.cc:492] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.736330  8028 raft_consensus.cc:493] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.736981  8008 ts_tablet_manager.cc:1403] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:18:28.736981  8028 raft_consensus.cc:515] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.737581  8019 leader_election.cc:290] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.738741  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa8c6fe7865458fa2972dc8acd8b18d" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:28.740597  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42323c88a944b76bfca0602a8d24650" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.741248  7872 raft_consensus.cc:2468] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.741560  8007 ts_tablet_manager.cc:1434] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:18:28.741714  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42323c88a944b76bfca0602a8d24650" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.742316  7722 raft_consensus.cc:2468] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.742681  8007 tablet_bootstrap.cc:492] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.742588  7764 leader_election.cc:304] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:28.743717  8030 raft_consensus.cc:2804] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.744076  8030 raft_consensus.cc:493] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.744392  8030 raft_consensus.cc:3060] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.744534  8008 raft_consensus.cc:359] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.745217  8008 raft_consensus.cc:385] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.745500  8008 raft_consensus.cc:740] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.746182  8008 consensus_queue.cc:260] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.748302  8008 ts_tablet_manager.cc:1434] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:28.749219  8008 tablet_bootstrap.cc:492] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: Bootstrap starting.
I20260709 13:18:28.750322  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfa8c6fe7865458fa2972dc8acd8b18d" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.751125  8028 leader_election.cc:290] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.750602  8007 tablet_bootstrap.cc:654] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.751231  7721 raft_consensus.cc:2393] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad5bcb3e418842f998b2f9aa622c7527 in current term 1: Already voted for candidate 57039b71674b4719abbef40a29a8ec03 in this term.
I20260709 13:18:28.753041  7835 leader_election.cc:304] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:28.754206  8019 raft_consensus.cc:3060] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.754889  8008 tablet_bootstrap.cc:654] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.754796  8030 raft_consensus.cc:515] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.757798  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42323c88a944b76bfca0602a8d24650" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.758556  7721 raft_consensus.cc:3060] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.761499  8019 raft_consensus.cc:2749] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:28.766501  8008 tablet_bootstrap.cc:492] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: No bootstrap required, opened a new log
I20260709 13:18:28.767072  8008 ts_tablet_manager.cc:1403] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:18:28.768388  8019 raft_consensus.cc:493] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.768951  8019 raft_consensus.cc:515] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.769872  8008 raft_consensus.cc:359] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.770643  8008 raft_consensus.cc:385] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.771112  8019 leader_election.cc:290] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.770905  8008 raft_consensus.cc:740] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.772228  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.772989  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42323c88a944b76bfca0602a8d24650" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:28.773236  8030 leader_election.cc:290] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.773634  7872 raft_consensus.cc:3060] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.772277  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:28.773005  8008 consensus_queue.cc:260] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.774852  7798 raft_consensus.cc:2468] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:28.776451  8008 ts_tablet_manager.cc:1434] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:18:28.776530  7836 leader_election.cc:304] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:28.773262  7722 raft_consensus.cc:2468] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:28.777525  8019 raft_consensus.cc:2804] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.777892  8019 raft_consensus.cc:493] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.778239  8019 raft_consensus.cc:3060] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.781390  7872 raft_consensus.cc:2468] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.782660  7764 leader_election.cc:304] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:28.783525  8030 raft_consensus.cc:2804] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.784299  8030 raft_consensus.cc:697] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:28.785115  8030 consensus_queue.cc:237] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.785571  8019 raft_consensus.cc:515] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.789441  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.790073  7722 raft_consensus.cc:3060] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.773981  7721 raft_consensus.cc:2468] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.794337  8019 leader_election.cc:290] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:28.796000  8009 tablet_bootstrap.cc:492] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.795571  7619 catalog_manager.cc:5697] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:28.796569  8009 ts_tablet_manager.cc:1403] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.171s	user 0.048s	sys 0.058s
I20260709 13:18:28.798054  8007 tablet_bootstrap.cc:492] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.798673  8007 ts_tablet_manager.cc:1403] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.000s
I20260709 13:18:28.798923  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:28.799571  7798 raft_consensus.cc:3060] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.800938  8009 raft_consensus.cc:359] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.801332  8007 raft_consensus.cc:359] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.801692  8009 raft_consensus.cc:385] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.802011  8007 raft_consensus.cc:385] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.802351  8007 raft_consensus.cc:740] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.802902  7722 raft_consensus.cc:2468] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:28.802093  8009 raft_consensus.cc:740] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.803081  8007 consensus_queue.cc:260] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.804522  8009 consensus_queue.cc:260] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.806177  8007 ts_tablet_manager.cc:1434] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:28.806555  7835 leader_election.cc:304] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.806885  8009 ts_tablet_manager.cc:1434] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:28.807535  8019 raft_consensus.cc:2804] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.808045  8019 raft_consensus.cc:697] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:28.808867  8019 consensus_queue.cc:237] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.810482  7798 raft_consensus.cc:2468] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:28.808065  8009 tablet_bootstrap.cc:492] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.811934  8007 tablet_bootstrap.cc:492] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: Bootstrap starting.
I20260709 13:18:28.818421  8007 tablet_bootstrap.cc:654] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.818420  8009 tablet_bootstrap.cc:654] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.827560  8018 consensus_queue.cc:1048] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:28.829466  7619 catalog_manager.cc:5697] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.836194  8007 tablet_bootstrap.cc:492] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: No bootstrap required, opened a new log
I20260709 13:18:28.836954  8007 ts_tablet_manager.cc:1403] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.002s
I20260709 13:18:28.838845  8010 raft_consensus.cc:493] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.839396  8010 raft_consensus.cc:515] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.840581  8007 raft_consensus.cc:359] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.841611  8007 raft_consensus.cc:385] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.841967  8007 raft_consensus.cc:740] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.842869  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fec0eae8004693a813852224aed514" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:28.843089  8007 consensus_queue.cc:260] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.843673  7796 raft_consensus.cc:2468] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:28.846341  8007 ts_tablet_manager.cc:1434] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:18:28.849627  7687 leader_election.cc:304] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.851140  7996 raft_consensus.cc:2804] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.851512  7996 raft_consensus.cc:493] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.851886  7996 raft_consensus.cc:3060] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.853037  8010 leader_election.cc:290] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.854148  8009 tablet_bootstrap.cc:492] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.854686  8009 ts_tablet_manager.cc:1403] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.012s
I20260709 13:18:28.854964  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fec0eae8004693a813852224aed514" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.855680  7872 raft_consensus.cc:2468] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 0.
I20260709 13:18:28.857456  8009 raft_consensus.cc:359] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.858234  8009 raft_consensus.cc:385] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.858495  8009 raft_consensus.cc:740] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.859191  8009 consensus_queue.cc:260] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.861778  8009 ts_tablet_manager.cc:1434] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:28.862726  8009 tablet_bootstrap.cc:492] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: Bootstrap starting.
I20260709 13:18:28.868208  7996 raft_consensus.cc:515] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.869982  8009 tablet_bootstrap.cc:654] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:28.871434  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fec0eae8004693a813852224aed514" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:28.872157  7796 raft_consensus.cc:3060] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.884441  8028 raft_consensus.cc:493] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.885058  8028 raft_consensus.cc:515] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.886495  8018 consensus_queue.cc:1048] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:28.887260  8028 leader_election.cc:290] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.889811  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0562f88033c404baf7f3ba0bd0b6d63" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527" is_pre_election: true
I20260709 13:18:28.890553  7872 raft_consensus.cc:2468] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.892009  7764 leader_election.cc:304] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:28.893419  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0562f88033c404baf7f3ba0bd0b6d63" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:28.894133  7721 raft_consensus.cc:2468] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 0.
I20260709 13:18:28.895819  8028 raft_consensus.cc:2804] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:28.896270  8028 raft_consensus.cc:493] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.899673  8028 raft_consensus.cc:3060] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.899966  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fec0eae8004693a813852224aed514" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:28.900929  7872 raft_consensus.cc:3060] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.907967  7996 leader_election.cc:290] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.911468  7796 raft_consensus.cc:2468] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:28.916690  8028 raft_consensus.cc:515] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.917320  7687 leader_election.cc:304] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.918931  8010 raft_consensus.cc:2804] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.919549  8010 raft_consensus.cc:697] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:28.919728  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0562f88033c404baf7f3ba0bd0b6d63" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:28.920387  7721 raft_consensus.cc:3060] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.920658  8010 consensus_queue.cc:237] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.927258  8028 leader_election.cc:290] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:28.928592  7870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0562f88033c404baf7f3ba0bd0b6d63" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:28.929487  7870 raft_consensus.cc:3060] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:28.941624  7721 raft_consensus.cc:2468] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.944554  7870 raft_consensus.cc:2468] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 1.
I20260709 13:18:28.936638  7872 raft_consensus.cc:2468] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 1.
I20260709 13:18:28.949785  7761 leader_election.cc:304] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:28.949676  7619 catalog_manager.cc:5697] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 0 to 1, leader changed from <none> to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 1 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:28.951453  8028 raft_consensus.cc:2804] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:28.951967  8028 raft_consensus.cc:697] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:28.952785  8028 consensus_queue.cc:237] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.961768  8009 tablet_bootstrap.cc:492] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: No bootstrap required, opened a new log
I20260709 13:18:28.962249  8009 ts_tablet_manager.cc:1403] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.051s
I20260709 13:18:28.964807  8009 raft_consensus.cc:359] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.965508  8009 raft_consensus.cc:385] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:28.965792  8009 raft_consensus.cc:740] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Initialized, Role: FOLLOWER
I20260709 13:18:28.965648  7620 catalog_manager.cc:5697] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 1 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:28.966631  8009 consensus_queue.cc:260] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:28.968640  8009 ts_tablet_manager.cc:1434] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:29.058571  8028 consensus_queue.cc:1048] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.069085  7952 consensus_queue.cc:1048] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.076979  8019 raft_consensus.cc:493] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.077595  8019 raft_consensus.cc:515] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.080046  8019 leader_election.cc:290] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:29.081189  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03" is_pre_election: true
I20260709 13:18:29.081271  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f" is_pre_election: true
I20260709 13:18:29.082012  7798 raft_consensus.cc:2468] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:29.082059  7721 raft_consensus.cc:2468] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 0.
I20260709 13:18:29.082985  7836 leader_election.cc:304] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:29.083638  8019 raft_consensus.cc:2804] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:29.084025  8019 raft_consensus.cc:493] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.084340  8019 raft_consensus.cc:3060] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:29.090792  8019 raft_consensus.cc:515] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.092456  8019 leader_election.cc:290] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:29.093178  7721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:29.093508  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:29.093850  7721 raft_consensus.cc:3060] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:29.094112  7798 raft_consensus.cc:3060] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:29.100749  7721 raft_consensus.cc:2468] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:29.100747  7798 raft_consensus.cc:2468] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 1.
I20260709 13:18:29.102341  7836 leader_election.cc:304] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:29.103103  8019 raft_consensus.cc:2804] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:29.103547  8019 raft_consensus.cc:697] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:29.104398  8019 consensus_queue.cc:237] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.112192  7619 catalog_manager.cc:5697] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 1 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.132210  7952 consensus_queue.cc:1048] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.142573  8028 consensus_queue.cc:1048] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.209921  7872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be33cc1f36f34068b484ab7216318820"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
mode: GRACEFUL
new_leader_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:41062
I20260709 13:18:29.210525  7872 raft_consensus.cc:606] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Received request to transfer leadership to TS e06813d9b94c44bc8010170059affc2f
I20260709 13:18:29.215670  7798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5"
dest_uuid: "57039b71674b4719abbef40a29a8ec03"
mode: GRACEFUL
new_leader_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:50268
I20260709 13:18:29.216270  7798 raft_consensus.cc:606] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Received request to transfer leadership to TS e06813d9b94c44bc8010170059affc2f
I20260709 13:18:29.221655  7872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
mode: GRACEFUL
new_leader_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:41062
I20260709 13:18:29.222165  7872 raft_consensus.cc:606] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Received request to transfer leadership to TS e06813d9b94c44bc8010170059affc2f
I20260709 13:18:29.226750  8019 consensus_queue.cc:1048] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.227711  7872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0679999514447789c20706e56d7a4f6"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
mode: GRACEFUL
new_leader_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:41062
I20260709 13:18:29.228425  7872 raft_consensus.cc:606] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Received request to transfer leadership to TS e06813d9b94c44bc8010170059affc2f
I20260709 13:18:29.238508  8018 consensus_queue.cc:1048] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.248448  8018 raft_consensus.cc:993] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: : Instructing follower e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.248883  8018 raft_consensus.cc:1081] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Signalling peer e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.250372  7721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0679999514447789c20706e56d7a4f6"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:18:29.250959  7721 raft_consensus.cc:493] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.251344  7721 raft_consensus.cc:3060] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.254308  7872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
mode: GRACEFUL
new_leader_uuid: "57039b71674b4719abbef40a29a8ec03"
 from {username='slave'} at 127.0.0.1:41062
I20260709 13:18:29.254899  7872 raft_consensus.cc:606] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Received request to transfer leadership to TS 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:29.258104  7721 raft_consensus.cc:515] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.260116  7721 leader_election.cc:290] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:29.261129  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0679999514447789c20706e56d7a4f6" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:29.261209  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0679999514447789c20706e56d7a4f6" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:29.262007  7872 raft_consensus.cc:3055] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.262099  7798 raft_consensus.cc:3060] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.262403  7872 raft_consensus.cc:740] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:29.266659  7872 consensus_queue.cc:260] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.268054  7721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14fec0eae8004693a813852224aed514"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
mode: GRACEFUL
new_leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:42230
I20260709 13:18:29.268069  7872 raft_consensus.cc:3060] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.268846  7721 raft_consensus.cc:606] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Received request to transfer leadership to TS ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:29.269675  7798 raft_consensus.cc:2468] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.270865  7687 leader_election.cc:304] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:29.271719  8010 raft_consensus.cc:2804] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.273139  8010 raft_consensus.cc:697] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:29.273984  8010 consensus_queue.cc:237] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.275301  7872 raft_consensus.cc:2468] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.282152  7619 catalog_manager.cc:5697] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 1 to 2, leader changed from ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131) to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 2 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.294184  8028 consensus_queue.cc:1048] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.301877  8019 raft_consensus.cc:993] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: : Instructing follower e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.302328  8019 raft_consensus.cc:1081] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Signalling peer e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.304291  7722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be33cc1f36f34068b484ab7216318820"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:18:29.304826  7722 raft_consensus.cc:493] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.305205  7722 raft_consensus.cc:3060] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.305248  8030 consensus_queue.cc:1048] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:29.316538  7722 raft_consensus.cc:515] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.318262  7722 leader_election.cc:290] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:29.318965  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:29.319252  7872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be33cc1f36f34068b484ab7216318820" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:29.319666  7798 raft_consensus.cc:3060] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.319878  7872 raft_consensus.cc:3055] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.320287  7872 raft_consensus.cc:740] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:29.320967  7872 consensus_queue.cc:260] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.321909  7872 raft_consensus.cc:3060] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.326918  7872 raft_consensus.cc:2468] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.326910  7798 raft_consensus.cc:2468] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.328091  7689 leader_election.cc:304] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:29.328872  8062 raft_consensus.cc:2804] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.329198  8062 raft_consensus.cc:697] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:29.329933  8062 consensus_queue.cc:237] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.335636  7619 catalog_manager.cc:5697] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 1 to 2, leader changed from ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131) to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 2 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.371438  8030 consensus_queue.cc:1048] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.371896  8010 consensus_queue.cc:1048] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:29.382462  8010 raft_consensus.cc:993] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: : Instructing follower ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:29.382884  8010 raft_consensus.cc:1081] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Signalling peer ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:29.383471  8028 consensus_queue.cc:1048] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.385087  7871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14fec0eae8004693a813852224aed514"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:18:29.385748  7871 raft_consensus.cc:493] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.386104  7871 raft_consensus.cc:3060] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.388509  8062 consensus_queue.cc:1048] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:29.393630  7871 raft_consensus.cc:515] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.395524  7872 raft_consensus.cc:1240] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Rejecting Update request from peer e06813d9b94c44bc8010170059affc2f for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:29.400606  7871 leader_election.cc:290] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:29.402756  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fec0eae8004693a813852224aed514" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:29.405022  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14fec0eae8004693a813852224aed514" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:29.405881  7722 raft_consensus.cc:3055] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.406452  7722 raft_consensus.cc:740] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:29.407388  7722 consensus_queue.cc:260] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.408056  8062 consensus_queue.cc:1059] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.409087  8018 consensus_queue.cc:1048] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.412741  7722 raft_consensus.cc:3060] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.420507  7722 raft_consensus.cc:2468] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 2.
I20260709 13:18:29.423382  7835 leader_election.cc:304] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 57039b71674b4719abbef40a29a8ec03
I20260709 13:18:29.424189  8018 consensus_queue.cc:1048] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.424455  8019 raft_consensus.cc:2804] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.425137  8019 raft_consensus.cc:697] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:29.425997  8019 consensus_queue.cc:237] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.431560  7995 raft_consensus.cc:993] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: : Instructing follower e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.432008  7995 raft_consensus.cc:1081] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Signalling peer e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.435065  7723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:42206
I20260709 13:18:29.435627  7723 raft_consensus.cc:493] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.436056  7723 raft_consensus.cc:3060] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.443243  7723 raft_consensus.cc:515] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.444316  7722 raft_consensus.cc:1240] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Rejecting Update request from peer ad5bcb3e418842f998b2f9aa622c7527 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:29.446507  8019 consensus_queue.cc:1059] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.447338  8019 raft_consensus.cc:3055] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.447512  7723 leader_election.cc:290] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:29.447661  8019 raft_consensus.cc:740] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:29.448724  8019 consensus_queue.cc:260] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.449761  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
W20260709 13:18:29.449826  8018 consensus_queue.cc:1175] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "57039b71674b4719abbef40a29a8ec03" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:18:29.450603  7796 raft_consensus.cc:3060] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.450042  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4029bb503654a3abfcebe96c447c872" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:29.449767  8019 raft_consensus.cc:3060] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.451565  7620 catalog_manager.cc:5697] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 1 to 2, leader changed from e06813d9b94c44bc8010170059affc2f (127.29.5.129) to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.458775  7796 raft_consensus.cc:2468] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.460439  7687 leader_election.cc:304] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:29.461417  7996 raft_consensus.cc:2804] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.461918  7996 raft_consensus.cc:697] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:29.462769  7996 consensus_queue.cc:237] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.466780  7871 raft_consensus.cc:2468] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.471306  7620 catalog_manager.cc:5697] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 1 to 2, leader changed from ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131) to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 2 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.506964  8019 consensus_queue.cc:1048] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.517094  8018 consensus_queue.cc:1048] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.526152  7995 raft_consensus.cc:993] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: : Instructing follower 57039b71674b4719abbef40a29a8ec03 to start an election
I20260709 13:18:29.526672  7995 raft_consensus.cc:1081] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Signalling peer 57039b71674b4719abbef40a29a8ec03 to start an election
I20260709 13:18:29.528084  7796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259"
dest_uuid: "57039b71674b4719abbef40a29a8ec03"
 from {username='slave'} at 127.0.0.1:50256
I20260709 13:18:29.528541  7796 raft_consensus.cc:493] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.528861  7796 raft_consensus.cc:3060] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.533954  7796 raft_consensus.cc:515] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.536057  7796 leader_election.cc:290] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 2 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:29.536334  7723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:29.536660  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22aba1482fb54caa81fce2c947b22259" candidate_uuid: "57039b71674b4719abbef40a29a8ec03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:29.537058  7723 raft_consensus.cc:3060] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.537277  7871 raft_consensus.cc:3055] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.537616  7871 raft_consensus.cc:740] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:29.538431  7871 consensus_queue.cc:260] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.539697  7871 raft_consensus.cc:3060] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.544150  7723 raft_consensus.cc:2468] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 2.
I20260709 13:18:29.545426  7761 leader_election.cc:304] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:29.546190  7952 raft_consensus.cc:2804] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.546700  7952 raft_consensus.cc:697] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Becoming Leader. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:29.546584  7871 raft_consensus.cc:2468] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57039b71674b4719abbef40a29a8ec03 in term 2.
I20260709 13:18:29.547629  7952 consensus_queue.cc:237] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.553972  7620 catalog_manager.cc:5697] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 reported cstate change: term changed from 1 to 2, leader changed from ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131) to 57039b71674b4719abbef40a29a8ec03 (127.29.5.130). New cstate: current_term: 2 leader_uuid: "57039b71674b4719abbef40a29a8ec03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.657656  7796 raft_consensus.cc:1275] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.658845  7996 consensus_queue.cc:1048] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.669202  7871 raft_consensus.cc:1275] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.670826  8073 consensus_queue.cc:1048] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.728366  8028 raft_consensus.cc:993] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: : Instructing follower e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.728888  8028 raft_consensus.cc:1081] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Signalling peer e06813d9b94c44bc8010170059affc2f to start an election
I20260709 13:18:29.730978  7723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
 from {username='slave'} at 127.0.0.1:42216
I20260709 13:18:29.731545  7723 raft_consensus.cc:493] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:29.731948  7723 raft_consensus.cc:3060] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.737489  7723 raft_consensus.cc:515] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.739099  7723 leader_election.cc:290] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Requested vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131:38115)
I20260709 13:18:29.739925  7796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:29.740171  7871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085dea7e7e414db1b8b056d310f950b5" candidate_uuid: "e06813d9b94c44bc8010170059affc2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
I20260709 13:18:29.740514  7796 raft_consensus.cc:3055] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:29.740760  7871 raft_consensus.cc:3060] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.740902  7796 raft_consensus.cc:740] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:29.741654  7796 consensus_queue.cc:260] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.742588  7796 raft_consensus.cc:3060] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.746204  7871 raft_consensus.cc:2468] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.747382  7689 leader_election.cc:304] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527, e06813d9b94c44bc8010170059affc2f; no voters: 
I20260709 13:18:29.747953  7796 raft_consensus.cc:2468] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e06813d9b94c44bc8010170059affc2f in term 2.
I20260709 13:18:29.748126  8073 raft_consensus.cc:2804] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:29.748703  8073 raft_consensus.cc:697] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Becoming Leader. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:29.749401  8073 consensus_queue.cc:237] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:29.755700  7620 catalog_manager.cc:5697] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f reported cstate change: term changed from 1 to 2, leader changed from 57039b71674b4719abbef40a29a8ec03 (127.29.5.130) to e06813d9b94c44bc8010170059affc2f (127.29.5.129). New cstate: current_term: 2 leader_uuid: "e06813d9b94c44bc8010170059affc2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:29.848978  7796 raft_consensus.cc:1275] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.850337  8010 consensus_queue.cc:1048] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.858325  7871 raft_consensus.cc:1275] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.859831  8073 consensus_queue.cc:1048] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.871803  7723 raft_consensus.cc:1275] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.873394  7995 consensus_queue.cc:1048] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.884877  7796 raft_consensus.cc:3060] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:29.893045  7796 raft_consensus.cc:1275] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.894251  8074 consensus_queue.cc:1048] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.966329  7871 raft_consensus.cc:1275] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.967796  8062 consensus_queue.cc:1048] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.971841  7870 raft_consensus.cc:1275] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer 57039b71674b4719abbef40a29a8ec03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.973315  7952 consensus_queue.cc:1048] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:29.981757  7796 raft_consensus.cc:1275] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.983835  7723 raft_consensus.cc:1275] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Refusing update from remote peer 57039b71674b4719abbef40a29a8ec03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:29.984719  8062 consensus_queue.cc:1048] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:29.985803  7952 consensus_queue.cc:1048] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.167339  7796 raft_consensus.cc:1275] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:30.168668  8062 consensus_queue.cc:1048] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.177079  7871 raft_consensus.cc:1275] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Refusing update from remote peer e06813d9b94c44bc8010170059affc2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:30.178897  7996 consensus_queue.cc:1048] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:32.272192  7621 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54208:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:18:32.291699  7621 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54208:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:18:32.331198 29718 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:32.502067  7794 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7"
dest_uuid: "57039b71674b4719abbef40a29a8ec03"
mode: GRACEFUL
new_leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:54766
I20260709 13:18:32.502815  7794 raft_consensus.cc:606] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Received request to transfer leadership to TS ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:32.560207  8126 tablet.cc:1724] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.598101  8120 tablet.cc:1724] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:32.613231  7764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.29.5.131:38115, user_credentials={real_user=slave}} blocked reactor thread for 53497.4us
I20260709 13:18:32.632556  8137 tablet.cc:1724] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.649137  8140 tablet.cc:1724] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.672832  8138 tablet.cc:1724] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.678776  8143 tablet.cc:1724] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.713953  8144 tablet.cc:1724] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:18:32.716082  8134 log.cc:927] Time spent T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:18:32.718716  8120 tablet.cc:1724] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.716125  8126 tablet.cc:1724] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.725904  8137 tablet.cc:1724] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.728495  7722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49"
dest_uuid: "e06813d9b94c44bc8010170059affc2f"
mode: GRACEFUL
new_leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:52832
I20260709 13:18:32.729147  7722 raft_consensus.cc:606] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Received request to transfer leadership to TS ad5bcb3e418842f998b2f9aa622c7527
I20260709 13:18:32.730700 29718 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:32.731334 29718 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:32.736276  8149 tablet.cc:1724] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.738612  8147 tablet.cc:1724] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.745846  8120 tablet.cc:1724] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.749500  8138 tablet.cc:1724] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.752403  8137 tablet.cc:1724] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.698361  8142 tablet.cc:1724] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.765700  8145 raft_consensus.cc:993] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: : Instructing follower ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:32.766268  8145 raft_consensus.cc:1081] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Signalling peer ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:32.769353  8150 tablet.cc:1724] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.763420  8140 tablet.cc:1724] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.778841  8149 tablet.cc:1724] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.770501  8144 tablet.cc:1724] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.780272  7870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:41050
I20260709 13:18:32.786336  7870 raft_consensus.cc:493] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:32.786790  7870 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.799952  8143 tablet.cc:1724] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.803084  8126 tablet.cc:1724] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.756105  8151 tablet.cc:1724] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.810848  7870 raft_consensus.cc:515] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:32.822849  8144 tablet.cc:1724] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.850553  7870 leader_election.cc:290] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:32.856086  8144 tablet.cc:1724] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.857318  8147 tablet.cc:1724] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.864930  8150 tablet.cc:1724] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:18:32.873224  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:32.873986  7798 raft_consensus.cc:3055] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:32.874305  7798 raft_consensus.cc:740] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57039b71674b4719abbef40a29a8ec03, State: Running, Role: LEADER
I20260709 13:18:32.875075  7798 consensus_queue.cc:260] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:32.876307  7798 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.881321  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c20f3e5b7f804f9ca36132fb645b91f7" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:32.881842  7722 raft_consensus.cc:3060] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:32.883122  7798 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 3.
I20260709 13:18:32.884639  7836 leader_election.cc:304] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:32.885591  8018 raft_consensus.cc:2804] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:32.886072  8018 raft_consensus.cc:697] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 3 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:32.886914  8018 consensus_queue.cc:237] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:32.892062  7722 raft_consensus.cc:2468] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 3.
I20260709 13:18:33.034415  8079 raft_consensus.cc:993] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: : Instructing follower ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:33.034917  8079 raft_consensus.cc:1081] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Signalling peer ad5bcb3e418842f998b2f9aa622c7527 to start an election
I20260709 13:18:33.037369  7870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49"
dest_uuid: "ad5bcb3e418842f998b2f9aa622c7527"
 from {username='slave'} at 127.0.0.1:41046
I20260709 13:18:33.037959  7870 raft_consensus.cc:493] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:33.038394  7870 raft_consensus.cc:3060] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.046454  7870 raft_consensus.cc:515] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:33.048997  7870 leader_election.cc:290] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 election: Requested vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:33.050861  7722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e06813d9b94c44bc8010170059affc2f"
I20260709 13:18:33.051527  7722 raft_consensus.cc:3055] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:33.051662  7798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b0fa9345344e58b6da4eeb8ced9b49" candidate_uuid: "ad5bcb3e418842f998b2f9aa622c7527" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57039b71674b4719abbef40a29a8ec03"
I20260709 13:18:33.051913  7722 raft_consensus.cc:740] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e06813d9b94c44bc8010170059affc2f, State: Running, Role: LEADER
I20260709 13:18:33.052331  7798 raft_consensus.cc:3060] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.053074  7722 consensus_queue.cc:260] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:33.054436  7722 raft_consensus.cc:3060] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:33.059275  7798 raft_consensus.cc:2468] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 2.
I20260709 13:18:33.060705  7836 leader_election.cc:304] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57039b71674b4719abbef40a29a8ec03, ad5bcb3e418842f998b2f9aa622c7527; no voters: 
I20260709 13:18:33.061510  7722 raft_consensus.cc:2468] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5bcb3e418842f998b2f9aa622c7527 in term 2.
I20260709 13:18:33.061807  8018 raft_consensus.cc:2804] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:33.062649  8018 raft_consensus.cc:697] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 LEADER]: Becoming Leader. State: Replica: ad5bcb3e418842f998b2f9aa622c7527, State: Running, Role: LEADER
I20260709 13:18:33.063544  8018 consensus_queue.cc:237] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:33.064376  7618 catalog_manager.cc:5697] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 2 to 3, leader changed from 57039b71674b4719abbef40a29a8ec03 (127.29.5.130) to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 3 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.074817  7620 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec: soft_deleted_table [id=913456cfaa704737b7bc6c2977409cfc] alter complete (version 1)
I20260709 13:18:33.085105  7619 catalog_manager.cc:5697] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 reported cstate change: term changed from 1 to 2, leader changed from e06813d9b94c44bc8010170059affc2f (127.29.5.129) to ad5bcb3e418842f998b2f9aa622c7527 (127.29.5.131). New cstate: current_term: 2 leader_uuid: "ad5bcb3e418842f998b2f9aa622c7527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:33.494475  7798 raft_consensus.cc:1275] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 3 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:33.495821  8018 consensus_queue.cc:1048] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:33.500077  7722 raft_consensus.cc:1275] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 3 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:33.501633  8018 consensus_queue.cc:1048] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:33.524484  7719 raft_consensus.cc:1275] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:33.527537  8158 consensus_queue.cc:1048] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:33.547263  7793 raft_consensus.cc:1275] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Refusing update from remote peer ad5bcb3e418842f998b2f9aa622c7527: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:33.549858  8158 consensus_queue.cc:1048] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:33.788416 29718 tablet_server.cc:179] TabletServer@127.29.5.129:0 shutting down...
I20260709 13:18:33.821307 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:33.822789 29718 tablet_replica.cc:333] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.823727 29718 raft_consensus.cc:2243] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.824354 29718 raft_consensus.cc:2272] T d0562f88033c404baf7f3ba0bd0b6d63 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.827317 29718 tablet_replica.cc:333] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.828011 29718 raft_consensus.cc:2243] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.828490 29718 raft_consensus.cc:2272] T 22aba1482fb54caa81fce2c947b22259 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.830365 29718 tablet_replica.cc:333] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.830991 29718 raft_consensus.cc:2243] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.831705 29718 raft_consensus.cc:2272] T a4029bb503654a3abfcebe96c447c872 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.833875 29718 tablet_replica.cc:333] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.834386 29718 raft_consensus.cc:2243] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.835099 29718 raft_consensus.cc:2272] T 085dea7e7e414db1b8b056d310f950b5 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.836932 29718 tablet_replica.cc:333] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.837477 29718 raft_consensus.cc:2243] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.837905 29718 raft_consensus.cc:2272] T dfa8c6fe7865458fa2972dc8acd8b18d P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.840247 29718 tablet_replica.cc:333] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.840885 29718 raft_consensus.cc:2243] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.841308 29718 raft_consensus.cc:2272] T 352aacdb915e4962b234ffec9089146d P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.843181 29718 tablet_replica.cc:333] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.843732 29718 raft_consensus.cc:2243] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.844524 29718 raft_consensus.cc:2272] T be33cc1f36f34068b484ab7216318820 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.846242 29718 tablet_replica.cc:333] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.846758 29718 raft_consensus.cc:2243] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.847146 29718 raft_consensus.cc:2272] T c20f3e5b7f804f9ca36132fb645b91f7 P e06813d9b94c44bc8010170059affc2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.849475 29718 tablet_replica.cc:333] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.850069 29718 raft_consensus.cc:2243] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.850481 29718 raft_consensus.cc:2272] T bd133bbcaad6446caef836fed56d89e3 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.852488 29718 tablet_replica.cc:333] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.853192 29718 raft_consensus.cc:2243] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.853641 29718 raft_consensus.cc:2272] T 7a0a7e5a2cbc44dc917cf605377dc94b P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.855504 29718 tablet_replica.cc:333] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.856066 29718 raft_consensus.cc:2243] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.856477 29718 raft_consensus.cc:2272] T a42323c88a944b76bfca0602a8d24650 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.858177 29718 tablet_replica.cc:333] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.858709 29718 raft_consensus.cc:2243] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.859119 29718 raft_consensus.cc:2272] T e0b0fa9345344e58b6da4eeb8ced9b49 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.862057 29718 tablet_replica.cc:333] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.862769 29718 raft_consensus.cc:2243] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.863821 29718 raft_consensus.cc:2272] T 2df012888d964e41b1c7175829371b55 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.866391 29718 tablet_replica.cc:333] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.866850 29718 raft_consensus.cc:2243] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.867200 29718 raft_consensus.cc:2272] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.869264 29718 tablet_replica.cc:333] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.869725 29718 raft_consensus.cc:2243] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.870070 29718 raft_consensus.cc:2272] T 14fec0eae8004693a813852224aed514 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.871902 29718 tablet_replica.cc:333] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.872530 29718 raft_consensus.cc:2243] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.873258 29718 raft_consensus.cc:2272] T afa747ca87014f5c848ea05f8e51b6bb P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.875731 29718 tablet_replica.cc:333] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.876261 29718 raft_consensus.cc:2243] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.876992 29718 raft_consensus.cc:2272] T 48be1d6a553c490eb7df545e052bf194 P e06813d9b94c44bc8010170059affc2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.879199 29718 tablet_replica.cc:333] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f: stopping tablet replica
I20260709 13:18:33.880342 29718 raft_consensus.cc:2243] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:33.881354 29718 raft_consensus.cc:2272] T f0679999514447789c20706e56d7a4f6 P e06813d9b94c44bc8010170059affc2f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:33.919307  7819 debug-util.cc:398] Leaking SignalData structure 0x7b0800395b00 after lost signal to thread 29721
W20260709 13:18:33.921378  7819 debug-util.cc:398] Leaking SignalData structure 0x7b08001b9780 after lost signal to thread 7655
I20260709 13:18:33.922466 29718 tablet_server.cc:196] TabletServer@127.29.5.129:0 shutdown complete.
W20260709 13:18:33.923830  7819 debug-util.cc:398] Leaking SignalData structure 0x7b08003927a0 after lost signal to thread 7822
W20260709 13:18:33.925277  7819 debug-util.cc:398] Leaking SignalData structure 0x7b08003750c0 after lost signal to thread 7896
I20260709 13:18:33.969578 29718 tablet_server.cc:179] TabletServer@127.29.5.130:0 shutting down...
W20260709 13:18:33.981637  7836 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:18:33.988042  7836 consensus_peers.cc:597] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:33.990646  7836 consensus_peers.cc:597] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:33.996163  7835 consensus_peers.cc:597] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:34.022490  7835 consensus_peers.cc:597] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:34.025504  7761 consensus_peers.cc:597] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:34.026476  7761 consensus_peers.cc:597] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:34.034698 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:34.035569 29718 tablet_replica.cc:333] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.036584 29718 raft_consensus.cc:2243] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.037613 29718 raft_consensus.cc:2272] T 22aba1482fb54caa81fce2c947b22259 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.039662 29718 tablet_replica.cc:333] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.040437 29718 raft_consensus.cc:2243] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.041342 29718 raft_consensus.cc:2272] T d0562f88033c404baf7f3ba0bd0b6d63 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:34.042958  7836 consensus_peers.cc:597] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:34.043614 29718 tablet_replica.cc:333] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.044363 29718 raft_consensus.cc:2243] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.044842 29718 raft_consensus.cc:2272] T f0679999514447789c20706e56d7a4f6 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.047392 29718 tablet_replica.cc:333] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.048018 29718 raft_consensus.cc:2243] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.048759 29718 raft_consensus.cc:2272] T dfa8c6fe7865458fa2972dc8acd8b18d P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.050631 29718 tablet_replica.cc:333] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.051214 29718 raft_consensus.cc:2243] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.051638 29718 raft_consensus.cc:2272] T a4029bb503654a3abfcebe96c447c872 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.054139 29718 tablet_replica.cc:333] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.055028 29718 raft_consensus.cc:2243] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.058806 29718 raft_consensus.cc:2272] T 085dea7e7e414db1b8b056d310f950b5 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:34.059478  7836 consensus_peers.cc:597] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:34.061390 29718 tablet_replica.cc:333] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.062252 29718 raft_consensus.cc:2243] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.062763 29718 raft_consensus.cc:2272] T c20f3e5b7f804f9ca36132fb645b91f7 P 57039b71674b4719abbef40a29a8ec03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.065551 29718 tablet_replica.cc:333] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.066128 29718 raft_consensus.cc:2243] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.066551 29718 raft_consensus.cc:2272] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.068638 29718 tablet_replica.cc:333] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.069224 29718 raft_consensus.cc:2243] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.069648 29718 raft_consensus.cc:2272] T 2df012888d964e41b1c7175829371b55 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.071388 29718 tablet_replica.cc:333] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.072003 29718 raft_consensus.cc:2243] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.072783 29718 raft_consensus.cc:2272] T bd133bbcaad6446caef836fed56d89e3 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.074714 29718 tablet_replica.cc:333] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.075255 29718 raft_consensus.cc:2243] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.076153 29718 raft_consensus.cc:2272] T 7a0a7e5a2cbc44dc917cf605377dc94b P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.078713 29718 tablet_replica.cc:333] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.079264 29718 raft_consensus.cc:2243] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.079792 29718 raft_consensus.cc:2272] T be33cc1f36f34068b484ab7216318820 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:34.081637  7835 consensus_peers.cc:597] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:34.082054 29718 tablet_replica.cc:333] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.082916 29718 raft_consensus.cc:2243] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.083823 29718 raft_consensus.cc:2272] T 352aacdb915e4962b234ffec9089146d P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.086299 29718 tablet_replica.cc:333] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
W20260709 13:18:34.086865  7835 consensus_peers.cc:597] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:34.086988 29718 raft_consensus.cc:2243] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.087749 29718 raft_consensus.cc:2272] T 14fec0eae8004693a813852224aed514 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.089761 29718 tablet_replica.cc:333] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.090325 29718 raft_consensus.cc:2243] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.090771 29718 raft_consensus.cc:2272] T 48be1d6a553c490eb7df545e052bf194 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.093050 29718 tablet_replica.cc:333] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.093648 29718 raft_consensus.cc:2243] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.094094 29718 raft_consensus.cc:2272] T afa747ca87014f5c848ea05f8e51b6bb P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.096114 29718 tablet_replica.cc:333] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.096639 29718 raft_consensus.cc:2243] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:34.097438 29718 raft_consensus.cc:2272] T a42323c88a944b76bfca0602a8d24650 P 57039b71674b4719abbef40a29a8ec03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.099450 29718 tablet_replica.cc:333] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03: stopping tablet replica
I20260709 13:18:34.100013 29718 raft_consensus.cc:2243] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:34.100433 29718 raft_consensus.cc:2272] T e0b0fa9345344e58b6da4eeb8ced9b49 P 57039b71674b4719abbef40a29a8ec03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:34.874475  8018 raft_consensus.cc:493] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:34.875831  8018 raft_consensus.cc:515] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:34.878872  8018 leader_election.cc:290] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:34.883388  7835 leader_election.cc:336] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:34.884166  7836 leader_election.cc:336] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:34.884645  7836 leader_election.cc:304] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:34.885568  8018 raft_consensus.cc:2749] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.049355  8018 raft_consensus.cc:493] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:35.049993  8018 raft_consensus.cc:515] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.051805  8018 leader_election.cc:290] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.055867  7835 leader_election.cc:336] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.056460  7836 leader_election.cc:336] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.056826  7836 leader_election.cc:304] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.057474  8018 raft_consensus.cc:2749] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.065667  8018 raft_consensus.cc:493] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:35.066443  8018 raft_consensus.cc:515] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.068832  8018 leader_election.cc:290] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.072407  7835 leader_election.cc:336] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.073634  7836 leader_election.cc:336] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.074075  7836 leader_election.cc:304] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.074839  8018 raft_consensus.cc:2749] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.076509  8018 raft_consensus.cc:493] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:35.077100  8018 raft_consensus.cc:515] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.078917  8018 leader_election.cc:290] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.083081  7836 leader_election.cc:336] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:35.083592  7835 leader_election.cc:336] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:35.083967  7835 leader_election.cc:304] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.084671  8018 raft_consensus.cc:2749] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.126899  8018 raft_consensus.cc:493] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.127840  8018 raft_consensus.cc:515] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.130297  8018 leader_election.cc:290] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.133905  7835 leader_election.cc:336] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.134572  7836 leader_election.cc:336] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.134949  7836 leader_election.cc:304] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.135816  8158 raft_consensus.cc:2749] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:35.139578 29718 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7819)
I20260709 13:18:35.164906  8158 raft_consensus.cc:493] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:35.165652  8158 raft_consensus.cc:515] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.167538  8158 leader_election.cc:290] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.171464  7835 leader_election.cc:336] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.171975  7836 leader_election.cc:336] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.172500  7836 leader_election.cc:304] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.173336  8158 raft_consensus.cc:2749] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.208454  8158 raft_consensus.cc:493] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.209203  8158 raft_consensus.cc:515] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.211404  8158 leader_election.cc:290] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.215337  7835 leader_election.cc:336] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.215981  7836 leader_election.cc:336] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.216331  7836 leader_election.cc:304] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.216967  8158 raft_consensus.cc:2749] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.254761  8158 raft_consensus.cc:493] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:35.255632  8158 raft_consensus.cc:515] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.258296  8158 leader_election.cc:290] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:35.260995  8158 raft_consensus.cc:493] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.261885  8158 raft_consensus.cc:515] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
W20260709 13:18:35.262514  7835 leader_election.cc:336] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.263104  7836 leader_election.cc:336] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.263556  7836 leader_election.cc:304] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.264390  8018 raft_consensus.cc:2749] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.264365  8158 leader_election.cc:290] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.268450  7835 leader_election.cc:336] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.268926  7836 leader_election.cc:336] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.269385  7836 leader_election.cc:304] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.270164  8158 raft_consensus.cc:2749] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.315414  8158 raft_consensus.cc:493] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.316177  8158 raft_consensus.cc:515] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.318177  8158 leader_election.cc:290] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
I20260709 13:18:35.322273  8158 raft_consensus.cc:493] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
W20260709 13:18:35.322845  7836 leader_election.cc:336] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:35.323514  7835 leader_election.cc:336] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:35.323110  8158 raft_consensus.cc:515] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:35.323984  7835 leader_election.cc:304] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.324645  8018 raft_consensus.cc:2749] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.325719  8158 leader_election.cc:290] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607)
W20260709 13:18:35.329718  7835 leader_election.cc:336] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.330394  7836 leader_election.cc:336] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.330763  7836 leader_election.cc:304] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.331404  8158 raft_consensus.cc:2749] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.374799  8158 raft_consensus.cc:493] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.375604  8158 raft_consensus.cc:515] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.378072  8158 leader_election.cc:290] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.382015  7835 leader_election.cc:336] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.382506  7836 leader_election.cc:336] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.382997  7836 leader_election.cc:304] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.383900  8158 raft_consensus.cc:2749] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:35.439388  8158 raft_consensus.cc:493] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.440240  8158 raft_consensus.cc:515] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.442736  8158 leader_election.cc:290] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.446305  7835 leader_election.cc:336] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.447117  7836 leader_election.cc:336] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.447475  7836 leader_election.cc:304] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.448135  8158 raft_consensus.cc:2749] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:35.512506  8158 raft_consensus.cc:493] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:35.513356  8158 raft_consensus.cc:515] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:35.515852  8158 leader_election.cc:290] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:35.519498  7835 leader_election.cc:336] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:35.520747  7836 leader_election.cc:336] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:35.521126  7836 leader_election.cc:304] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:35.521744  8158 raft_consensus.cc:2749] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:36.140130 29718 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7819)
W20260709 13:18:36.467007  7836 consensus_peers.cc:597] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:36.472824  7836 consensus_peers.cc:597] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:36.502264  7836 consensus_peers.cc:597] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:36.515241  7836 consensus_peers.cc:597] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Couldn't send request to peer 57039b71674b4719abbef40a29a8ec03. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:36.607489  8173 raft_consensus.cc:493] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:36.608278  8173 raft_consensus.cc:515] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:36.610741  8173 leader_election.cc:290] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:36.614992  7835 leader_election.cc:336] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:36.616029  7836 leader_election.cc:336] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:36.616484  7836 leader_election.cc:304] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:36.617188  8173 raft_consensus.cc:2749] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:18:36.644055  7835 consensus_peers.cc:597] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:36.695875  7835 consensus_peers.cc:597] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:36.699970  7835 consensus_peers.cc:597] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:36.756611  7835 consensus_peers.cc:597] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 -> Peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Couldn't send request to peer e06813d9b94c44bc8010170059affc2f. Status: Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:36.855530  8173 raft_consensus.cc:493] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:36.856323  8173 raft_consensus.cc:515] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:36.858963  8173 leader_election.cc:290] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:36.862381  7835 leader_election.cc:336] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:36.864120  7836 leader_election.cc:336] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:36.864440  7836 leader_election.cc:304] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:36.865006  8173 raft_consensus.cc:2749] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:36.924248  8173 raft_consensus.cc:493] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:36.924881  8173 raft_consensus.cc:515] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:36.927421  8173 leader_election.cc:290] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:36.931937  7836 leader_election.cc:336] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:36.932459  7835 leader_election.cc:336] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:36.932876  7835 leader_election.cc:304] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:36.933610  8173 raft_consensus.cc:2749] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:36.985723  8173 raft_consensus.cc:493] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:36.986363  8173 raft_consensus.cc:515] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:36.988886  8173 leader_election.cc:290] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:36.992532  7835 leader_election.cc:336] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:36.992962  7836 leader_election.cc:336] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:36.993340  7836 leader_election.cc:304] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:36.993894  8173 raft_consensus.cc:2749] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.003921  8173 raft_consensus.cc:493] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:37.004449  8173 raft_consensus.cc:515] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.006788  8173 leader_election.cc:290] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.010213  7835 leader_election.cc:336] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:37.011042  7836 leader_election.cc:336] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:37.011368  7836 leader_election.cc:304] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.011974  8173 raft_consensus.cc:2749] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.027086  8173 raft_consensus.cc:493] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:37.027674  8173 raft_consensus.cc:515] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.030143  8173 leader_election.cc:290] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.033649  7835 leader_election.cc:336] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:37.034219  7836 leader_election.cc:336] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:37.034535  7836 leader_election.cc:304] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.035084  8173 raft_consensus.cc:2749] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.058293  8173 raft_consensus.cc:493] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:37.058827  8173 raft_consensus.cc:515] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.061110  8173 leader_election.cc:290] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.067366  7835 leader_election.cc:336] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:37.069161  7836 leader_election.cc:336] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:37.069546  7836 leader_election.cc:304] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.070205  8176 raft_consensus.cc:2749] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.133103  8176 raft_consensus.cc:493] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:37.133606  8176 raft_consensus.cc:515] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.135386  8176 leader_election.cc:290] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.139457  7836 leader_election.cc:336] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:37.140035  7835 leader_election.cc:336] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:37.140576 29718 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7819)
I20260709 13:18:37.140507  7835 leader_election.cc:304] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.141390  8176 raft_consensus.cc:2749] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.165506  8176 raft_consensus.cc:493] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:37.166112  8176 raft_consensus.cc:515] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.168571  8176 leader_election.cc:290] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.172453  7835 leader_election.cc:336] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
W20260709 13:18:37.173004  7836 leader_election.cc:336] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
I20260709 13:18:37.173462  7836 leader_election.cc:304] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.174196  8176 raft_consensus.cc:2749] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.197438  8176 raft_consensus.cc:493] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:37.197912  8176 raft_consensus.cc:515] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.199815  8176 leader_election.cc:290] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.203497  7836 leader_election.cc:336] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:37.203981  7835 leader_election.cc:336] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:37.204362  7835 leader_election.cc:304] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.205504  8176 raft_consensus.cc:2749] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.237478  8176 raft_consensus.cc:493] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:37.238013  8176 raft_consensus.cc:515] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.240226  8176 leader_election.cc:290] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.246259  7836 leader_election.cc:336] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:37.246982  7835 leader_election.cc:336] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:37.247570  7835 leader_election.cc:304] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.248435  8176 raft_consensus.cc:2749] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.269119  8176 raft_consensus.cc:493] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:37.269769  8176 raft_consensus.cc:515] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.272336  8176 leader_election.cc:290] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.276875  7836 leader_election.cc:336] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:37.277406  7835 leader_election.cc:336] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:37.277773  7835 leader_election.cc:304] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.278362  8176 raft_consensus.cc:2749] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.353202  8176 raft_consensus.cc:493] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e06813d9b94c44bc8010170059affc2f)
I20260709 13:18:37.353828  8176 raft_consensus.cc:515] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } }
I20260709 13:18:37.356263  8176 leader_election.cc:290] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965), e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607)
W20260709 13:18:37.360339  7836 leader_election.cc:336] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:37.360826  7835 leader_election.cc:336] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:37.361253  7835 leader_election.cc:304] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.361968  8176 raft_consensus.cc:2749] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:37.467458  8176 raft_consensus.cc:493] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 57039b71674b4719abbef40a29a8ec03)
I20260709 13:18:37.468051  8176 raft_consensus.cc:515] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e06813d9b94c44bc8010170059affc2f" member_type: VOTER last_known_addr { host: "127.29.5.129" port: 45607 } } peers { permanent_uuid: "57039b71674b4719abbef40a29a8ec03" member_type: VOTER last_known_addr { host: "127.29.5.130" port: 45965 } } peers { permanent_uuid: "ad5bcb3e418842f998b2f9aa622c7527" member_type: VOTER last_known_addr { host: "127.29.5.131" port: 38115 } }
I20260709 13:18:37.469928  8176 leader_election.cc:290] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607), 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965)
W20260709 13:18:37.473815  7836 leader_election.cc:336] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 57039b71674b4719abbef40a29a8ec03 (127.29.5.130:45965): Network error: Client connection negotiation failed: client connection to 127.29.5.130:45965: connect: Connection refused (error 111)
W20260709 13:18:37.474403  7835 leader_election.cc:336] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e06813d9b94c44bc8010170059affc2f (127.29.5.129:45607): Network error: Client connection negotiation failed: client connection to 127.29.5.129:45607: connect: Connection refused (error 111)
I20260709 13:18:37.474787  7835 leader_election.cc:304] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad5bcb3e418842f998b2f9aa622c7527; no voters: 57039b71674b4719abbef40a29a8ec03, e06813d9b94c44bc8010170059affc2f
I20260709 13:18:37.475353  8176 raft_consensus.cc:2749] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:37.661825 29718 tablet_server.cc:196] TabletServer@127.29.5.130:0 shutdown complete.
I20260709 13:18:37.725580 29718 tablet_server.cc:179] TabletServer@127.29.5.131:0 shutting down...
I20260709 13:18:37.753599 29718 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:37.754499 29718 tablet_replica.cc:333] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.755852 29718 raft_consensus.cc:2243] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.756626 29718 raft_consensus.cc:2272] T 22aba1482fb54caa81fce2c947b22259 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.759107 29718 tablet_replica.cc:333] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.759732 29718 raft_consensus.cc:2243] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.760362 29718 raft_consensus.cc:2272] T dfa8c6fe7865458fa2972dc8acd8b18d P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.763088 29718 tablet_replica.cc:333] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.763604 29718 raft_consensus.cc:2243] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.764166 29718 raft_consensus.cc:2272] T d0562f88033c404baf7f3ba0bd0b6d63 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.766487 29718 tablet_replica.cc:333] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.767074 29718 raft_consensus.cc:2243] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.767552 29718 raft_consensus.cc:2272] T a4029bb503654a3abfcebe96c447c872 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.769891 29718 tablet_replica.cc:333] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.770401 29718 raft_consensus.cc:2243] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.770884 29718 raft_consensus.cc:2272] T f0679999514447789c20706e56d7a4f6 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.773216 29718 tablet_replica.cc:333] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.773728 29718 raft_consensus.cc:2243] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.774224 29718 raft_consensus.cc:2272] T 085dea7e7e414db1b8b056d310f950b5 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.776723 29718 tablet_replica.cc:333] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.777297 29718 raft_consensus.cc:2243] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.777783 29718 raft_consensus.cc:2272] T 352aacdb915e4962b234ffec9089146d P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.779974 29718 tablet_replica.cc:333] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.780468 29718 raft_consensus.cc:2243] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.780947 29718 raft_consensus.cc:2272] T be33cc1f36f34068b484ab7216318820 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.783267 29718 tablet_replica.cc:333] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.783823 29718 raft_consensus.cc:2243] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:37.784847 29718 raft_consensus.cc:2272] T c20f3e5b7f804f9ca36132fb645b91f7 P ad5bcb3e418842f998b2f9aa622c7527 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.787194 29718 tablet_replica.cc:333] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.787811 29718 raft_consensus.cc:2243] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.788283 29718 raft_consensus.cc:2272] T bd133bbcaad6446caef836fed56d89e3 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.790608 29718 tablet_replica.cc:333] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.791188 29718 raft_consensus.cc:2243] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.791656 29718 raft_consensus.cc:2272] T 7a0a7e5a2cbc44dc917cf605377dc94b P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.793991 29718 tablet_replica.cc:333] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.794545 29718 raft_consensus.cc:2243] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:37.795461 29718 raft_consensus.cc:2272] T 14fec0eae8004693a813852224aed514 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.797899 29718 tablet_replica.cc:333] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.798549 29718 raft_consensus.cc:2243] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.799083 29718 raft_consensus.cc:2272] T 48be1d6a553c490eb7df545e052bf194 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.801340 29718 tablet_replica.cc:333] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.801841 29718 raft_consensus.cc:2243] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.802338 29718 raft_consensus.cc:2272] T afa747ca87014f5c848ea05f8e51b6bb P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.804754 29718 tablet_replica.cc:333] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.805302 29718 raft_consensus.cc:2243] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.805801 29718 raft_consensus.cc:2272] T 2df012888d964e41b1c7175829371b55 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.808247 29718 tablet_replica.cc:333] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.808776 29718 raft_consensus.cc:2243] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:37.811437 29718 raft_consensus.cc:2272] T 4fd35fb9ad734c4bbd68c8a8ab2d8b9b P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.813779 29718 tablet_replica.cc:333] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.814291 29718 raft_consensus.cc:2243] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.814839 29718 raft_consensus.cc:2272] T a42323c88a944b76bfca0602a8d24650 P ad5bcb3e418842f998b2f9aa622c7527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.817041 29718 tablet_replica.cc:333] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527: stopping tablet replica
I20260709 13:18:37.817519 29718 raft_consensus.cc:2243] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:37.818435 29718 raft_consensus.cc:2272] T e0b0fa9345344e58b6da4eeb8ced9b49 P ad5bcb3e418842f998b2f9aa622c7527 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.866822 29718 tablet_server.cc:196] TabletServer@127.29.5.131:0 shutdown complete.
I20260709 13:18:37.910648 29718 master.cc:562] Master@127.29.5.190:42119 shutting down...
I20260709 13:18:37.936190 29718 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:37.936854 29718 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.937151 29718 tablet_replica.cc:333] T 00000000000000000000000000000000 P e181a6c75b7641a697bd4cab596bbcec: stopping tablet replica
I20260709 13:18:37.958849 29718 master.cc:584] Master@127.29.5.190:42119 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14933 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (27289 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (313961 ms total)
[  PASSED  ] 8 tests.
I20260709 13:18:38.018111 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 506 messages since previous log ~17 seconds ago
I20260709 13:18:38.018319 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 506 messages since previous log ~17 seconds ago
I20260709 13:18:38.018455 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 506 messages since previous log ~17 seconds ago
I20260709 13:18:38.018607 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:18:38.018761 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:18:38.018906 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~121 seconds ago
I20260709 13:18:38.019042 29718 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~215 seconds ago
I20260709 13:18:38.019184 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~215 seconds ago
I20260709 13:18:38.019384 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 120 messages since previous log ~4 seconds ago
I20260709 13:18:38.019634 29718 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~9 seconds ago
